[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:20:34.774544 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:43823
I20260709 12:20:34.776170 29609 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:20:34.777303 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:34.795953 29618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.795924 29615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.795938 29616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:34.797331 29609 server_base.cc:1061] running on GCE node
I20260709 12:20:36.078229 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:36.078547 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:36.078728 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599636078709 us; error 0 us; skew 500 ppm
I20260709 12:20:36.079620 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:36.085700 29609 webserver.cc:533] Webserver started at http://127.28.234.126:34577/ using document root <none> and password file <none>
I20260709 12:20:36.086766 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:36.086995 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:36.087458 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:36.094151 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "7bafae2bac37413aa407144c758845c3"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.103359 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:20:36.109292 29624 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.110760 29609 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:20:36.111202 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "7bafae2bac37413aa407144c758845c3"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.111569 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:36.183531 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:36.185194 29609 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:20:36.185703 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:36.264369 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:43823
I20260709 12:20:36.264530 29675 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:43823 every 8 connection(s)
I20260709 12:20:36.272632 29676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:36.295073 29676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3: Bootstrap starting.
I20260709 12:20:36.301259 29676 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:36.303383 29676 log.cc:826] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3: Log is configured to *not* fsync() on all Append() calls
I20260709 12:20:36.308151 29676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3: No bootstrap required, opened a new log
I20260709 12:20:36.330317 29676 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bafae2bac37413aa407144c758845c3" member_type: VOTER }
I20260709 12:20:36.330912 29676 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:36.331209 29676 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bafae2bac37413aa407144c758845c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:36.332294 29676 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bafae2bac37413aa407144c758845c3" member_type: VOTER }
I20260709 12:20:36.332837 29676 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:36.333163 29676 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:36.333524 29676 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:36.338063 29676 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bafae2bac37413aa407144c758845c3" member_type: VOTER }
I20260709 12:20:36.338927 29676 leader_election.cc:304] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bafae2bac37413aa407144c758845c3; no voters: 
I20260709 12:20:36.340811 29676 leader_election.cc:290] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:36.341233 29679 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:36.343760 29679 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 1 LEADER]: Becoming Leader. State: Replica: 7bafae2bac37413aa407144c758845c3, State: Running, Role: LEADER
I20260709 12:20:36.344913 29679 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bafae2bac37413aa407144c758845c3" member_type: VOTER }
I20260709 12:20:36.346149 29676 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:36.356067 29681 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bafae2bac37413aa407144c758845c3. Latest consensus state: current_term: 1 leader_uuid: "7bafae2bac37413aa407144c758845c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bafae2bac37413aa407144c758845c3" member_type: VOTER } }
I20260709 12:20:36.356238 29680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bafae2bac37413aa407144c758845c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bafae2bac37413aa407144c758845c3" member_type: VOTER } }
I20260709 12:20:36.357051 29680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:36.358011 29681 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:36.360093 29687 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:36.372315 29687 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:36.377146 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:36.392237 29687 catalog_manager.cc:1383] Generated new cluster ID: af35adbc02f14438a3279dbb71ed64c5
I20260709 12:20:36.392587 29687 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:36.435240 29687 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:36.436975 29687 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:36.451669 29687 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3: Generated new TSK 0
I20260709 12:20:36.452641 29687 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:36.509119 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:36.519595 29699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:36.521637 29700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:36.524322 29702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:36.525730 29609 server_base.cc:1061] running on GCE node
I20260709 12:20:36.526675 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:36.526914 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:36.527107 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599636527090 us; error 0 us; skew 500 ppm
I20260709 12:20:36.527763 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:36.532552 29609 webserver.cc:533] Webserver started at http://127.28.234.65:41885/ using document root <none> and password file <none>
I20260709 12:20:36.533139 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:36.533377 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:36.533669 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:36.534891 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.541071 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:20:36.546051 29707 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.546988 29609 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:36.547348 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.547660 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:36.580979 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:36.582593 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:36.585613 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:36.590569 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:36.590821 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.591166 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:36.591327 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.697696 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:41941
I20260709 12:20:36.697791 29769 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:41941 every 8 connection(s)
I20260709 12:20:36.705181 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:36.715409 29774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:36.717303 29775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:36.722805 29609 server_base.cc:1061] running on GCE node
W20260709 12:20:36.723780 29777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:36.724843 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:36.725095 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:36.725332 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599636725307 us; error 0 us; skew 500 ppm
I20260709 12:20:36.726176 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:36.729384 29609 webserver.cc:533] Webserver started at http://127.28.234.66:33281/ using document root <none> and password file <none>
I20260709 12:20:36.730145 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:36.730202 29770 heartbeater.cc:344] Connected to a master server at 127.28.234.126:43823
I20260709 12:20:36.730489 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:36.730775 29770 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:36.730857 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:36.732100 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.732116 29770 heartbeater.cc:507] Master 127.28.234.126:43823 requested a full tablet report, sending...
I20260709 12:20:36.736256 29641 ts_manager.cc:194] Registered new tserver with Master: 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941)
I20260709 12:20:36.739029 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:20:36.739415 29641 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55718
I20260709 12:20:36.745085 29782 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.746122 29609 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:36.746454 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.746735 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:36.774060 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:36.775504 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:36.778630 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:36.781983 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:36.782200 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.782545 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:36.782703 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.886240 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:38601
I20260709 12:20:36.886379 29845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:38601 every 8 connection(s)
I20260709 12:20:36.900295 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:36.911448 29849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:36.913801 29846 heartbeater.cc:344] Connected to a master server at 127.28.234.126:43823
I20260709 12:20:36.914284 29846 heartbeater.cc:461] Registering TS with master...
W20260709 12:20:36.914515 29850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:36.915640 29846 heartbeater.cc:507] Master 127.28.234.126:43823 requested a full tablet report, sending...
I20260709 12:20:36.918968 29641 ts_manager.cc:194] Registered new tserver with Master: 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:36.919359 29609 server_base.cc:1061] running on GCE node
W20260709 12:20:36.920318 29853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:36.920527 29641 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55720
I20260709 12:20:36.921437 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:36.921737 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:36.921978 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599636921957 us; error 0 us; skew 500 ppm
I20260709 12:20:36.922773 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:36.925474 29609 webserver.cc:533] Webserver started at http://127.28.234.67:35645/ using document root <none> and password file <none>
I20260709 12:20:36.926015 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:36.926224 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:36.926527 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:36.927618 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.932555 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:36.936367 29857 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.937415 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:20:36.937726 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
format_stamp: "Formatted at 2026-07-09 12:20:36 on dist-test-slave-8c39"
I20260709 12:20:36.938098 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:36.953406 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:36.954816 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:36.956337 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:36.958772 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:36.959009 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:36.959252 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:36.959443 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:37.064791 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:45893
I20260709 12:20:37.064934 29919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:45893 every 8 connection(s)
I20260709 12:20:37.084517 29920 heartbeater.cc:344] Connected to a master server at 127.28.234.126:43823
I20260709 12:20:37.085000 29920 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:37.086015 29920 heartbeater.cc:507] Master 127.28.234.126:43823 requested a full tablet report, sending...
I20260709 12:20:37.088419 29641 ts_manager.cc:194] Registered new tserver with Master: 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:37.088938 29609 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014914996s
I20260709 12:20:37.090394 29641 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55736
I20260709 12:20:37.150439 29641 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55744:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:37.155597 29641 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:37.271924 29810 tablet_service.cc:1511] Processing CreateTablet for tablet db77a416b1264c93976549f08ceb1670 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:37.271983 29809 tablet_service.cc:1511] Processing CreateTablet for tablet 6e16e54ad1844aecbbe54fb18ac0392d (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:37.274791 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e16e54ad1844aecbbe54fb18ac0392d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.276495 29808 tablet_service.cc:1511] Processing CreateTablet for tablet 2336e66ed982422f87134423176743e6 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:37.277880 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db77a416b1264c93976549f08ceb1670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.280900 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2336e66ed982422f87134423176743e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.285122 29807 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3c096966c64770820591e2bfc678de (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:37.286662 29807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3c096966c64770820591e2bfc678de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.294627 29806 tablet_service.cc:1511] Processing CreateTablet for tablet a0e7011e5be8416cb489c476ed60af48 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:37.296222 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e7011e5be8416cb489c476ed60af48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.298940 29805 tablet_service.cc:1511] Processing CreateTablet for tablet 82aa315ca1e7409ba1e86f74e1811e98 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:37.300458 29805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aa315ca1e7409ba1e86f74e1811e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.343040 29938 tablet_bootstrap.cc:492] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:37.333179 29735 tablet_service.cc:1511] Processing CreateTablet for tablet db77a416b1264c93976549f08ceb1670 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:37.340379 29734 tablet_service.cc:1511] Processing CreateTablet for tablet 6e16e54ad1844aecbbe54fb18ac0392d (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:37.348052 29808 tablet_service.cc:1511] Processing CreateTablet for tablet 7d580abc61184101979e43ff478b9f21 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:37.351327 29733 tablet_service.cc:1511] Processing CreateTablet for tablet 2336e66ed982422f87134423176743e6 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:37.352061 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d580abc61184101979e43ff478b9f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.350555 29730 tablet_service.cc:1511] Processing CreateTablet for tablet 82aa315ca1e7409ba1e86f74e1811e98 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:37.357053 29729 tablet_service.cc:1511] Processing CreateTablet for tablet 7d580abc61184101979e43ff478b9f21 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:37.356930 29731 tablet_service.cc:1511] Processing CreateTablet for tablet a0e7011e5be8416cb489c476ed60af48 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:37.361171 29732 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3c096966c64770820591e2bfc678de (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:37.365101 29728 tablet_service.cc:1511] Processing CreateTablet for tablet 906593f579ab4fe393d1d9d128ccaf47 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:37.369170 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2336e66ed982422f87134423176743e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.369984 29731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e7011e5be8416cb489c476ed60af48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.372606 29728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906593f579ab4fe393d1d9d128ccaf47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:37.373612 29689 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:37.374941 29735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db77a416b1264c93976549f08ceb1670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.376494 29732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3c096966c64770820591e2bfc678de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.378811 29729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d580abc61184101979e43ff478b9f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.388659 29730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aa315ca1e7409ba1e86f74e1811e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.387535 29885 tablet_service.cc:1511] Processing CreateTablet for tablet db77a416b1264c93976549f08ceb1670 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:37.403745 29881 tablet_service.cc:1511] Processing CreateTablet for tablet a0e7011e5be8416cb489c476ed60af48 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:37.396716 29884 tablet_service.cc:1511] Processing CreateTablet for tablet 6e16e54ad1844aecbbe54fb18ac0392d (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:37.408880 29885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db77a416b1264c93976549f08ceb1670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.407438 29879 tablet_service.cc:1511] Processing CreateTablet for tablet 7d580abc61184101979e43ff478b9f21 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:37.411731 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e16e54ad1844aecbbe54fb18ac0392d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.419864 29806 tablet_service.cc:1511] Processing CreateTablet for tablet 906593f579ab4fe393d1d9d128ccaf47 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:37.419680 29880 tablet_service.cc:1511] Processing CreateTablet for tablet 82aa315ca1e7409ba1e86f74e1811e98 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:37.413905 29883 tablet_service.cc:1511] Processing CreateTablet for tablet 2336e66ed982422f87134423176743e6 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:37.480213 29881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e7011e5be8416cb489c476ed60af48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.511718 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906593f579ab4fe393d1d9d128ccaf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.515344 29884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e16e54ad1844aecbbe54fb18ac0392d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.526203 29879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d580abc61184101979e43ff478b9f21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.425956 29882 tablet_service.cc:1511] Processing CreateTablet for tablet 4d3c096966c64770820591e2bfc678de (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:37.534256 29878 tablet_service.cc:1511] Processing CreateTablet for tablet 906593f579ab4fe393d1d9d128ccaf47 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:37.543241 29880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82aa315ca1e7409ba1e86f74e1811e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.550310 29727 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0fe9179b604b1b9672f064da6aa4e2 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:37.555859 29883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2336e66ed982422f87134423176743e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.557404 29727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0fe9179b604b1b9672f064da6aa4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.558403 29878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906593f579ab4fe393d1d9d128ccaf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.574421 29810 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0fe9179b604b1b9672f064da6aa4e2 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:37.578893 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0fe9179b604b1b9672f064da6aa4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.582680 29939 tablet_bootstrap.cc:492] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:37.589309 29938 tablet_bootstrap.cc:654] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.595396 29882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d3c096966c64770820591e2bfc678de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.599874 29877 tablet_service.cc:1511] Processing CreateTablet for tablet 7b0fe9179b604b1b9672f064da6aa4e2 (DEFAULT_TABLE table=test-workload [id=dea91bc43d5a4e88949a18f98476cb36]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:37.623425 29877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b0fe9179b604b1b9672f064da6aa4e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:37.646591 29938 tablet_bootstrap.cc:492] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:37.647161 29938 ts_tablet_manager.cc:1403] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.323s	user 0.014s	sys 0.026s
I20260709 12:20:37.652478 29938 raft_consensus.cc:359] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.658277 29938 raft_consensus.cc:385] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.658663 29938 raft_consensus.cc:740] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.666224 29939 tablet_bootstrap.cc:654] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.671250 29941 tablet_bootstrap.cc:492] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:37.666886 29938 consensus_queue.cc:260] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.698266 29938 ts_tablet_manager.cc:1434] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.016s
I20260709 12:20:37.699482 29846 heartbeater.cc:499] Master 127.28.234.126:43823 was elected leader, sending a full tablet report...
I20260709 12:20:37.702687 29942 raft_consensus.cc:493] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.703420 29942 raft_consensus.cc:515] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.713371 29938 tablet_bootstrap.cc:492] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:37.721462 29942 leader_election.cc:290] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:37.727028 29941 tablet_bootstrap.cc:654] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.743430 29770 heartbeater.cc:499] Master 127.28.234.126:43823 was elected leader, sending a full tablet report...
I20260709 12:20:37.739133 29939 tablet_bootstrap.cc:492] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:37.744890 29939 ts_tablet_manager.cc:1403] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.179s	user 0.007s	sys 0.023s
I20260709 12:20:37.747181 29938 tablet_bootstrap.cc:654] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.749576 29939 raft_consensus.cc:359] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.750478 29939 raft_consensus.cc:385] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.750877 29939 raft_consensus.cc:740] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.751860 29939 consensus_queue.cc:260] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.764588 29941 tablet_bootstrap.cc:492] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:37.765100 29941 ts_tablet_manager.cc:1403] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.010s
I20260709 12:20:37.772235 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
W20260709 12:20:37.775457 29784 leader_election.cc:343] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.780264 29895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
W20260709 12:20:37.782307 29783 leader_election.cc:343] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.782840 29783 leader_election.cc:304] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:37.788552 29939 ts_tablet_manager.cc:1434] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.013s
I20260709 12:20:37.788686 29941 raft_consensus.cc:359] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.789518 29941 raft_consensus.cc:385] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.789706 29939 tablet_bootstrap.cc:492] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:37.789881 29941 raft_consensus.cc:740] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.790891 29941 consensus_queue.cc:260] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.792309 29938 tablet_bootstrap.cc:492] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:37.792798 29938 ts_tablet_manager.cc:1403] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.000s
I20260709 12:20:37.794023 29942 raft_consensus.cc:2749] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:37.797618 29939 tablet_bootstrap.cc:654] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.807277 29920 heartbeater.cc:499] Master 127.28.234.126:43823 was elected leader, sending a full tablet report...
I20260709 12:20:37.807504 29941 ts_tablet_manager.cc:1434] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.042s	user 0.015s	sys 0.006s
I20260709 12:20:37.808701 29941 tablet_bootstrap.cc:492] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:37.808809 29938 raft_consensus.cc:359] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.809736 29938 raft_consensus.cc:385] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.810182 29938 raft_consensus.cc:740] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.811064 29938 consensus_queue.cc:260] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.814725 29939 tablet_bootstrap.cc:492] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:37.815261 29939 ts_tablet_manager.cc:1403] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.009s
I20260709 12:20:37.816538 29941 tablet_bootstrap.cc:654] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.818580 29939 raft_consensus.cc:359] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.819433 29939 raft_consensus.cc:385] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.819811 29939 raft_consensus.cc:740] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.820698 29939 consensus_queue.cc:260] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.823253 29939 ts_tablet_manager.cc:1434] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:37.824364 29939 tablet_bootstrap.cc:492] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
W20260709 12:20:37.825328 29921 tablet.cc:2406] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:37.827726 29938 ts_tablet_manager.cc:1434] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.004s
I20260709 12:20:37.831861 29939 tablet_bootstrap.cc:654] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.844949 29939 tablet_bootstrap.cc:492] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:37.845512 29939 ts_tablet_manager.cc:1403] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 12:20:37.852249 29939 raft_consensus.cc:359] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.853093 29939 raft_consensus.cc:385] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.853464 29939 raft_consensus.cc:740] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.854277 29938 tablet_bootstrap.cc:492] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:37.854276 29939 consensus_queue.cc:260] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.856850 29939 ts_tablet_manager.cc:1434] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:20:37.857970 29939 tablet_bootstrap.cc:492] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:37.864320 29938 tablet_bootstrap.cc:654] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.866060 29939 tablet_bootstrap.cc:654] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.873521 29941 tablet_bootstrap.cc:492] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:37.874197 29941 ts_tablet_manager.cc:1403] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.021s
I20260709 12:20:37.878048 29938 tablet_bootstrap.cc:492] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:37.878048 29941 raft_consensus.cc:359] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.878767 29938 ts_tablet_manager.cc:1403] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.010s
I20260709 12:20:37.878882 29941 raft_consensus.cc:385] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.879345 29941 raft_consensus.cc:740] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.880211 29941 consensus_queue.cc:260] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.882457 29941 ts_tablet_manager.cc:1434] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:37.883472 29941 tablet_bootstrap.cc:492] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:37.884166 29938 raft_consensus.cc:359] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.885174 29938 raft_consensus.cc:385] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.885618 29938 raft_consensus.cc:740] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.887046 29939 tablet_bootstrap.cc:492] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:37.886672 29938 consensus_queue.cc:260] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.887578 29939 ts_tablet_manager.cc:1403] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.011s
I20260709 12:20:37.889423 29938 ts_tablet_manager.cc:1434] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:20:37.893605 29938 tablet_bootstrap.cc:492] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:37.891567 29939 raft_consensus.cc:359] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.894232 29939 raft_consensus.cc:385] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.894647 29939 raft_consensus.cc:740] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.895490 29939 consensus_queue.cc:260] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.898432 29939 ts_tablet_manager.cc:1434] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:20:37.899559 29939 tablet_bootstrap.cc:492] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:37.902745 29938 tablet_bootstrap.cc:654] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.906878 29939 tablet_bootstrap.cc:654] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.912699 29948 raft_consensus.cc:493] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.913345 29948 raft_consensus.cc:515] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.915501 29938 tablet_bootstrap.cc:492] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:37.916304 29948 leader_election.cc:290] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:37.916095 29938 ts_tablet_manager.cc:1403] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 12:20:37.923774 29939 tablet_bootstrap.cc:492] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:37.924332 29939 ts_tablet_manager.cc:1403] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:20:37.927747 29938 raft_consensus.cc:359] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.928463 29939 raft_consensus.cc:359] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.931023 29941 tablet_bootstrap.cc:654] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.932786 29939 raft_consensus.cc:385] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.933314 29939 raft_consensus.cc:740] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.934424 29939 consensus_queue.cc:260] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.937676 29939 ts_tablet_manager.cc:1434] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 12:20:37.938798 29939 tablet_bootstrap.cc:492] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:37.943743 29938 raft_consensus.cc:385] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.944609 29938 raft_consensus.cc:740] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.949561 29895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
W20260709 12:20:37.951942 29708 leader_election.cc:343] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:37.952886 29938 consensus_queue.cc:260] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.953684 29948 raft_consensus.cc:493] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.954252 29948 raft_consensus.cc:515] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.956488 29948 leader_election.cc:290] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:37.956967 29948 raft_consensus.cc:493] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:37.957626 29895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
I20260709 12:20:37.957419 29948 raft_consensus.cc:515] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.958196 29938 ts_tablet_manager.cc:1434] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.035s	user 0.001s	sys 0.007s
I20260709 12:20:37.958372 29895 raft_consensus.cc:2468] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:37.959220 29938 tablet_bootstrap.cc:492] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:37.960022 29708 leader_election.cc:304] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:37.964244 29939 tablet_bootstrap.cc:654] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.967716 29948 leader_election.cc:290] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:37.968402 29948 raft_consensus.cc:2804] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:37.968806 29948 raft_consensus.cc:493] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:37.969033 29895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
I20260709 12:20:37.969789 29895 raft_consensus.cc:2468] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:37.969218 29948 raft_consensus.cc:3060] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:37.971377 29708 leader_election.cc:304] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:37.972059 29938 tablet_bootstrap.cc:654] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:37.975085 29941 tablet_bootstrap.cc:492] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:37.975595 29941 ts_tablet_manager.cc:1403] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.092s	user 0.005s	sys 0.011s
I20260709 12:20:37.984609 29948 raft_consensus.cc:515] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.985823 29938 tablet_bootstrap.cc:492] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:37.986830 29938 ts_tablet_manager.cc:1403] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 12:20:37.987033 29941 raft_consensus.cc:359] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.988131 29941 raft_consensus.cc:385] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:37.991777 29941 raft_consensus.cc:740] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:37.992666 29941 consensus_queue.cc:260] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:37.996817 29948 leader_election.cc:290] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:37.997418 29948 raft_consensus.cc:2804] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:37.998782 29895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.000070 29895 raft_consensus.cc:3060] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.001431 29948 raft_consensus.cc:493] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.004117 29948 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.006198 29941 ts_tablet_manager.cc:1434] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.001s
I20260709 12:20:38.014084 29948 raft_consensus.cc:515] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.016314 29948 leader_election.cc:290] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.017340 29941 tablet_bootstrap.cc:492] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:38.020489 29895 raft_consensus.cc:2468] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 1.
I20260709 12:20:38.019434 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.022294 29708 leader_election.cc:304] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:38.024781 29894 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.025460 29938 raft_consensus.cc:359] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.026240 29962 raft_consensus.cc:2804] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.026666 29938 raft_consensus.cc:385] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.025955 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.027340 29938 raft_consensus.cc:740] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.029109 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.028792 29962 raft_consensus.cc:697] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:38.030386 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.031591 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
W20260709 12:20:38.035169 29709 leader_election.cc:343] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.033630 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:38.036995 29939 tablet_bootstrap.cc:492] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:38.048811 29939 ts_tablet_manager.cc:1403] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.110s	user 0.036s	sys 0.023s
I20260709 12:20:38.048851 29938 consensus_queue.cc:260] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.050334 29818 raft_consensus.cc:2468] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:38.052552 29939 raft_consensus.cc:359] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.053390 29939 raft_consensus.cc:385] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.053718 29939 raft_consensus.cc:740] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.054847 29938 ts_tablet_manager.cc:1434] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.003s
I20260709 12:20:38.054716 29939 consensus_queue.cc:260] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.036556 29709 leader_election.cc:304] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555, 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:38.056113 29938 tablet_bootstrap.cc:492] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:38.056373 29948 raft_consensus.cc:2749] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:38.057044 29709 leader_election.cc:343] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.058399 29939 ts_tablet_manager.cc:1434] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
W20260709 12:20:38.058552 29709 leader_election.cc:343] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.059449 29939 tablet_bootstrap.cc:492] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:38.055145 29894 raft_consensus.cc:2468] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 1.
I20260709 12:20:38.063977 29938 tablet_bootstrap.cc:654] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.064714 29708 leader_election.cc:304] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:38.065678 29948 raft_consensus.cc:2804] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.064517 29962 consensus_queue.cc:237] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.070380 29948 raft_consensus.cc:697] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:38.071564 29948 consensus_queue.cc:237] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.073927 29941 tablet_bootstrap.cc:654] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.076346 29939 tablet_bootstrap.cc:654] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.081045 29938 tablet_bootstrap.cc:492] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:38.084467 29938 ts_tablet_manager.cc:1403] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.003s
I20260709 12:20:38.085000 29939 tablet_bootstrap.cc:492] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:38.085544 29939 ts_tablet_manager.cc:1403] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
I20260709 12:20:38.087566 29938 raft_consensus.cc:359] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.088330 29938 raft_consensus.cc:385] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.088369 29939 raft_consensus.cc:359] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.089134 29939 raft_consensus.cc:385] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.089457 29939 raft_consensus.cc:740] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.090495 29939 consensus_queue.cc:260] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.093212 29939 ts_tablet_manager.cc:1434] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:38.094761 29939 tablet_bootstrap.cc:492] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:38.095646 29941 tablet_bootstrap.cc:492] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:38.096120 29941 ts_tablet_manager.cc:1403] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.009s
I20260709 12:20:38.097568 29641 catalog_manager.cc:5697] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 1 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.099561 29941 raft_consensus.cc:359] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.100353 29941 raft_consensus.cc:385] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.100788 29941 raft_consensus.cc:740] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.088738 29938 raft_consensus.cc:740] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.101625 29939 tablet_bootstrap.cc:654] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.102268 29938 consensus_queue.cc:260] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.105746 29941 consensus_queue.cc:260] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.109042 29941 ts_tablet_manager.cc:1434] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:20:38.110225 29941 tablet_bootstrap.cc:492] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:38.118105 29938 ts_tablet_manager.cc:1434] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:20:38.119446 29938 tablet_bootstrap.cc:492] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:38.127167 29938 tablet_bootstrap.cc:654] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.131163 29962 raft_consensus.cc:493] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.132500 29941 tablet_bootstrap.cc:654] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.132560 29962 raft_consensus.cc:515] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.136480 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.137172 29962 leader_election.cc:290] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.137403 29818 raft_consensus.cc:2468] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:38.138875 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
W20260709 12:20:38.140547 29708 leader_election.cc:343] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.141253 29709 leader_election.cc:304] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.142436 29962 raft_consensus.cc:2804] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.142853 29962 raft_consensus.cc:493] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.143219 29962 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.151592 29938 tablet_bootstrap.cc:492] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:38.152151 29938 ts_tablet_manager.cc:1403] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.005s
I20260709 12:20:38.155979 29938 raft_consensus.cc:359] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.156590 29938 raft_consensus.cc:385] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.156906 29938 raft_consensus.cc:740] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.157352 29962 raft_consensus.cc:515] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.157914 29941 tablet_bootstrap.cc:492] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:38.158371 29939 tablet_bootstrap.cc:492] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:38.158463 29941 ts_tablet_manager.cc:1403] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.012s
I20260709 12:20:38.158871 29939 ts_tablet_manager.cc:1403] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.033s
I20260709 12:20:38.160522 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:38.161324 29818 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.161998 29939 raft_consensus.cc:359] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.162842 29939 raft_consensus.cc:385] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.163203 29939 raft_consensus.cc:740] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.162748 29938 consensus_queue.cc:260] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.164242 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.164764 29962 leader_election.cc:290] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.161954 29941 raft_consensus.cc:359] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.166744 29941 raft_consensus.cc:385] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:38.166496 29708 leader_election.cc:343] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.167148 29941 raft_consensus.cc:740] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.166451 29938 ts_tablet_manager.cc:1434] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:20:38.168179 29939 consensus_queue.cc:260] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.169276 29938 tablet_bootstrap.cc:492] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:38.170532 29939 ts_tablet_manager.cc:1434] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:20:38.171509 29939 tablet_bootstrap.cc:492] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a: Bootstrap starting.
I20260709 12:20:38.176360 29818 raft_consensus.cc:2468] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 1.
I20260709 12:20:38.177038 29938 tablet_bootstrap.cc:654] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.168179 29941 consensus_queue.cc:260] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.186800 29709 leader_election.cc:304] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.188107 29962 raft_consensus.cc:2804] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.188422 29941 ts_tablet_manager.cc:1434] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 12:20:38.188643 29962 raft_consensus.cc:697] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:38.189564 29941 tablet_bootstrap.cc:492] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:38.189657 29962 consensus_queue.cc:237] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.180397 29939 tablet_bootstrap.cc:654] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.184320 29942 raft_consensus.cc:493] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.191116 29942 raft_consensus.cc:515] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.193553 29942 leader_election.cc:290] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.195859 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
W20260709 12:20:38.198040 29783 leader_election.cc:343] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.198572 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.199364 29745 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 0.
I20260709 12:20:38.201582 29784 leader_election.cc:304] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.202947 29942 raft_consensus.cc:2804] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.203359 29942 raft_consensus.cc:493] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.203749 29942 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.220744 29941 tablet_bootstrap.cc:654] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.218111 29942 raft_consensus.cc:515] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.228469 29942 leader_election.cc:290] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.229434 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:38.229624 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.230181 29745 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:38.231385 29783 leader_election.cc:343] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.240537 29942 raft_consensus.cc:493] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.241380 29942 raft_consensus.cc:515] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.244805 29942 leader_election.cc:290] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.246081 29950 raft_consensus.cc:493] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.246352 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aa315ca1e7409ba1e86f74e1811e98" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
I20260709 12:20:38.222707 29639 catalog_manager.cc:5697] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 1 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:38.252012 29783 leader_election.cc:343] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.248517 29950 raft_consensus.cc:515] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.243829 29745 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 1.
I20260709 12:20:38.247177 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aa315ca1e7409ba1e86f74e1811e98" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.255085 29744 raft_consensus.cc:2468] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 0.
I20260709 12:20:38.256749 29950 leader_election.cc:290] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:38.259254 29784 leader_election.cc:304] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.260187 29942 raft_consensus.cc:2804] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.260607 29942 raft_consensus.cc:493] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.260993 29942 raft_consensus.cc:3060] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.260622 29784 leader_election.cc:304] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.264575 29939 tablet_bootstrap.cc:492] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a: No bootstrap required, opened a new log
I20260709 12:20:38.265096 29939 ts_tablet_manager.cc:1403] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.021s
I20260709 12:20:38.270754 29939 raft_consensus.cc:359] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.271085 29942 raft_consensus.cc:515] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.271533 29939 raft_consensus.cc:385] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.271870 29939 raft_consensus.cc:740] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.272575 29939 consensus_queue.cc:260] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.273319 29942 leader_election.cc:290] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.274039 29942 raft_consensus.cc:2804] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.274502 29942 raft_consensus.cc:697] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:38.275120 29939 ts_tablet_manager.cc:1434] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:20:38.275187 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aa315ca1e7409ba1e86f74e1811e98" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.275370 29942 consensus_queue.cc:237] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
W20260709 12:20:38.279340 29783 leader_election.cc:343] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:38.283015 29938 tablet_bootstrap.cc:492] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:38.283879 29938 ts_tablet_manager.cc:1403] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.024s
I20260709 12:20:38.286931 29938 raft_consensus.cc:359] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.287755 29938 raft_consensus.cc:385] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.288148 29938 raft_consensus.cc:740] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.289093 29938 consensus_queue.cc:260] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.286478 29639 catalog_manager.cc:5697] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 1 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.291931 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aa315ca1e7409ba1e86f74e1811e98" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:38.292645 29745 raft_consensus.cc:3060] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.300585 29745 raft_consensus.cc:2468] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 1.
I20260709 12:20:38.301905 29962 raft_consensus.cc:493] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.302474 29962 raft_consensus.cc:515] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.303074 29948 raft_consensus.cc:493] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.303745 29948 raft_consensus.cc:515] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.305436 29962 leader_election.cc:290] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.306813 29948 leader_election.cc:290] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.307325 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
I20260709 12:20:38.308094 29894 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:38.310338 29708 leader_election.cc:304] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:38.312345 29948 raft_consensus.cc:2804] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.313462 29948 raft_consensus.cc:493] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.314203 29784 leader_election.cc:304] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.314496 29948 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.313366 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
I20260709 12:20:38.319677 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.321214 29894 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:38.320467 29818 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:38.322160 29982 raft_consensus.cc:493] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.322700 29982 raft_consensus.cc:515] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.323767 29708 leader_election.cc:304] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:38.328154 29938 ts_tablet_manager.cc:1434] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.044s	user 0.012s	sys 0.014s
I20260709 12:20:38.331629 29984 raft_consensus.cc:2804] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.332247 29984 raft_consensus.cc:697] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:38.332626 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
I20260709 12:20:38.333498 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.333619 29894 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 0.
I20260709 12:20:38.333411 29984 consensus_queue.cc:237] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.334340 29818 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 0.
I20260709 12:20:38.327620 29962 raft_consensus.cc:2804] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.336030 29783 leader_election.cc:304] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:38.336855 29962 raft_consensus.cc:493] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.337459 29962 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.343075 29938 tablet_bootstrap.cc:492] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Bootstrap starting.
I20260709 12:20:38.343469 29985 raft_consensus.cc:2804] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.344071 29985 raft_consensus.cc:493] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.344627 29985 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.341049 29982 leader_election.cc:290] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.347343 29982 raft_consensus.cc:493] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.347865 29982 raft_consensus.cc:515] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.348779 29941 tablet_bootstrap.cc:492] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:38.349001 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.349402 29941 ts_tablet_manager.cc:1403] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.160s	user 0.024s	sys 0.011s
I20260709 12:20:38.361840 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.362576 29744 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 0.
I20260709 12:20:38.362769 29941 raft_consensus.cc:359] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.363500 29941 raft_consensus.cc:385] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.363802 29941 raft_consensus.cc:740] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.364673 29941 consensus_queue.cc:260] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.366824 29982 leader_election.cc:290] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.370879 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" is_pre_election: true
I20260709 12:20:38.371716 29894 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 0.
I20260709 12:20:38.377526 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.366283 29784 leader_election.cc:304] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:38.378322 29744 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 0.
I20260709 12:20:38.380386 29938 tablet_bootstrap.cc:654] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.381224 29987 raft_consensus.cc:2804] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.386287 29641 catalog_manager.cc:5697] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:38.382125 29689 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:38.391760 29859 leader_election.cc:304] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:38.391304 29987 raft_consensus.cc:493] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.392758 29950 raft_consensus.cc:2804] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.393126 29987 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.393193 29950 raft_consensus.cc:493] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.394215 29950 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.390816 29941 ts_tablet_manager.cc:1434] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:20:38.391148 29948 raft_consensus.cc:515] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.393319 29962 raft_consensus.cc:515] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.406380 29745 raft_consensus.cc:2393] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in current term 1: Already voted for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in this term.
I20260709 12:20:38.410662 29948 leader_election.cc:290] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.411322 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:38.412824 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:38.413126 29817 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.412158 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.418301 29895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.415630 29894 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.418939 29895 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.420492 29941 tablet_bootstrap.cc:492] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:38.417444 29962 leader_election.cc:290] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.428874 29938 tablet_bootstrap.cc:492] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5: No bootstrap required, opened a new log
I20260709 12:20:38.428651 29985 raft_consensus.cc:515] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.429479 29938 ts_tablet_manager.cc:1403] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.007s
I20260709 12:20:38.431964 29818 raft_consensus.cc:2393] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d3a090f2b7944518ecdbfb838a2fa2a in current term 1: Already voted for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in this term.
I20260709 12:20:38.435111 29641 catalog_manager.cc:5697] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.436357 29895 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 1.
I20260709 12:20:38.437129 29987 raft_consensus.cc:515] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.439492 29708 leader_election.cc:304] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:38.441344 29985 leader_election.cc:290] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.441944 29962 raft_consensus.cc:2804] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.442667 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:38.446533 29895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.444382 29962 raft_consensus.cc:697] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:38.440415 29817 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 1.
I20260709 12:20:38.445708 29894 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 1.
I20260709 12:20:38.443742 29950 raft_consensus.cc:515] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.454614 29709 leader_election.cc:304] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:38.455458 29948 raft_consensus.cc:2804] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.455338 29938 raft_consensus.cc:359] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.456430 29938 raft_consensus.cc:385] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.456395 29948 raft_consensus.cc:697] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:38.456904 29938 raft_consensus.cc:740] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.457722 29938 consensus_queue.cc:260] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.458196 29895 raft_consensus.cc:2393] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in current term 1: Already voted for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in this term.
I20260709 12:20:38.452986 29941 tablet_bootstrap.cc:654] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.457610 29948 consensus_queue.cc:237] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.449870 29962 consensus_queue.cc:237] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.460464 29950 leader_election.cc:290] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:38.470477 29938 ts_tablet_manager.cc:1434] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 12:20:38.469316 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:38.472939 29894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:38.473177 29743 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.472627 29817 raft_consensus.cc:3060] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.474056 29894 raft_consensus.cc:2393] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in current term 1: Already voted for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in this term.
I20260709 12:20:38.461108 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:38.468037 29987 leader_election.cc:290] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:38.491972 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:38.492096 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.492975 29817 raft_consensus.cc:2393] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in current term 1: Already voted for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in this term.
I20260709 12:20:38.494721 29965 consensus_queue.cc:1048] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:38.501032 29859 leader_election.cc:304] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:38.502139 29950 raft_consensus.cc:2749] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:38.502959 29965 consensus_queue.cc:1048] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:38.516040 29743 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 1.
I20260709 12:20:38.528285 29784 leader_election.cc:304] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.529520 29987 raft_consensus.cc:2749] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:38.532420 29784 leader_election.cc:304] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:38.533653 29987 raft_consensus.cc:2804] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.534332 29987 raft_consensus.cc:697] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:38.535571 29987 consensus_queue.cc:237] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.542088 29641 catalog_manager.cc:5697] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 1 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.549232 29639 catalog_manager.cc:5697] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.551905 29941 tablet_bootstrap.cc:492] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:38.552423 29941 ts_tablet_manager.cc:1403] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.137s	user 0.031s	sys 0.047s
I20260709 12:20:38.555450 29941 raft_consensus.cc:359] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.556209 29941 raft_consensus.cc:385] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.556492 29941 raft_consensus.cc:740] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.557327 29941 consensus_queue.cc:260] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.560261 29941 ts_tablet_manager.cc:1434] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:38.561342 29941 tablet_bootstrap.cc:492] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:38.568023 29941 tablet_bootstrap.cc:654] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.576176 29962 consensus_queue.cc:1048] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:38.581816 29941 tablet_bootstrap.cc:492] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:38.582337 29941 ts_tablet_manager.cc:1403] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:20:38.583117 29641 catalog_manager.cc:5697] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 1 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:38.586450 29941 raft_consensus.cc:359] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.587164 29941 raft_consensus.cc:385] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.587426 29941 raft_consensus.cc:740] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.594238 29941 consensus_queue.cc:260] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.605371 29817 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.612510 29962 consensus_queue.cc:1048] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.613634 29941 ts_tablet_manager.cc:1434] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.031s	user 0.018s	sys 0.004s
I20260709 12:20:38.614651 29941 tablet_bootstrap.cc:492] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555: Bootstrap starting.
I20260709 12:20:38.616583 30003 raft_consensus.cc:493] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.617110 30003 raft_consensus.cc:515] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.620319 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aa315ca1e7409ba1e86f74e1811e98" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.620814 29941 tablet_bootstrap.cc:654] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.621254 29743 raft_consensus.cc:2393] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in current term 1: Already voted for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in this term.
I20260709 12:20:38.627990 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82aa315ca1e7409ba1e86f74e1811e98" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.630159 29859 leader_election.cc:304] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:38.631132 29950 raft_consensus.cc:3060] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.632513 29941 tablet_bootstrap.cc:492] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555: No bootstrap required, opened a new log
I20260709 12:20:38.632978 29941 ts_tablet_manager.cc:1403] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:20:38.635615 29941 raft_consensus.cc:359] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.636276 29941 raft_consensus.cc:385] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:38.636546 29941 raft_consensus.cc:740] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Initialized, Role: FOLLOWER
I20260709 12:20:38.637851 29950 raft_consensus.cc:2749] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:38.636445 30003 leader_election.cc:290] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:38.638000 29941 consensus_queue.cc:260] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.640249 29941 ts_tablet_manager.cc:1434] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:38.663698 29962 consensus_queue.cc:1048] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:38.665925 30003 raft_consensus.cc:493] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.666441 30003 raft_consensus.cc:515] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.668705 30003 leader_election.cc:290] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:38.670262 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.671343 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.672936 29859 leader_election.cc:304] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:38.673307 30003 raft_consensus.cc:493] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.674089 29950 raft_consensus.cc:2749] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:38.673893 30003 raft_consensus.cc:515] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.676188 30003 leader_election.cc:290] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:38.677016 30003 raft_consensus.cc:493] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:38.677511 30003 raft_consensus.cc:515] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.680193 30003 leader_election.cc:290] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:38.681778 29894 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.682825 29895 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.683771 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.684532 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0fe9179b604b1b9672f064da6aa4e2" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" is_pre_election: true
I20260709 12:20:38.685189 29816 raft_consensus.cc:2468] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 0.
I20260709 12:20:38.686055 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0fe9179b604b1b9672f064da6aa4e2" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.686226 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" is_pre_election: true
I20260709 12:20:38.686759 29745 raft_consensus.cc:2468] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 0.
I20260709 12:20:38.687019 29743 raft_consensus.cc:2393] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in current term 1: Already voted for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in this term.
I20260709 12:20:38.690542 29987 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.692255 29965 consensus_queue.cc:1048] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.694242 29859 leader_election.cc:304] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:38.695128 30003 raft_consensus.cc:2804] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:38.695341 29859 leader_election.cc:304] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:38.695616 30003 raft_consensus.cc:493] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:38.696128 30003 raft_consensus.cc:3060] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.705883 29950 raft_consensus.cc:2749] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:38.707923 30003 raft_consensus.cc:515] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.710391 30003 leader_election.cc:290] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:38.713508 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0fe9179b604b1b9672f064da6aa4e2" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:38.714454 29743 raft_consensus.cc:3060] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.714486 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b0fe9179b604b1b9672f064da6aa4e2" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:38.718775 29817 raft_consensus.cc:3060] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:38.728188 29984 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.737514 29743 raft_consensus.cc:2468] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 1.
I20260709 12:20:38.739151 29859 leader_election.cc:304] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:38.742085 30009 raft_consensus.cc:2804] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:38.742825 30009 raft_consensus.cc:697] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 LEADER]: Becoming Leader. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Running, Role: LEADER
I20260709 12:20:38.743989 30009 consensus_queue.cc:237] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:38.750903 29817 raft_consensus.cc:2468] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 1.
I20260709 12:20:38.766711 29639 catalog_manager.cc:5697] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:38.782222 29984 consensus_queue.cc:1048] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.794242 29987 consensus_queue.cc:1048] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.876180 29965 consensus_queue.cc:1048] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.888634 29962 consensus_queue.cc:1048] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.970844 29985 consensus_queue.cc:1048] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:38.983767 29984 consensus_queue.cc:1048] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.016515 29962 consensus_queue.cc:1048] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.028254 29948 consensus_queue.cc:1048] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.127362 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
mode: GRACEFUL
new_leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:51404
I20260709 12:20:39.128077 29817 raft_consensus.cc:606] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Received request to transfer leadership to TS 0d3a090f2b7944518ecdbfb838a2fa2a
I20260709 12:20:39.132019 30009 consensus_queue.cc:1048] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.146499 29950 consensus_queue.cc:1048] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:39.164784 29745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
mode: GRACEFUL
new_leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:58166
I20260709 12:20:39.165521 29745 raft_consensus.cc:606] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Received request to transfer leadership to TS 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:39.179702 29745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
mode: GRACEFUL
new_leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:58166
I20260709 12:20:39.180315 29745 raft_consensus.cc:606] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Received request to transfer leadership to TS 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:39.210307 29962 raft_consensus.cc:993] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a: : Instructing follower 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:39.210811 29965 raft_consensus.cc:1081] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Signalling peer 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:39.212821 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:20:39.213451 29817 raft_consensus.cc:493] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:39.213876 29817 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.219202 29817 raft_consensus.cc:515] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.221131 29817 leader_election.cc:290] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:39.222177 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:39.222353 29892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:39.223181 29745 raft_consensus.cc:3055] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:39.223248 29892 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.223537 29745 raft_consensus.cc:740] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:39.224421 29745 consensus_queue.cc:260] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.225530 29745 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.230248 29745 raft_consensus.cc:2468] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:39.230458 29892 raft_consensus.cc:2468] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:39.231606 29784 leader_election.cc:304] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:39.232489 29984 raft_consensus.cc:2804] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.232969 29984 raft_consensus.cc:697] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:39.233798 29984 consensus_queue.cc:237] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.240964 29639 catalog_manager.cc:5697] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 1 to 2, leader changed from 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65) to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.254940 29987 raft_consensus.cc:993] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: : Instructing follower 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:39.255429 29987 raft_consensus.cc:1081] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Signalling peer 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:39.257197 29745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:58144
I20260709 12:20:39.257869 29745 raft_consensus.cc:493] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:39.258293 29745 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.263568 29745 raft_consensus.cc:515] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.265617 29745 leader_election.cc:290] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 2 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:39.266467 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:39.266813 29892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:39.267100 29817 raft_consensus.cc:3055] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:39.267505 29892 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.267467 29817 raft_consensus.cc:740] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:39.268585 29817 consensus_queue.cc:260] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.269986 29817 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.275238 29892 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 2.
I20260709 12:20:39.276660 29708 leader_election.cc:304] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:39.277647 29962 raft_consensus.cc:2804] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.277565 29817 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 2.
I20260709 12:20:39.278331 29962 raft_consensus.cc:697] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:39.279294 29962 consensus_queue.cc:237] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.287165 29639 catalog_manager.cc:5697] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 1 to 2, leader changed from 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66) to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 2 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.510481 29965 raft_consensus.cc:993] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a: : Instructing follower 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:39.511014 29962 raft_consensus.cc:1081] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Signalling peer 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:39.512774 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:20:39.513366 29817 raft_consensus.cc:493] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:39.513873 29817 raft_consensus.cc:3060] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.519287 29817 raft_consensus.cc:515] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.521226 29817 leader_election.cc:290] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:39.522578 29892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:39.523241 29892 raft_consensus.cc:3060] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.523499 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906593f579ab4fe393d1d9d128ccaf47" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:39.524121 29745 raft_consensus.cc:3055] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:39.524407 29745 raft_consensus.cc:740] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:39.525147 29745 consensus_queue.cc:260] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.526135 29745 raft_consensus.cc:3060] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:39.530361 29892 raft_consensus.cc:2468] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:39.530743 29745 raft_consensus.cc:2468] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:39.531641 29783 leader_election.cc:304] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:39.532621 29984 raft_consensus.cc:2804] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:39.533193 29984 raft_consensus.cc:697] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:39.534085 29984 consensus_queue.cc:237] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:39.541638 29641 catalog_manager.cc:5697] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 1 to 2, leader changed from 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65) to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.701362 29892 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:39.703014 29965 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:39.711647 29817 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:39.714054 29962 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:39.769343 29892 raft_consensus.cc:1275] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:39.770733 29984 consensus_queue.cc:1048] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:39.782182 29745 raft_consensus.cc:1275] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:39.785202 30029 consensus_queue.cc:1048] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:40.050836 29892 raft_consensus.cc:1275] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.052325 30029 consensus_queue.cc:1048] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.063881 29745 raft_consensus.cc:1275] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.065413 30032 consensus_queue.cc:1048] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:42.216285 29609 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:20:42.217195 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:42.234154 29745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
mode: GRACEFUL
new_leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:57234
I20260709 12:20:42.234797 29745 raft_consensus.cc:606] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 LEADER]: Received request to transfer leadership to TS 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:42.246991 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d580abc61184101979e43ff478b9f21"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
mode: GRACEFUL
new_leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:53826
I20260709 12:20:42.247558 29817 raft_consensus.cc:606] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Received request to transfer leadership to TS 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:42.248878 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:42.249478 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:42.559867 30032 raft_consensus.cc:993] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5: : Instructing follower 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:42.560351 30032 raft_consensus.cc:1081] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Signalling peer 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:42.561915 29892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d580abc61184101979e43ff478b9f21"
dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:59120
I20260709 12:20:42.562538 29892 raft_consensus.cc:493] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:42.562886 29892 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.567628 29892 raft_consensus.cc:515] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:42.569491 29892 leader_election.cc:290] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 2 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:42.570397 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:42.570678 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:42.571027 29745 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.571231 29817 raft_consensus.cc:3055] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:42.571592 29817 raft_consensus.cc:740] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:42.572392 29817 consensus_queue.cc:260] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:42.573655 29817 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:42.578135 29745 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 2.
I20260709 12:20:42.579551 29859 leader_election.cc:304] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:42.580619 30009 raft_consensus.cc:2804] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:42.580854 29817 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 2.
I20260709 12:20:42.582157 30009 raft_consensus.cc:697] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 LEADER]: Becoming Leader. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Running, Role: LEADER
I20260709 12:20:42.583223 30009 consensus_queue.cc:237] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:42.590459 29641 catalog_manager.cc:5697] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 reported cstate change: term changed from 1 to 2, leader changed from 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66) to 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:42.612452 29962 raft_consensus.cc:993] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a: : Instructing follower 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:42.612914 30044 raft_consensus.cc:1081] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 LEADER]: Signalling peer 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:42.614938 29892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:59128
I20260709 12:20:42.615633 29892 raft_consensus.cc:493] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:42.615967 29892 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.621030 29892 raft_consensus.cc:515] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:42.622812 29892 leader_election.cc:290] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 3 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:42.623814 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:42.624238 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:42.624473 29745 raft_consensus.cc:3055] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:42.624817 29817 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.624840 29745 raft_consensus.cc:740] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:42.625857 29745 consensus_queue.cc:260] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:42.627161 29745 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:42.632473 29817 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 3.
I20260709 12:20:42.633946 29859 leader_election.cc:304] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:42.634021 29745 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 3.
I20260709 12:20:42.634734 30009 raft_consensus.cc:2804] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:42.635248 30009 raft_consensus.cc:697] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 LEADER]: Becoming Leader. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Running, Role: LEADER
I20260709 12:20:42.635993 30009 consensus_queue.cc:237] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:42.642894 29641 catalog_manager.cc:5697] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 reported cstate change: term changed from 2 to 3, leader changed from 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65) to 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:43.007457 29816 raft_consensus.cc:1275] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:43.008806 30009 consensus_queue.cc:1048] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:43.019884 29745 raft_consensus.cc:1275] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:43.021461 30050 consensus_queue.cc:1048] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:43.091925 29816 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:43.093395 30050 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.102654 29745 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:43.104154 30050 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:43.250595 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:43.255833 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:43.256246 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:44.257257 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.262287 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:44.262720 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:45.264451 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:45.269975 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:45.270435 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:46.271652 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:46.277184 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:46.277660 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:47.278726 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:47.283979 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:47.284440 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:48.285444 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:48.290354 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:48.290817 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:49.291836 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:49.297104 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:49.297534 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:50.298689 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:50.304121 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:50.304594 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:51.305642 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:51.310840 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:51.311283 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:52.342159 29609 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:20:52.347869 29745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db77a416b1264c93976549f08ceb1670"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
mode: GRACEFUL
new_leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:58166
I20260709 12:20:52.348924 29745 raft_consensus.cc:606] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Received request to transfer leadership to TS 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:52.355007 29745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
mode: GRACEFUL
new_leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:58166
I20260709 12:20:52.355592 29745 raft_consensus.cc:606] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Received request to transfer leadership to TS 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:52.376765 29892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
mode: GRACEFUL
new_leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51814
I20260709 12:20:52.377357 29892 raft_consensus.cc:606] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 LEADER]: Received request to transfer leadership to TS 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:52.383174 29745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d3c096966c64770820591e2bfc678de"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
mode: GRACEFUL
new_leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:58166
I20260709 12:20:52.383668 29745 raft_consensus.cc:606] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Received request to transfer leadership to TS 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:52.395706 29892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d580abc61184101979e43ff478b9f21"
dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
mode: GRACEFUL
new_leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51814
I20260709 12:20:52.396301 29892 raft_consensus.cc:606] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 LEADER]: Received request to transfer leadership to TS 6ccabaab27b34b0b8c90275c0a8d1ae5
I20260709 12:20:52.507042 30050 raft_consensus.cc:993] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555: : Instructing follower 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.507622 30066 raft_consensus.cc:1081] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 LEADER]: Signalling peer 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.509332 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d580abc61184101979e43ff478b9f21"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51392
I20260709 12:20:52.509853 29817 raft_consensus.cc:493] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.510192 29817 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.515187 29817 raft_consensus.cc:515] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.517089 29817 leader_election.cc:290] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 3 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:52.518141 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:52.518474 29893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d580abc61184101979e43ff478b9f21" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:52.518934 29745 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.519047 29893 raft_consensus.cc:3055] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:52.519393 29893 raft_consensus.cc:740] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Running, Role: LEADER
I20260709 12:20:52.520385 29893 consensus_queue.cc:260] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.521561 29893 raft_consensus.cc:3060] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:52.524838 29745 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 3.
I20260709 12:20:52.526077 29784 leader_election.cc:304] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:52.527030 30060 raft_consensus.cc:2804] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:52.527948 29893 raft_consensus.cc:2468] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 3.
I20260709 12:20:52.528194 30060 raft_consensus.cc:697] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:52.529649 30060 consensus_queue.cc:237] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.538798 29639 catalog_manager.cc:5697] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 2 to 3, leader changed from 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67) to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 3 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.592164 30058 raft_consensus.cc:993] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a: : Instructing follower 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.592572 30058 raft_consensus.cc:1081] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Signalling peer 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.594370 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d3c096966c64770820591e2bfc678de"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:20:52.594940 29817 raft_consensus.cc:493] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.595189 29817 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.600281 29817 raft_consensus.cc:515] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.601871 29817 leader_election.cc:290] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:52.602766 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:52.603145 29893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:52.603423 29745 raft_consensus.cc:3055] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.603745 29893 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.603776 29745 raft_consensus.cc:740] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:52.604866 29745 consensus_queue.cc:260] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.606213 29745 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.611713 29893 raft_consensus.cc:2468] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:52.613176 29745 raft_consensus.cc:2468] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:52.613265 29783 leader_election.cc:304] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:52.614663 30067 raft_consensus.cc:2804] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.615190 30067 raft_consensus.cc:697] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:52.615902 30067 consensus_queue.cc:237] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.623512 29639 catalog_manager.cc:5697] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 1 to 2, leader changed from 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65) to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.667899 30073 raft_consensus.cc:993] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a: : Instructing follower 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.668390 30073 raft_consensus.cc:1081] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Signalling peer 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.669967 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:20:52.670531 29817 raft_consensus.cc:493] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.670833 29817 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.674868 29817 raft_consensus.cc:515] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.676479 29817 leader_election.cc:290] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:52.677268 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:52.677629 29893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:52.677927 29745 raft_consensus.cc:3055] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.678200 29893 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.678267 29745 raft_consensus.cc:740] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:52.679093 29745 consensus_queue.cc:260] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.679997 29745 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.683462 29893 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:52.684581 29745 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:52.684599 29783 leader_election.cc:304] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:52.685696 30067 raft_consensus.cc:2804] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.686213 30067 raft_consensus.cc:697] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:52.687091 30067 consensus_queue.cc:237] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.694803 29639 catalog_manager.cc:5697] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 1 to 2, leader changed from 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65) to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.828810 30058 raft_consensus.cc:993] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a: : Instructing follower 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.829290 30073 raft_consensus.cc:1081] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Signalling peer 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.830878 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db77a416b1264c93976549f08ceb1670"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51386
I20260709 12:20:52.831398 29817 raft_consensus.cc:493] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.831734 29817 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.836443 29817 raft_consensus.cc:515] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.839078 30050 raft_consensus.cc:993] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555: : Instructing follower 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.839398 29817 leader_election.cc:290] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:52.839603 30050 raft_consensus.cc:1081] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 LEADER]: Signalling peer 6ccabaab27b34b0b8c90275c0a8d1ae5 to start an election
I20260709 12:20:52.840202 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:52.840874 29745 raft_consensus.cc:3055] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.840941 29893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:52.841202 29745 raft_consensus.cc:740] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:52.841374 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
 from {username='slave'} at 127.0.0.1:51392
I20260709 12:20:52.841640 29893 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.841980 29817 raft_consensus.cc:493] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:52.842410 29817 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.842262 29745 consensus_queue.cc:260] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.843585 29745 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.846748 29893 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:52.847992 29783 leader_election.cc:304] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d3d5c8093e94dd6b5e47aeec6f25555, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:52.848906 30067 raft_consensus.cc:2804] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:52.849375 30067 raft_consensus.cc:697] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:52.849316 29817 raft_consensus.cc:515] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.850504 30067 consensus_queue.cc:237] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.851229 29745 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 2.
I20260709 12:20:52.852190 29817 leader_election.cc:290] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 4 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:52.852470 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:52.853101 29745 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.853331 29893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:52.854007 29893 raft_consensus.cc:3055] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:52.854450 29893 raft_consensus.cc:740] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Running, Role: LEADER
I20260709 12:20:52.855556 29893 consensus_queue.cc:260] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.856938 29893 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:52.859455 29639 catalog_manager.cc:5697] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 1 to 2, leader changed from 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65) to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.862681 29745 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 4.
I20260709 12:20:52.863798 29784 leader_election.cc:304] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 6ccabaab27b34b0b8c90275c0a8d1ae5; no voters: 
I20260709 12:20:52.864153 29893 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ccabaab27b34b0b8c90275c0a8d1ae5 in term 4.
I20260709 12:20:52.864701 30067 raft_consensus.cc:2804] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:52.865527 30067 raft_consensus.cc:697] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 LEADER]: Becoming Leader. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:52.866626 30067 consensus_queue.cc:237] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:52.874169 29639 catalog_manager.cc:5697] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 reported cstate change: term changed from 3 to 4, leader changed from 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67) to 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66). New cstate: current_term: 4 leader_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.043051 29745 raft_consensus.cc:1275] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:53.044307 30067 consensus_queue.cc:1048] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:53.055214 29893 raft_consensus.cc:1275] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:53.057928 30060 consensus_queue.cc:1048] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:53.073055 29745 raft_consensus.cc:1275] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.074437 30060 consensus_queue.cc:1048] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.085665 29893 raft_consensus.cc:1275] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.087234 30067 consensus_queue.cc:1048] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.093971 29892 raft_consensus.cc:1275] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.095778 30067 consensus_queue.cc:1048] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.109246 29745 raft_consensus.cc:1275] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.113956 30084 consensus_queue.cc:1048] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.271122 29745 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 4 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:53.272430 30084 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:53.281610 29892 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 4 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:53.283015 30084 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:53.341202 29892 raft_consensus.cc:1275] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.342854 30084 consensus_queue.cc:1048] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:53.354105 29745 raft_consensus.cc:1275] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Refusing update from remote peer 6ccabaab27b34b0b8c90275c0a8d1ae5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:53.355932 30060 consensus_queue.cc:1048] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:55.435338 29609 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:20:55.436507 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:55.444501 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
mode: GRACEFUL
new_leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:53826
I20260709 12:20:55.445248 29817 raft_consensus.cc:606] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 LEADER]: Received request to transfer leadership to TS 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:55.448199 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d3c096966c64770820591e2bfc678de"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
mode: GRACEFUL
new_leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:53826
I20260709 12:20:55.448722 29817 raft_consensus.cc:606] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Received request to transfer leadership to TS 0d3a090f2b7944518ecdbfb838a2fa2a
I20260709 12:20:55.451390 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
mode: GRACEFUL
new_leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:53826
I20260709 12:20:55.451903 29817 raft_consensus.cc:606] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Received request to transfer leadership to TS 0d3a090f2b7944518ecdbfb838a2fa2a
I20260709 12:20:55.454319 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
mode: GRACEFUL
new_leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:53826
I20260709 12:20:55.454892 29817 raft_consensus.cc:606] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Received request to transfer leadership to TS 0d3a090f2b7944518ecdbfb838a2fa2a
I20260709 12:20:55.457265 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db77a416b1264c93976549f08ceb1670"
dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
mode: GRACEFUL
new_leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:53826
I20260709 12:20:55.457700 29817 raft_consensus.cc:606] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Received request to transfer leadership to TS 4d3d5c8093e94dd6b5e47aeec6f25555
I20260709 12:20:55.458902 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:55.459432 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:55.466514 30094 raft_consensus.cc:993] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5: : Instructing follower 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:55.467204 30084 raft_consensus.cc:1081] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Signalling peer 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:55.469106 29745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:58144
I20260709 12:20:55.469830 29745 raft_consensus.cc:493] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:55.470253 29745 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.475994 29745 raft_consensus.cc:515] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.478356 29745 leader_election.cc:290] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 3 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:55.479440 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:55.479794 29892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e16e54ad1844aecbbe54fb18ac0392d" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:55.480059 29817 raft_consensus.cc:3055] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.480332 29892 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.480372 29817 raft_consensus.cc:740] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:55.481248 29817 consensus_queue.cc:260] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.482234 29817 raft_consensus.cc:3060] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.485558 29892 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 3.
I20260709 12:20:55.486920 29817 raft_consensus.cc:2468] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 3.
I20260709 12:20:55.486917 29708 leader_election.cc:304] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:55.488657 30095 raft_consensus.cc:2804] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.489496 30095 raft_consensus.cc:697] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:55.490434 30095 consensus_queue.cc:237] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.497418 29641 catalog_manager.cc:5697] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 2 to 3, leader changed from 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66) to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 3 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.511466 30094 raft_consensus.cc:993] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5: : Instructing follower 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:55.512036 30084 raft_consensus.cc:1081] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Signalling peer 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:55.513605 29892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db77a416b1264c93976549f08ceb1670"
dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:59120
I20260709 12:20:55.514185 29892 raft_consensus.cc:493] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:55.514451 29892 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.519006 29892 raft_consensus.cc:515] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.520954 29892 leader_election.cc:290] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 3 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941)
I20260709 12:20:55.521885 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:55.522281 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db77a416b1264c93976549f08ceb1670" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:55.522476 29817 raft_consensus.cc:3055] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.522792 29745 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.522770 29817 raft_consensus.cc:740] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:55.523736 29817 consensus_queue.cc:260] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.524901 29817 raft_consensus.cc:3060] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.529384 29745 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 3.
I20260709 12:20:55.530972 29817 raft_consensus.cc:2468] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 3.
I20260709 12:20:55.530933 29859 leader_election.cc:304] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:55.532020 30050 raft_consensus.cc:2804] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.533020 30050 raft_consensus.cc:697] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 LEADER]: Becoming Leader. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Running, Role: LEADER
I20260709 12:20:55.533893 30050 consensus_queue.cc:237] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.540537 29641 catalog_manager.cc:5697] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 reported cstate change: term changed from 2 to 3, leader changed from 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66) to 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.583550 30094 raft_consensus.cc:993] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5: : Instructing follower 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:55.584012 30084 raft_consensus.cc:1081] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Signalling peer 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:55.585495 29745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:58144
I20260709 12:20:55.586037 29745 raft_consensus.cc:493] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:55.586336 29745 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.590624 29745 raft_consensus.cc:515] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.592216 29745 leader_election.cc:290] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 3 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:55.593308 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:55.593375 29892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e7011e5be8416cb489c476ed60af48" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:55.594084 29817 raft_consensus.cc:3055] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.594120 29892 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.594486 29817 raft_consensus.cc:740] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:55.595386 29817 consensus_queue.cc:260] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.596354 29817 raft_consensus.cc:3060] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.598915 29892 raft_consensus.cc:2468] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 3.
I20260709 12:20:55.599890 29708 leader_election.cc:304] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:55.600653 30095 raft_consensus.cc:2804] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.601054 30095 raft_consensus.cc:697] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:55.601178 29817 raft_consensus.cc:2468] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 3.
I20260709 12:20:55.601971 30095 consensus_queue.cc:237] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.609723 29641 catalog_manager.cc:5697] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 2 to 3, leader changed from 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66) to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 3 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.712347 30094 raft_consensus.cc:993] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: : Instructing follower 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:55.712821 30084 raft_consensus.cc:1081] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 LEADER]: Signalling peer 4d3d5c8093e94dd6b5e47aeec6f25555 to start an election
I20260709 12:20:55.714536 29892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2336e66ed982422f87134423176743e6"
dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
 from {username='slave'} at 127.0.0.1:59120
I20260709 12:20:55.714983 29892 raft_consensus.cc:493] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:55.715230 29892 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.719614 29892 raft_consensus.cc:515] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.721168 29892 leader_election.cc:290] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 5 election: Requested vote from peers 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941), 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601)
I20260709 12:20:55.722280 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
I20260709 12:20:55.722471 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2336e66ed982422f87134423176743e6" candidate_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:55.722931 29745 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.722971 29817 raft_consensus.cc:3055] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:20:55.723479 29817 raft_consensus.cc:740] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:55.724191 29817 consensus_queue.cc:260] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.725076 29817 raft_consensus.cc:3060] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:20:55.727903 29745 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 5.
I20260709 12:20:55.728977 29859 leader_election.cc:304] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:55.729429 29817 raft_consensus.cc:2468] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d3d5c8093e94dd6b5e47aeec6f25555 in term 5.
I20260709 12:20:55.729971 30050 raft_consensus.cc:2804] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:20:55.730430 30050 raft_consensus.cc:697] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 5 LEADER]: Becoming Leader. State: Replica: 4d3d5c8093e94dd6b5e47aeec6f25555, State: Running, Role: LEADER
I20260709 12:20:55.731181 30050 consensus_queue.cc:237] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.738382 29641 catalog_manager.cc:5697] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 reported cstate change: term changed from 4 to 5, leader changed from 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66) to 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67). New cstate: current_term: 5 leader_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.940332 30094 raft_consensus.cc:993] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5: : Instructing follower 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:55.940798 30084 raft_consensus.cc:1081] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Signalling peer 0d3a090f2b7944518ecdbfb838a2fa2a to start an election
I20260709 12:20:55.942370 29745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d3c096966c64770820591e2bfc678de"
dest_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a"
 from {username='slave'} at 127.0.0.1:58144
I20260709 12:20:55.942970 29745 raft_consensus.cc:493] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:55.943298 29745 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.947853 29745 raft_consensus.cc:515] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.949697 29745 leader_election.cc:290] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 3 election: Requested vote from peers 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601), 4d3d5c8093e94dd6b5e47aeec6f25555 (127.28.234.67:45893)
I20260709 12:20:55.950596 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5"
I20260709 12:20:55.950759 29892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d3c096966c64770820591e2bfc678de" candidate_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555"
I20260709 12:20:55.951218 29817 raft_consensus.cc:3055] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:55.951375 29892 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.951632 29817 raft_consensus.cc:740] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6ccabaab27b34b0b8c90275c0a8d1ae5, State: Running, Role: LEADER
I20260709 12:20:55.952435 29817 consensus_queue.cc:260] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.953354 29817 raft_consensus.cc:3060] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:55.955989 29892 raft_consensus.cc:2468] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 3.
I20260709 12:20:55.956943 29708 leader_election.cc:304] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d3a090f2b7944518ecdbfb838a2fa2a, 4d3d5c8093e94dd6b5e47aeec6f25555; no voters: 
I20260709 12:20:55.957659 30095 raft_consensus.cc:2804] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:55.958139 30095 raft_consensus.cc:697] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 LEADER]: Becoming Leader. State: Replica: 0d3a090f2b7944518ecdbfb838a2fa2a, State: Running, Role: LEADER
I20260709 12:20:55.958727 29817 raft_consensus.cc:2468] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d3a090f2b7944518ecdbfb838a2fa2a in term 3.
I20260709 12:20:55.958878 30095 consensus_queue.cc:237] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } }
I20260709 12:20:55.967077 29641 catalog_manager.cc:5697] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a reported cstate change: term changed from 2 to 3, leader changed from 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66) to 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65). New cstate: current_term: 3 leader_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:55.995016 29892 raft_consensus.cc:1275] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:55.996416 30095 consensus_queue.cc:1048] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.007369 29817 raft_consensus.cc:1275] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.010205 30096 consensus_queue.cc:1048] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:56.022243 29892 raft_consensus.cc:1275] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.025352 29745 raft_consensus.cc:1275] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.025471 30109 consensus_queue.cc:1048] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:56.026714 30050 consensus_queue.cc:1048] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.039204 29817 raft_consensus.cc:1275] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.043258 30096 consensus_queue.cc:1048] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.044437 29817 raft_consensus.cc:1275] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.045974 30102 consensus_queue.cc:1048] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.126394 29745 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 5 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:56.127739 30050 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d3a090f2b7944518ecdbfb838a2fa2a" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 41941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:20:56.137490 29816 raft_consensus.cc:1275] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 5 FOLLOWER]: Refusing update from remote peer 4d3d5c8093e94dd6b5e47aeec6f25555: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:20:56.140743 30120 consensus_queue.cc:1048] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:20:56.339838 29816 raft_consensus.cc:1275] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.341253 30115 consensus_queue.cc:1048] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ccabaab27b34b0b8c90275c0a8d1ae5" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 38601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.351173 29892 raft_consensus.cc:1275] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Refusing update from remote peer 0d3a090f2b7944518ecdbfb838a2fa2a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:56.352965 30096 consensus_queue.cc:1048] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d3d5c8093e94dd6b5e47aeec6f25555" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:56.460690 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:56.465606 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:56.466060 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:57.467168 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:57.473747 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:57.474261 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:58.475458 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:58.482439 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:58.482951 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:59.484102 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:59.488962 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:59.489396 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:00.490605 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:00.496229 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:00.496737 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:01.497851 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:01.503383 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:01.503829 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:02.505052 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:02.509946 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:02.510314 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:03.511416 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:03.516729 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:03.517194 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:04.518337 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:04.523788 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:04.524375 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:05.554491 29609 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:21:05.555394 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
W20260709 12:21:05.585616 29859 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:05.589392 29859 consensus_peers.cc:597] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 -> Peer 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941): Couldn't send request to peer 0d3a090f2b7944518ecdbfb838a2fa2a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:05.598376 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:05.599370 29609 tablet_replica.cc:333] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.600350 29609 raft_consensus.cc:2243] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.601574 29609 raft_consensus.cc:2272] T 6e16e54ad1844aecbbe54fb18ac0392d P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.604344 29609 tablet_replica.cc:333] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.604971 29609 raft_consensus.cc:2243] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.605522 29609 raft_consensus.cc:2272] T 906593f579ab4fe393d1d9d128ccaf47 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.607501 29609 tablet_replica.cc:333] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.608106 29609 raft_consensus.cc:2243] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.608579 29609 raft_consensus.cc:2272] T 7b0fe9179b604b1b9672f064da6aa4e2 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.610649 29609 tablet_replica.cc:333] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.611207 29609 raft_consensus.cc:2243] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.611707 29609 raft_consensus.cc:2272] T 7d580abc61184101979e43ff478b9f21 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.613487 29609 tablet_replica.cc:333] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.614202 29609 raft_consensus.cc:2243] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.614725 29609 raft_consensus.cc:2272] T 2336e66ed982422f87134423176743e6 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.616783 29609 tablet_replica.cc:333] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.617304 29609 raft_consensus.cc:2243] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.617789 29609 raft_consensus.cc:2272] T 82aa315ca1e7409ba1e86f74e1811e98 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.619531 29609 tablet_replica.cc:333] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.620075 29609 raft_consensus.cc:2243] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.620592 29609 raft_consensus.cc:2272] T db77a416b1264c93976549f08ceb1670 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.622448 29609 tablet_replica.cc:333] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.622961 29609 raft_consensus.cc:2243] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.623826 29609 raft_consensus.cc:2272] T 4d3c096966c64770820591e2bfc678de P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.625527 29609 tablet_replica.cc:333] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a: stopping tablet replica
I20260709 12:21:05.626053 29609 raft_consensus.cc:2243] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.626873 29609 raft_consensus.cc:2272] T a0e7011e5be8416cb489c476ed60af48 P 0d3a090f2b7944518ecdbfb838a2fa2a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:05.635046 29784 consensus_peers.cc:597] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 -> Peer 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941): Couldn't send request to peer 0d3a090f2b7944518ecdbfb838a2fa2a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:05.750597 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
W20260709 12:21:05.751138 29784 consensus_peers.cc:597] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 -> Peer 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941): Couldn't send request to peer 0d3a090f2b7944518ecdbfb838a2fa2a. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:41941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:05.772127 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
I20260709 12:21:05.805469 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:05.806244 29609 tablet_replica.cc:333] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.806952 29609 raft_consensus.cc:2243] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.807782 29609 raft_consensus.cc:2272] T 906593f579ab4fe393d1d9d128ccaf47 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.809568 29609 tablet_replica.cc:333] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.810144 29609 raft_consensus.cc:2243] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.810602 29609 raft_consensus.cc:2272] T 7b0fe9179b604b1b9672f064da6aa4e2 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.812273 29609 tablet_replica.cc:333] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.812783 29609 raft_consensus.cc:2243] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.813627 29609 raft_consensus.cc:2272] T 7d580abc61184101979e43ff478b9f21 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.815593 29609 tablet_replica.cc:333] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.816109 29609 raft_consensus.cc:2243] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.816536 29609 raft_consensus.cc:2272] T a0e7011e5be8416cb489c476ed60af48 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.818331 29609 tablet_replica.cc:333] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.818857 29609 raft_consensus.cc:2243] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.819293 29609 raft_consensus.cc:2272] T 4d3c096966c64770820591e2bfc678de P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.820825 29609 tablet_replica.cc:333] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.821302 29609 raft_consensus.cc:2243] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.821700 29609 raft_consensus.cc:2272] T db77a416b1264c93976549f08ceb1670 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.823385 29609 tablet_replica.cc:333] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.823853 29609 raft_consensus.cc:2243] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.824599 29609 raft_consensus.cc:2272] T 82aa315ca1e7409ba1e86f74e1811e98 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.826258 29609 tablet_replica.cc:333] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.826740 29609 raft_consensus.cc:2243] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.827149 29609 raft_consensus.cc:2272] T 2336e66ed982422f87134423176743e6 P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.828842 29609 tablet_replica.cc:333] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5: stopping tablet replica
I20260709 12:21:05.829308 29609 raft_consensus.cc:2243] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.829818 29609 raft_consensus.cc:2272] T 6e16e54ad1844aecbbe54fb18ac0392d P 6ccabaab27b34b0b8c90275c0a8d1ae5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.856997 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
W20260709 12:21:05.867942 29859 consensus_peers.cc:597] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 -> Peer 0d3a090f2b7944518ecdbfb838a2fa2a (127.28.234.65:41941): Couldn't send request to peer 0d3a090f2b7944518ecdbfb838a2fa2a. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:41941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:05.873692 29859 consensus_peers.cc:597] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 -> Peer 6ccabaab27b34b0b8c90275c0a8d1ae5 (127.28.234.66:38601): Couldn't send request to peer 6ccabaab27b34b0b8c90275c0a8d1ae5. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:38601: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:05.880764 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
I20260709 12:21:05.915655 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:05.916620 29609 tablet_replica.cc:333] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.917706 29609 raft_consensus.cc:2243] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.918565 29609 raft_consensus.cc:2272] T 4d3c096966c64770820591e2bfc678de P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.920446 29609 tablet_replica.cc:333] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.920982 29609 raft_consensus.cc:2243] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.921833 29609 raft_consensus.cc:2272] T 7b0fe9179b604b1b9672f064da6aa4e2 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.923630 29609 tablet_replica.cc:333] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.924124 29609 raft_consensus.cc:2243] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.924539 29609 raft_consensus.cc:2272] T 7d580abc61184101979e43ff478b9f21 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.926407 29609 tablet_replica.cc:333] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.926895 29609 raft_consensus.cc:2243] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.927666 29609 raft_consensus.cc:2272] T 2336e66ed982422f87134423176743e6 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.929378 29609 tablet_replica.cc:333] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.929937 29609 raft_consensus.cc:2243] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.930315 29609 raft_consensus.cc:2272] T 82aa315ca1e7409ba1e86f74e1811e98 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.932029 29609 tablet_replica.cc:333] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.932482 29609 raft_consensus.cc:2243] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:05.933292 29609 raft_consensus.cc:2272] T db77a416b1264c93976549f08ceb1670 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.935060 29609 tablet_replica.cc:333] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.935493 29609 raft_consensus.cc:2243] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.935878 29609 raft_consensus.cc:2272] T 6e16e54ad1844aecbbe54fb18ac0392d P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.937601 29609 tablet_replica.cc:333] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.938114 29609 raft_consensus.cc:2243] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.938493 29609 raft_consensus.cc:2272] T 906593f579ab4fe393d1d9d128ccaf47 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.940239 29609 tablet_replica.cc:333] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555: stopping tablet replica
I20260709 12:21:05.940647 29609 raft_consensus.cc:2243] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:05.941056 29609 raft_consensus.cc:2272] T a0e7011e5be8416cb489c476ed60af48 P 4d3d5c8093e94dd6b5e47aeec6f25555 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:05.969149 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
I20260709 12:21:05.987682 29609 master.cc:562] Master@127.28.234.126:43823 shutting down...
I20260709 12:21:06.212204 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:06.212877 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:06.213199 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7bafae2bac37413aa407144c758845c3: stopping tablet replica
I20260709 12:21:06.233070 29609 master.cc:584] Master@127.28.234.126:43823 shutdown complete.
0d3a090f2b7944518ecdbfb838a2fa2a  4
4d3d5c8093e94dd6b5e47aeec6f25555  1
6ccabaab27b34b0b8c90275c0a8d1ae5  4
0d3a090f2b7944518ecdbfb838a2fa2a  3
4d3d5c8093e94dd6b5e47aeec6f25555  3
6ccabaab27b34b0b8c90275c0a8d1ae5  3
0d3a090f2b7944518ecdbfb838a2fa2a  0
4d3d5c8093e94dd6b5e47aeec6f25555  1
6ccabaab27b34b0b8c90275c0a8d1ae5  8
0d3a090f2b7944518ecdbfb838a2fa2a  3
4d3d5c8093e94dd6b5e47aeec6f25555  3
6ccabaab27b34b0b8c90275c0a8d1ae5  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31503 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:21:06.274636 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:41625
I20260709 12:21:06.275882 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:06.282104 30140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:06.282107 30139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:06.283104 30142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:06.283648 29609 server_base.cc:1061] running on GCE node
I20260709 12:21:06.284621 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:06.284850 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:06.285050 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599666285032 us; error 0 us; skew 500 ppm
I20260709 12:21:06.285643 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:06.288143 29609 webserver.cc:533] Webserver started at http://127.28.234.126:43783/ using document root <none> and password file <none>
I20260709 12:21:06.288753 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:06.288970 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:06.289251 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:06.290537 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "795cffcd3ad247d19c39b31da744a6bc"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.295110 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:06.298628 30147 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.299532 29609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:06.299822 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "795cffcd3ad247d19c39b31da744a6bc"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.300065 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:06.311126 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:06.312340 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:06.352826 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:41625
I20260709 12:21:06.352914 30198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:41625 every 8 connection(s)
I20260709 12:21:06.357203 30199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.367094 30199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc: Bootstrap starting.
I20260709 12:21:06.371927 30199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:06.376313 30199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc: No bootstrap required, opened a new log
I20260709 12:21:06.378758 30199 raft_consensus.cc:359] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cffcd3ad247d19c39b31da744a6bc" member_type: VOTER }
I20260709 12:21:06.379215 30199 raft_consensus.cc:385] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:06.379484 30199 raft_consensus.cc:740] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795cffcd3ad247d19c39b31da744a6bc, State: Initialized, Role: FOLLOWER
I20260709 12:21:06.380093 30199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cffcd3ad247d19c39b31da744a6bc" member_type: VOTER }
I20260709 12:21:06.380584 30199 raft_consensus.cc:399] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:06.380807 30199 raft_consensus.cc:493] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:06.381119 30199 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:06.385347 30199 raft_consensus.cc:515] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cffcd3ad247d19c39b31da744a6bc" member_type: VOTER }
I20260709 12:21:06.385979 30199 leader_election.cc:304] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 795cffcd3ad247d19c39b31da744a6bc; no voters: 
I20260709 12:21:06.387208 30199 leader_election.cc:290] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:06.387682 30202 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:06.389101 30202 raft_consensus.cc:697] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 1 LEADER]: Becoming Leader. State: Replica: 795cffcd3ad247d19c39b31da744a6bc, State: Running, Role: LEADER
I20260709 12:21:06.389909 30202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cffcd3ad247d19c39b31da744a6bc" member_type: VOTER }
I20260709 12:21:06.390317 30199 sys_catalog.cc:565] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:06.394963 30204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 795cffcd3ad247d19c39b31da744a6bc. Latest consensus state: current_term: 1 leader_uuid: "795cffcd3ad247d19c39b31da744a6bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cffcd3ad247d19c39b31da744a6bc" member_type: VOTER } }
I20260709 12:21:06.395843 30204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:06.397881 30203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "795cffcd3ad247d19c39b31da744a6bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "795cffcd3ad247d19c39b31da744a6bc" member_type: VOTER } }
I20260709 12:21:06.398388 30203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:06.398444 30210 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:06.407356 30210 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:06.408449 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:06.416945 30210 catalog_manager.cc:1383] Generated new cluster ID: 7b4411a673d743dcba0ff88bde246c38
I20260709 12:21:06.417272 30210 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:06.451110 30210 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:06.452359 30210 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:06.467643 30210 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc: Generated new TSK 0
I20260709 12:21:06.468290 30210 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:06.475113 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:06.481743 30220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:06.482786 30221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:06.484160 30223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:06.484889 29609 server_base.cc:1061] running on GCE node
I20260709 12:21:06.485914 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:06.486117 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:06.486323 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599666486307 us; error 0 us; skew 500 ppm
I20260709 12:21:06.486908 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:06.489310 29609 webserver.cc:533] Webserver started at http://127.28.234.65:34113/ using document root <none> and password file <none>
I20260709 12:21:06.489893 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:06.490126 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:06.490482 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:06.491677 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.496650 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:21:06.500603 30228 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.501592 29609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:21:06.502018 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.502364 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:06.516763 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:06.518558 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:06.520093 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:06.522476 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:06.522653 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.522958 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:06.523137 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.564567 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:38663
I20260709 12:21:06.564687 30292 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:38663 every 8 connection(s)
I20260709 12:21:06.569850 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:06.577672 30297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:06.580549 30298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:06.583039 29609 server_base.cc:1061] running on GCE node
W20260709 12:21:06.584139 30300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:06.585176 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:06.585495 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:06.585719 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599666585662 us; error 0 us; skew 500 ppm
I20260709 12:21:06.585777 30293 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41625
I20260709 12:21:06.586187 30293 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:06.586580 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:06.587154 30293 heartbeater.cc:507] Master 127.28.234.126:41625 requested a full tablet report, sending...
I20260709 12:21:06.589596 29609 webserver.cc:533] Webserver started at http://127.28.234.66:39809/ using document root <none> and password file <none>
I20260709 12:21:06.590010 30164 ts_manager.cc:194] Registered new tserver with Master: 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663)
I20260709 12:21:06.590181 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:06.590540 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:06.590832 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:06.592083 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "803ce617652546fab54bd1d24bb3fd2d"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.592080 30164 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40974
I20260709 12:21:06.597369 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:21:06.601711 30305 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.602645 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:06.602990 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "803ce617652546fab54bd1d24bb3fd2d"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.603338 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:06.624907 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:06.626315 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:06.627823 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:06.630106 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:06.630337 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.630622 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:06.630805 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.670388 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:37103
I20260709 12:21:06.670481 30368 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:37103 every 8 connection(s)
I20260709 12:21:06.675204 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:06.682655 30372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:06.684672 30373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:06.686486 29609 server_base.cc:1061] running on GCE node
W20260709 12:21:06.687274 30375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:06.688356 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:06.688675 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:06.688880 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599666688864 us; error 0 us; skew 500 ppm
I20260709 12:21:06.689457 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:06.689564 30369 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41625
I20260709 12:21:06.690065 30369 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:06.691103 30369 heartbeater.cc:507] Master 127.28.234.126:41625 requested a full tablet report, sending...
I20260709 12:21:06.692344 29609 webserver.cc:533] Webserver started at http://127.28.234.67:42689/ using document root <none> and password file <none>
I20260709 12:21:06.692883 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:06.693107 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:06.693382 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:06.693568 30164 ts_manager.cc:194] Registered new tserver with Master: 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:06.694679 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.695176 30164 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40984
I20260709 12:21:06.699761 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:06.703531 30380 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.704447 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:21:06.704775 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
format_stamp: "Formatted at 2026-07-09 12:21:06 on dist-test-slave-8c39"
I20260709 12:21:06.705087 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:06.715245 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:06.716467 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:06.718128 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:06.720335 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:06.720567 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.720818 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:06.720995 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:06.765610 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:38943
I20260709 12:21:06.765724 30442 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:38943 every 8 connection(s)
I20260709 12:21:06.780393 30443 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41625
I20260709 12:21:06.780822 30443 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:06.781591 30443 heartbeater.cc:507] Master 127.28.234.126:41625 requested a full tablet report, sending...
I20260709 12:21:06.783715 30164 ts_manager.cc:194] Registered new tserver with Master: 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:06.784411 29609 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01548597s
I20260709 12:21:06.785159 30164 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40992
I20260709 12:21:06.812146 30164 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40994:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:06.815164 30164 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:06.906930 30331 tablet_service.cc:1511] Processing CreateTablet for tablet 18756c69a82643aebea4266b7ec4a8dc (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:06.910316 30333 tablet_service.cc:1511] Processing CreateTablet for tablet 9eac978b5f5d45d7a8bd1e8a69d89641 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:06.910601 30406 tablet_service.cc:1511] Processing CreateTablet for tablet 18756c69a82643aebea4266b7ec4a8dc (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:06.911001 30403 tablet_service.cc:1511] Processing CreateTablet for tablet 502d6953dc714a82982ab1c3057fab36 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:06.912039 30406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18756c69a82643aebea4266b7ec4a8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.912766 30332 tablet_service.cc:1511] Processing CreateTablet for tablet c2c6f1f5fa454f8ab9bb8d890df08e89 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:06.913133 30404 tablet_service.cc:1511] Processing CreateTablet for tablet debc6092f29746b28020e981cd2737d3 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:06.923378 30404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debc6092f29746b28020e981cd2737d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.923581 30324 tablet_service.cc:1511] Processing CreateTablet for tablet 72d9e1c2fc6840b480154fb8112bd941 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:06.914880 30328 tablet_service.cc:1511] Processing CreateTablet for tablet 502d6953dc714a82982ab1c3057fab36 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:06.926862 30400 tablet_service.cc:1511] Processing CreateTablet for tablet 7e43053a49b84739a63891147ff8837a (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:06.928233 30400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e43053a49b84739a63891147ff8837a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.928823 30256 tablet_service.cc:1511] Processing CreateTablet for tablet 9eac978b5f5d45d7a8bd1e8a69d89641 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:06.930123 30256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eac978b5f5d45d7a8bd1e8a69d89641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.931048 30399 tablet_service.cc:1511] Processing CreateTablet for tablet 72d9e1c2fc6840b480154fb8112bd941 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:06.932340 30399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d9e1c2fc6840b480154fb8112bd941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.933094 30255 tablet_service.cc:1511] Processing CreateTablet for tablet c2c6f1f5fa454f8ab9bb8d890df08e89 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:06.933369 30249 tablet_service.cc:1511] Processing CreateTablet for tablet a3f7d2aceeff445fb78486496e801b3c (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:06.934391 30255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c6f1f5fa454f8ab9bb8d890df08e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.935753 30248 tablet_service.cc:1511] Processing CreateTablet for tablet 7e43053a49b84739a63891147ff8837a (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:06.937196 30248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e43053a49b84739a63891147ff8837a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.939502 30254 tablet_service.cc:1511] Processing CreateTablet for tablet 18756c69a82643aebea4266b7ec4a8dc (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:06.941409 30254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18756c69a82643aebea4266b7ec4a8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.915498 30408 tablet_service.cc:1511] Processing CreateTablet for tablet 9eac978b5f5d45d7a8bd1e8a69d89641 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:06.908277 30330 tablet_service.cc:1511] Processing CreateTablet for tablet 137a2db5be614860a25334718f9caac8 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:06.915992 30407 tablet_service.cc:1511] Processing CreateTablet for tablet c2c6f1f5fa454f8ab9bb8d890df08e89 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:06.908491 30331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18756c69a82643aebea4266b7ec4a8dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.916549 30329 tablet_service.cc:1511] Processing CreateTablet for tablet debc6092f29746b28020e981cd2737d3 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:06.918233 30327 tablet_service.cc:1511] Processing CreateTablet for tablet 89dae12c7700483bb4c07964cbb811b2 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:06.919335 30326 tablet_service.cc:1511] Processing CreateTablet for tablet a3f7d2aceeff445fb78486496e801b3c (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:06.920050 30401 tablet_service.cc:1511] Processing CreateTablet for tablet a3f7d2aceeff445fb78486496e801b3c (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:06.921128 30325 tablet_service.cc:1511] Processing CreateTablet for tablet 7e43053a49b84739a63891147ff8837a (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:06.914880 30405 tablet_service.cc:1511] Processing CreateTablet for tablet 137a2db5be614860a25334718f9caac8 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:06.921379 30402 tablet_service.cc:1511] Processing CreateTablet for tablet 89dae12c7700483bb4c07964cbb811b2 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:06.944155 30333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eac978b5f5d45d7a8bd1e8a69d89641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.944411 30253 tablet_service.cc:1511] Processing CreateTablet for tablet 137a2db5be614860a25334718f9caac8 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:06.950019 30250 tablet_service.cc:1511] Processing CreateTablet for tablet 89dae12c7700483bb4c07964cbb811b2 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:06.952296 30247 tablet_service.cc:1511] Processing CreateTablet for tablet 72d9e1c2fc6840b480154fb8112bd941 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:06.954403 30252 tablet_service.cc:1511] Processing CreateTablet for tablet debc6092f29746b28020e981cd2737d3 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:06.955803 30251 tablet_service.cc:1511] Processing CreateTablet for tablet 502d6953dc714a82982ab1c3057fab36 (DEFAULT_TABLE table=test-workload [id=d991b9251fe04d35a655dc212663152e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:06.958012 30403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502d6953dc714a82982ab1c3057fab36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.958745 30405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137a2db5be614860a25334718f9caac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.962734 30401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f7d2aceeff445fb78486496e801b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.964716 30249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f7d2aceeff445fb78486496e801b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.965746 30247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d9e1c2fc6840b480154fb8112bd941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.965927 30459 tablet_bootstrap.cc:492] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:06.970332 30251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502d6953dc714a82982ab1c3057fab36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.972723 30332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c6f1f5fa454f8ab9bb8d890df08e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.972802 30252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debc6092f29746b28020e981cd2737d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.974887 30402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89dae12c7700483bb4c07964cbb811b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.976141 30329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet debc6092f29746b28020e981cd2737d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.978147 30327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89dae12c7700483bb4c07964cbb811b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.978796 30328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502d6953dc714a82982ab1c3057fab36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.979638 30407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c6f1f5fa454f8ab9bb8d890df08e89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.981014 30330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137a2db5be614860a25334718f9caac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.981707 30325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e43053a49b84739a63891147ff8837a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.988893 30326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f7d2aceeff445fb78486496e801b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.998065 30408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eac978b5f5d45d7a8bd1e8a69d89641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:06.998217 30324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72d9e1c2fc6840b480154fb8112bd941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:07.000828 30250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89dae12c7700483bb4c07964cbb811b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:07.005561 30253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137a2db5be614860a25334718f9caac8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:07.017963 30459 tablet_bootstrap.cc:654] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.024163 30460 tablet_bootstrap.cc:492] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.099110 30460 tablet_bootstrap.cc:654] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.126547 30459 tablet_bootstrap.cc:492] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.127087 30459 ts_tablet_manager.cc:1403] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.162s	user 0.009s	sys 0.013s
I20260709 12:21:07.138527 30459 raft_consensus.cc:359] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.139216 30462 tablet_bootstrap.cc:492] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.139431 30459 raft_consensus.cc:385] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.139833 30459 raft_consensus.cc:740] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.140321 30460 tablet_bootstrap.cc:492] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.140828 30460 ts_tablet_manager.cc:1403] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.005s
I20260709 12:21:07.140671 30459 consensus_queue.cc:260] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.143162 30443 heartbeater.cc:499] Master 127.28.234.126:41625 was elected leader, sending a full tablet report...
I20260709 12:21:07.143765 30459 ts_tablet_manager.cc:1434] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:21:07.144341 30460 raft_consensus.cc:359] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.144979 30459 tablet_bootstrap.cc:492] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.145172 30460 raft_consensus.cc:385] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.145503 30460 raft_consensus.cc:740] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.145750 30462 tablet_bootstrap.cc:654] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.146605 30460 consensus_queue.cc:260] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.155594 30459 tablet_bootstrap.cc:654] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.162873 30460 ts_tablet_manager.cc:1434] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.022s	user 0.022s	sys 0.000s
I20260709 12:21:07.164058 30293 heartbeater.cc:499] Master 127.28.234.126:41625 was elected leader, sending a full tablet report...
I20260709 12:21:07.164670 30460 tablet_bootstrap.cc:492] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.172462 30462 tablet_bootstrap.cc:492] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.173064 30462 ts_tablet_manager.cc:1403] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.014s
I20260709 12:21:07.173817 30460 tablet_bootstrap.cc:654] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.176520 30459 tablet_bootstrap.cc:492] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.176520 30462 raft_consensus.cc:359] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.177273 30459 ts_tablet_manager.cc:1403] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.003s
I20260709 12:21:07.177551 30462 raft_consensus.cc:385] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.177945 30462 raft_consensus.cc:740] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.178846 30462 consensus_queue.cc:260] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.180856 30459 raft_consensus.cc:359] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.182073 30459 raft_consensus.cc:385] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.182519 30459 raft_consensus.cc:740] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.183712 30459 consensus_queue.cc:260] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.187383 30459 ts_tablet_manager.cc:1434] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:21:07.189613 30459 tablet_bootstrap.cc:492] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.198838 30459 tablet_bootstrap.cc:654] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.199903 30369 heartbeater.cc:499] Master 127.28.234.126:41625 was elected leader, sending a full tablet report...
I20260709 12:21:07.200485 30462 ts_tablet_manager.cc:1434] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.025s
I20260709 12:21:07.201538 30462 tablet_bootstrap.cc:492] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.203672 30460 tablet_bootstrap.cc:492] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.204408 30460 ts_tablet_manager.cc:1403] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.009s
I20260709 12:21:07.208840 30462 tablet_bootstrap.cc:654] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.208976 30460 raft_consensus.cc:359] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.210474 30460 raft_consensus.cc:385] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.210942 30460 raft_consensus.cc:740] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.212306 30460 consensus_queue.cc:260] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.215631 30460 ts_tablet_manager.cc:1434] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:21:07.217109 30460 tablet_bootstrap.cc:492] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.220765 30462 tablet_bootstrap.cc:492] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.221294 30462 ts_tablet_manager.cc:1403] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:21:07.224327 30462 raft_consensus.cc:359] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.225118 30462 raft_consensus.cc:385] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.225430 30462 raft_consensus.cc:740] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.226681 30460 tablet_bootstrap.cc:654] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.226408 30462 consensus_queue.cc:260] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.229005 30462 ts_tablet_manager.cc:1434] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:07.230037 30462 tablet_bootstrap.cc:492] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.236634 30462 tablet_bootstrap.cc:654] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.243371 30464 raft_consensus.cc:493] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.244100 30464 raft_consensus.cc:515] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.246694 30462 tablet_bootstrap.cc:492] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.247197 30462 ts_tablet_manager.cc:1403] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 12:21:07.250550 30464 leader_election.cc:290] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.251319 30460 tablet_bootstrap.cc:492] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.251750 30459 tablet_bootstrap.cc:492] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.251902 30460 ts_tablet_manager.cc:1403] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.008s
I20260709 12:21:07.252229 30459 ts_tablet_manager.cc:1403] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.063s	user 0.034s	sys 0.025s
I20260709 12:21:07.252007 30462 raft_consensus.cc:359] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.252804 30462 raft_consensus.cc:385] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.253125 30462 raft_consensus.cc:740] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.255239 30459 raft_consensus.cc:359] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.255273 30460 raft_consensus.cc:359] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.256125 30459 raft_consensus.cc:385] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.256456 30459 raft_consensus.cc:740] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.256405 30460 raft_consensus.cc:385] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.257431 30459 consensus_queue.cc:260] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.257968 30460 raft_consensus.cc:740] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.259693 30459 ts_tablet_manager.cc:1434] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:07.260646 30459 tablet_bootstrap.cc:492] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.254070 30462 consensus_queue.cc:260] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.266000 30462 ts_tablet_manager.cc:1434] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:21:07.267051 30459 tablet_bootstrap.cc:654] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.267071 30462 tablet_bootstrap.cc:492] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.271075 30460 consensus_queue.cc:260] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.271710 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.272099 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
W20260709 12:21:07.275077 30382 leader_election.cc:343] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.275498 30460 ts_tablet_manager.cc:1434] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
W20260709 12:21:07.276093 30382 leader_election.cc:343] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.276517 30460 tablet_bootstrap.cc:492] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.276630 30382 leader_election.cc:304] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:07.282773 30462 tablet_bootstrap.cc:654] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.283635 30460 tablet_bootstrap.cc:654] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.286881 30464 raft_consensus.cc:2749] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:07.296581 30460 tablet_bootstrap.cc:492] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.297122 30460 ts_tablet_manager.cc:1403] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.011s
I20260709 12:21:07.297871 30462 tablet_bootstrap.cc:492] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.298491 30462 ts_tablet_manager.cc:1403] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.000s
I20260709 12:21:07.299401 30464 raft_consensus.cc:493] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.299963 30460 raft_consensus.cc:359] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.299883 30464 raft_consensus.cc:515] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.300513 30460 raft_consensus.cc:385] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.300740 30460 raft_consensus.cc:740] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.301366 30460 consensus_queue.cc:260] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.301291 30462 raft_consensus.cc:359] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.302122 30464 leader_election.cc:290] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.302424 30462 raft_consensus.cc:385] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.302738 30462 raft_consensus.cc:740] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.303851 30460 ts_tablet_manager.cc:1434] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:21:07.303475 30462 consensus_queue.cc:260] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.304839 30460 tablet_bootstrap.cc:492] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.306116 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.306365 30462 ts_tablet_manager.cc:1434] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:21:07.306243 30459 tablet_bootstrap.cc:492] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.307062 30459 ts_tablet_manager.cc:1403] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.010s
I20260709 12:21:07.307413 30462 tablet_bootstrap.cc:492] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.309780 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.310515 30267 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 0.
I20260709 12:21:07.310096 30459 raft_consensus.cc:359] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.311127 30459 raft_consensus.cc:385] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.311507 30459 raft_consensus.cc:740] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.311949 30460 tablet_bootstrap.cc:654] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:07.312014 30382 leader_election.cc:343] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.312582 30459 consensus_queue.cc:260] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.313997 30462 tablet_bootstrap.cc:654] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.318006 30459 ts_tablet_manager.cc:1434] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:21:07.319607 30459 tablet_bootstrap.cc:492] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.325444 30460 tablet_bootstrap.cc:492] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.325528 30462 tablet_bootstrap.cc:492] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.326092 30460 ts_tablet_manager.cc:1403] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 12:21:07.326221 30462 ts_tablet_manager.cc:1403] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 12:21:07.327255 30459 tablet_bootstrap.cc:654] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.327085 30382 leader_election.cc:304] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:07.328328 30464 raft_consensus.cc:2804] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.328728 30464 raft_consensus.cc:493] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.329075 30464 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.329157 30460 raft_consensus.cc:359] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.329393 30462 raft_consensus.cc:359] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.330008 30460 raft_consensus.cc:385] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.330215 30462 raft_consensus.cc:385] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.330353 30460 raft_consensus.cc:740] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.330610 30462 raft_consensus.cc:740] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.331427 30460 consensus_queue.cc:260] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.331590 30462 consensus_queue.cc:260] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.334086 30460 ts_tablet_manager.cc:1434] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260709 12:21:07.335157 30460 tablet_bootstrap.cc:492] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.336486 30462 ts_tablet_manager.cc:1434] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:21:07.337612 30462 tablet_bootstrap.cc:492] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.337306 30464 raft_consensus.cc:515] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.342128 30460 tablet_bootstrap.cc:654] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.343688 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:07.344344 30267 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.344375 30464 leader_election.cc:290] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.345086 30462 tablet_bootstrap.cc:654] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.346311 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:07.347216 30343 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.353933 30465 raft_consensus.cc:493] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.354527 30465 raft_consensus.cc:515] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.366601 30465 leader_election.cc:290] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.386003 30267 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 1.
I20260709 12:21:07.387343 30343 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 1.
I20260709 12:21:07.387378 30382 leader_election.cc:304] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
I20260709 12:21:07.388926 30464 raft_consensus.cc:2804] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.391223 30464 raft_consensus.cc:697] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:07.392145 30464 consensus_queue.cc:237] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.397054 30459 tablet_bootstrap.cc:492] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.397655 30459 ts_tablet_manager.cc:1403] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.078s	user 0.032s	sys 0.023s
I20260709 12:21:07.399699 30462 tablet_bootstrap.cc:492] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.400265 30462 ts_tablet_manager.cc:1403] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.032s
I20260709 12:21:07.400784 30459 raft_consensus.cc:359] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
W20260709 12:21:07.402963 30212 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:07.404000 30462 raft_consensus.cc:359] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.404860 30462 raft_consensus.cc:385] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.405299 30462 raft_consensus.cc:740] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.404681 30460 tablet_bootstrap.cc:492] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.406241 30462 consensus_queue.cc:260] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.408617 30161 catalog_manager.cc:5697] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:07.401610 30459 raft_consensus.cc:385] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.412891 30459 raft_consensus.cc:740] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.413378 30462 ts_tablet_manager.cc:1434] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:07.413770 30459 consensus_queue.cc:260] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.407173 30460 ts_tablet_manager.cc:1403] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.011s
I20260709 12:21:07.414728 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc6092f29746b28020e981cd2737d3" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.415237 30462 tablet_bootstrap.cc:492] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.415387 30343 raft_consensus.cc:2468] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 0.
I20260709 12:21:07.416731 30230 leader_election.cc:304] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.417533 30465 raft_consensus.cc:2804] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.417899 30465 raft_consensus.cc:493] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.418268 30465 raft_consensus.cc:3060] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.418089 30460 raft_consensus.cc:359] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.419116 30460 raft_consensus.cc:385] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.419515 30460 raft_consensus.cc:740] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.420400 30460 consensus_queue.cc:260] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.427433 30488 raft_consensus.cc:493] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.428010 30488 raft_consensus.cc:515] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.429616 30459 ts_tablet_manager.cc:1434] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:21:07.429947 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc6092f29746b28020e981cd2737d3" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.430754 30459 tablet_bootstrap.cc:492] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.430848 30418 raft_consensus.cc:2468] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 0.
I20260709 12:21:07.431504 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.432736 30488 leader_election.cc:290] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
W20260709 12:21:07.433111 30232 leader_election.cc:343] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.435357 30460 ts_tablet_manager.cc:1434] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:21:07.436385 30469 raft_consensus.cc:493] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.436961 30459 tablet_bootstrap.cc:654] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.436892 30469 raft_consensus.cc:515] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.426374 30465 raft_consensus.cc:515] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.442164 30464 raft_consensus.cc:493] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.441651 30465 leader_election.cc:290] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.442858 30464 raft_consensus.cc:515] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.446264 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc6092f29746b28020e981cd2737d3" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:07.446643 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e43053a49b84739a63891147ff8837a" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.447127 30417 raft_consensus.cc:3060] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.447474 30267 raft_consensus.cc:2468] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 0.
I20260709 12:21:07.448966 30462 tablet_bootstrap.cc:654] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.448925 30382 leader_election.cc:304] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
I20260709 12:21:07.450146 30485 raft_consensus.cc:2804] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.450544 30485 raft_consensus.cc:493] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.450996 30485 raft_consensus.cc:3060] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.451187 30469 leader_election.cc:290] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.456290 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e43053a49b84739a63891147ff8837a" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.457230 30343 raft_consensus.cc:2468] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 0.
I20260709 12:21:07.458842 30460 tablet_bootstrap.cc:492] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.450554 30464 leader_election.cc:290] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.466967 30485 raft_consensus.cc:515] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.469218 30417 raft_consensus.cc:2468] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 1.
I20260709 12:21:07.471218 30232 leader_election.cc:304] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
I20260709 12:21:07.472599 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e43053a49b84739a63891147ff8837a" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:07.472918 30464 raft_consensus.cc:493] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.473526 30267 raft_consensus.cc:3060] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.473556 30464 raft_consensus.cc:515] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.478292 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d9e1c2fc6840b480154fb8112bd941" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.478776 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d9e1c2fc6840b480154fb8112bd941" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.479041 30343 raft_consensus.cc:2468] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 0.
I20260709 12:21:07.480436 30382 leader_election.cc:304] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.481701 30464 leader_election.cc:290] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.482708 30464 raft_consensus.cc:2804] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.483889 30464 raft_consensus.cc:493] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.485146 30464 raft_consensus.cc:3060] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.472570 30465 raft_consensus.cc:2804] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.486892 30465 raft_consensus.cc:697] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:07.487999 30465 consensus_queue.cc:237] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.490957 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.485976 30267 raft_consensus.cc:2468] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 1.
I20260709 12:21:07.493038 30460 tablet_bootstrap.cc:654] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:07.492947 30307 leader_election.cc:343] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.493281 30462 tablet_bootstrap.cc:492] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
W20260709 12:21:07.493214 30382 leader_election.cc:343] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.494625 30382 leader_election.cc:304] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
I20260709 12:21:07.495910 30485 leader_election.cc:290] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.496518 30485 raft_consensus.cc:2804] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.497030 30485 raft_consensus.cc:697] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:07.497895 30459 tablet_bootstrap.cc:492] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.498543 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e43053a49b84739a63891147ff8837a" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:07.504751 30343 raft_consensus.cc:3060] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.505417 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.507827 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc6092f29746b28020e981cd2737d3" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:07.508415 30342 raft_consensus.cc:3060] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.511428 30460 tablet_bootstrap.cc:492] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.510882 30164 catalog_manager.cc:5697] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 1 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.511988 30460 ts_tablet_manager.cc:1403] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.009s
I20260709 12:21:07.512488 30459 ts_tablet_manager.cc:1403] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.082s	user 0.038s	sys 0.020s
I20260709 12:21:07.512868 30469 raft_consensus.cc:493] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.513399 30469 raft_consensus.cc:515] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.515812 30469 leader_election.cc:290] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.516073 30342 raft_consensus.cc:2468] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 1.
I20260709 12:21:07.516284 30343 raft_consensus.cc:2468] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 1.
W20260709 12:21:07.517280 30230 leader_election.cc:343] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.517618 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.517789 30230 leader_election.cc:304] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e; no voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:07.518105 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.501636 30462 ts_tablet_manager.cc:1403] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.000s
I20260709 12:21:07.502853 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
W20260709 12:21:07.519392 30307 leader_election.cc:343] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.520221 30465 raft_consensus.cc:2749] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:07.520684 30309 leader_election.cc:343] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.520443 30460 raft_consensus.cc:359] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.521265 30460 raft_consensus.cc:385] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.521138 30309 leader_election.cc:304] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 803ce617652546fab54bd1d24bb3fd2d; no voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:07.521649 30460 raft_consensus.cc:740] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.522336 30462 raft_consensus.cc:359] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.522625 30469 raft_consensus.cc:2749] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:07.523061 30462 raft_consensus.cc:385] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.523386 30462 raft_consensus.cc:740] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.523622 30460 consensus_queue.cc:260] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
W20260709 12:21:07.524263 30309 leader_election.cc:343] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.524294 30462 consensus_queue.cc:260] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.524689 30485 consensus_queue.cc:237] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.525049 30309 leader_election.cc:304] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 803ce617652546fab54bd1d24bb3fd2d; no voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:07.526732 30460 ts_tablet_manager.cc:1434] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.010s
I20260709 12:21:07.527635 30460 tablet_bootstrap.cc:492] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.515808 30459 raft_consensus.cc:359] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.533950 30459 raft_consensus.cc:385] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.533646 30460 tablet_bootstrap.cc:654] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.534272 30469 raft_consensus.cc:2749] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:07.534283 30459 raft_consensus.cc:740] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.536031 30459 consensus_queue.cc:260] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.539382 30459 ts_tablet_manager.cc:1434] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:21:07.540807 30459 tablet_bootstrap.cc:492] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.547889 30462 ts_tablet_manager.cc:1434] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 12:21:07.549464 30462 tablet_bootstrap.cc:492] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.529560 30464 raft_consensus.cc:515] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.557343 30460 tablet_bootstrap.cc:492] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.557578 30459 tablet_bootstrap.cc:654] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.557875 30460 ts_tablet_manager.cc:1403] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.012s
I20260709 12:21:07.559360 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d9e1c2fc6840b480154fb8112bd941" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:07.560617 30460 raft_consensus.cc:359] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
W20260709 12:21:07.560968 30382 leader_election.cc:343] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.561301 30460 raft_consensus.cc:385] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.561611 30460 raft_consensus.cc:740] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.562566 30464 leader_election.cc:290] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.562402 30460 consensus_queue.cc:260] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.563594 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d9e1c2fc6840b480154fb8112bd941" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:07.564533 30343 raft_consensus.cc:3060] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.564973 30460 ts_tablet_manager.cc:1434] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:07.565963 30460 tablet_bootstrap.cc:492] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.567636 30462 tablet_bootstrap.cc:654] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.570084 30161 catalog_manager.cc:5697] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:07.572332 30460 tablet_bootstrap.cc:654] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.580196 30462 tablet_bootstrap.cc:492] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.580777 30462 ts_tablet_manager.cc:1403] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.003s
I20260709 12:21:07.582790 30460 tablet_bootstrap.cc:492] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.583382 30460 ts_tablet_manager.cc:1403] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.011s
I20260709 12:21:07.583737 30462 raft_consensus.cc:359] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.584522 30462 raft_consensus.cc:385] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.584824 30462 raft_consensus.cc:740] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.585793 30462 consensus_queue.cc:260] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.586937 30460 raft_consensus.cc:359] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.587734 30460 raft_consensus.cc:385] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.588104 30460 raft_consensus.cc:740] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.588763 30462 ts_tablet_manager.cc:1434] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:21:07.589073 30460 consensus_queue.cc:260] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.589859 30462 tablet_bootstrap.cc:492] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.591655 30460 ts_tablet_manager.cc:1434] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:07.592427 30465 raft_consensus.cc:493] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.592865 30460 tablet_bootstrap.cc:492] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e: Bootstrap starting.
I20260709 12:21:07.592891 30465 raft_consensus.cc:515] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.595249 30465 leader_election.cc:290] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.598122 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d9e1c2fc6840b480154fb8112bd941" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.599013 30417 raft_consensus.cc:2393] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in current term 1: Already voted for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in this term.
I20260709 12:21:07.599434 30460 tablet_bootstrap.cc:654] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.599879 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72d9e1c2fc6840b480154fb8112bd941" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.602573 30465 raft_consensus.cc:493] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.602530 30230 leader_election.cc:304] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e; no voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:07.603274 30465 raft_consensus.cc:515] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.604107 30490 raft_consensus.cc:3060] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.606940 30465 leader_election.cc:290] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.610914 30462 tablet_bootstrap.cc:654] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.611357 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.612062 30417 raft_consensus.cc:2468] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 0.
I20260709 12:21:07.613627 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.615224 30232 leader_election.cc:304] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
W20260709 12:21:07.616279 30230 leader_election.cc:343] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.618870 30465 raft_consensus.cc:2804] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.619997 30490 raft_consensus.cc:2749] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:07.620393 30465 raft_consensus.cc:493] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.620846 30465 raft_consensus.cc:3060] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.629899 30343 raft_consensus.cc:2468] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 1.
I20260709 12:21:07.631366 30382 leader_election.cc:304] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:07.632632 30464 raft_consensus.cc:2804] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.633132 30464 raft_consensus.cc:697] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:07.634008 30464 consensus_queue.cc:237] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.639668 30490 raft_consensus.cc:493] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.640190 30460 tablet_bootstrap.cc:492] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e: No bootstrap required, opened a new log
I20260709 12:21:07.640748 30460 ts_tablet_manager.cc:1403] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:21:07.640412 30490 raft_consensus.cc:515] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.644544 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.644788 30460 raft_consensus.cc:359] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.645568 30460 raft_consensus.cc:385] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.645891 30460 raft_consensus.cc:740] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.646301 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.646564 30460 consensus_queue.cc:260] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.648774 30460 ts_tablet_manager.cc:1434] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 12:21:07.648833 30230 leader_election.cc:343] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.650671 30465 raft_consensus.cc:515] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.651270 30459 tablet_bootstrap.cc:492] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.651880 30459 ts_tablet_manager.cc:1403] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.111s	user 0.043s	sys 0.036s
I20260709 12:21:07.652709 30462 tablet_bootstrap.cc:492] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.653144 30462 ts_tablet_manager.cc:1403] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.007s
I20260709 12:21:07.653524 30465 leader_election.cc:290] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.654810 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
W20260709 12:21:07.655138 30232 leader_election.cc:343] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.654948 30459 raft_consensus.cc:359] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.655720 30459 raft_consensus.cc:385] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.655766 30462 raft_consensus.cc:359] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.656560 30462 raft_consensus.cc:385] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:07.656697 30230 leader_election.cc:343] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.656857 30462 raft_consensus.cc:740] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.657013 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:07.656195 30459 raft_consensus.cc:740] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.655691 30232 leader_election.cc:304] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e; no voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:07.657783 30462 consensus_queue.cc:260] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.657804 30417 raft_consensus.cc:3060] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.658756 30459 consensus_queue.cc:260] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.660046 30462 ts_tablet_manager.cc:1434] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:21:07.661962 30459 ts_tablet_manager.cc:1434] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:21:07.663436 30459 tablet_bootstrap.cc:492] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.665437 30161 catalog_manager.cc:5697] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:07.667218 30417 raft_consensus.cc:2468] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 1.
I20260709 12:21:07.668717 30232 leader_election.cc:304] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:07.669675 30488 raft_consensus.cc:2749] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:07.670497 30488 raft_consensus.cc:2804] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.670986 30488 raft_consensus.cc:697] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:07.671751 30459 tablet_bootstrap.cc:654] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.671936 30488 consensus_queue.cc:237] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.675559 30462 tablet_bootstrap.cc:492] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: Bootstrap starting.
I20260709 12:21:07.682109 30462 tablet_bootstrap.cc:654] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.683861 30490 leader_election.cc:290] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.689320 30459 tablet_bootstrap.cc:492] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.690023 30459 ts_tablet_manager.cc:1403] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.003s
I20260709 12:21:07.692065 30462 tablet_bootstrap.cc:492] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: No bootstrap required, opened a new log
I20260709 12:21:07.692576 30462 ts_tablet_manager.cc:1403] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 12:21:07.693317 30459 raft_consensus.cc:359] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.694182 30459 raft_consensus.cc:385] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.694489 30459 raft_consensus.cc:740] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.694772 30462 raft_consensus.cc:359] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.695348 30462 raft_consensus.cc:385] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.695766 30462 raft_consensus.cc:740] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.695268 30459 consensus_queue.cc:260] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.695459 30164 catalog_manager.cc:5697] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 1 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.696445 30462 consensus_queue.cc:260] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.698031 30459 ts_tablet_manager.cc:1434] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:07.698523 30462 ts_tablet_manager.cc:1434] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:07.699116 30459 tablet_bootstrap.cc:492] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.705971 30459 tablet_bootstrap.cc:654] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.714427 30459 tablet_bootstrap.cc:492] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.714957 30459 ts_tablet_manager.cc:1403] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 12:21:07.715046 30469 raft_consensus.cc:493] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.715668 30469 raft_consensus.cc:515] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.717304 30459 raft_consensus.cc:359] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.717662 30469 leader_election.cc:290] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943), 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663)
I20260709 12:21:07.717996 30459 raft_consensus.cc:385] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.718356 30459 raft_consensus.cc:740] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.718466 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.719283 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.719084 30459 consensus_queue.cc:260] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
W20260709 12:21:07.719712 30309 leader_election.cc:343] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.719861 30267 raft_consensus.cc:2468] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 0.
I20260709 12:21:07.721015 30307 leader_election.cc:304] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:07.721463 30459 ts_tablet_manager.cc:1434] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:21:07.721954 30469 raft_consensus.cc:2804] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.722322 30469 raft_consensus.cc:493] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.722426 30459 tablet_bootstrap.cc:492] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6: Bootstrap starting.
I20260709 12:21:07.722672 30469 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.728294 30459 tablet_bootstrap.cc:654] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:07.730155 30469 raft_consensus.cc:515] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.732393 30469 leader_election.cc:290] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 election: Requested vote from peers 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943), 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663)
I20260709 12:21:07.733108 30459 tablet_bootstrap.cc:492] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6: No bootstrap required, opened a new log
I20260709 12:21:07.733335 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:07.733563 30459 ts_tablet_manager.cc:1403] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:21:07.733479 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:07.734189 30267 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:07.735028 30309 leader_election.cc:343] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:07.736330 30459 raft_consensus.cc:359] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.736830 30459 raft_consensus.cc:385] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:07.737010 30459 raft_consensus.cc:740] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Initialized, Role: FOLLOWER
I20260709 12:21:07.737567 30459 consensus_queue.cc:260] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.739235 30459 ts_tablet_manager.cc:1434] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:07.740420 30267 raft_consensus.cc:2468] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 1.
I20260709 12:21:07.741955 30307 leader_election.cc:304] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:07.742820 30469 raft_consensus.cc:2804] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.743920 30469 raft_consensus.cc:697] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:07.744817 30469 consensus_queue.cc:237] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.749215 30513 raft_consensus.cc:493] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.749784 30513 raft_consensus.cc:515] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.752213 30513 leader_election.cc:290] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.753397 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.754272 30417 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 0.
I20260709 12:21:07.753459 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.755652 30309 leader_election.cc:304] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.756512 30267 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 0.
I20260709 12:21:07.756753 30513 raft_consensus.cc:2804] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.756227 30163 catalog_manager.cc:5697] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 1 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.757138 30513 raft_consensus.cc:493] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.757599 30513 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.764304 30513 raft_consensus.cc:515] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.766285 30513 leader_election.cc:290] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.766978 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:07.767251 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:07.767470 30267 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.767810 30417 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.768920 30464 raft_consensus.cc:493] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.769394 30464 raft_consensus.cc:515] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.771466 30464 leader_election.cc:290] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.773057 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.773242 30267 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 1.
I20260709 12:21:07.773500 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.773703 30266 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 0.
I20260709 12:21:07.774247 30343 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 0.
I20260709 12:21:07.775025 30307 leader_election.cc:304] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.775540 30417 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 1.
I20260709 12:21:07.775825 30513 raft_consensus.cc:2804] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.776062 30382 leader_election.cc:304] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.776880 30464 raft_consensus.cc:2804] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.777236 30464 raft_consensus.cc:493] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.777671 30464 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.777223 30513 raft_consensus.cc:697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:07.778699 30513 consensus_queue.cc:237] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.784092 30464 raft_consensus.cc:515] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.785996 30464 leader_election.cc:290] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:07.786696 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:07.787286 30266 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.787226 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:07.787901 30343 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.787773 30163 catalog_manager.cc:5697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 1 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.795516 30343 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 1.
I20260709 12:21:07.796716 30382 leader_election.cc:304] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.797372 30266 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 1.
I20260709 12:21:07.797514 30464 raft_consensus.cc:2804] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.798372 30464 raft_consensus.cc:697] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:07.799213 30464 consensus_queue.cc:237] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.806605 30163 catalog_manager.cc:5697] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:07.815783 30464 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:07.820924 30488 raft_consensus.cc:493] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.821610 30488 raft_consensus.cc:515] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.824048 30488 leader_election.cc:290] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.825063 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.825713 30343 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 0.
I20260709 12:21:07.826967 30230 leader_election.cc:304] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.827804 30488 raft_consensus.cc:2804] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.828177 30488 raft_consensus.cc:493] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.828497 30488 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.829104 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.830360 30417 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 0.
I20260709 12:21:07.834945 30485 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:07.840374 30488 raft_consensus.cc:515] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.843802 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:07.844497 30341 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.845017 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:07.845620 30417 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.852012 30341 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 1.
I20260709 12:21:07.852680 30417 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 1.
I20260709 12:21:07.853488 30230 leader_election.cc:304] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.854666 30488 leader_election.cc:290] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 1 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.854782 30490 raft_consensus.cc:2804] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.855286 30490 raft_consensus.cc:697] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:07.856146 30490 consensus_queue.cc:237] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.862596 30513 raft_consensus.cc:493] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.863085 30513 raft_consensus.cc:515] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.865208 30513 leader_election.cc:290] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.866086 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.866729 30513 raft_consensus.cc:493] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.867238 30513 raft_consensus.cc:515] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.866551 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.867810 30164 catalog_manager.cc:5697] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 1 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.868659 30417 raft_consensus.cc:2393] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 803ce617652546fab54bd1d24bb3fd2d in current term 1: Already voted for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in this term.
I20260709 12:21:07.870201 30309 leader_election.cc:304] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 803ce617652546fab54bd1d24bb3fd2d; no voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:07.870610 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" is_pre_election: true
I20260709 12:21:07.871019 30469 raft_consensus.cc:3060] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.871249 30417 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 0.
I20260709 12:21:07.871328 30513 leader_election.cc:290] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.872409 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.873096 30266 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 0.
I20260709 12:21:07.874375 30307 leader_election.cc:304] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.875507 30513 raft_consensus.cc:2804] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:07.875833 30513 raft_consensus.cc:493] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:07.876176 30513 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.878415 30469 raft_consensus.cc:2749] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:07.881279 30513 raft_consensus.cc:515] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.882989 30513 leader_election.cc:290] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:07.883818 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:07.884042 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:07.884440 30266 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.884543 30417 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.890892 30417 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 1.
I20260709 12:21:07.891057 30266 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 1.
I20260709 12:21:07.892136 30309 leader_election.cc:304] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:07.892967 30513 raft_consensus.cc:2804] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:07.893471 30513 raft_consensus.cc:697] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:07.894299 30513 consensus_queue.cc:237] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:07.902012 30164 catalog_manager.cc:5697] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 1 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:07.912340 30485 consensus_queue.cc:1048] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:07.923744 30464 consensus_queue.cc:1048] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:07.931493 30370 tablet.cc:2406] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:07.947911 30464 raft_consensus.cc:493] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:07.948555 30464 raft_consensus.cc:515] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:07.950798 30464 leader_election.cc:290] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663)
I20260709 12:21:07.951606 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "803ce617652546fab54bd1d24bb3fd2d" is_pre_election: true
I20260709 12:21:07.951763 30490 consensus_queue.cc:1048] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:07.951990 30266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" is_pre_election: true
I20260709 12:21:07.952911 30266 raft_consensus.cc:2393] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f7d02bc70464623bb8c4025ab29ddf6 in current term 1: Already voted for candidate 803ce617652546fab54bd1d24bb3fd2d in this term.
I20260709 12:21:07.954064 30382 leader_election.cc:304] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:07.954824 30464 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:07.963979 30490 consensus_queue.cc:1048] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:07.969959 30464 raft_consensus.cc:2749] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:08.042660 30342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:42648
I20260709 12:21:08.043299 30342 raft_consensus.cc:606] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:08.048815 30342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:42648
I20260709 12:21:08.049353 30342 raft_consensus.cc:606] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:08.066587 30417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "137a2db5be614860a25334718f9caac8"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:21:08.067144 30417 raft_consensus.cc:606] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:08.082731 30490 consensus_queue.cc:1048] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.086249 30266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
mode: GRACEFUL
new_leader_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:37252
I20260709 12:21:08.086961 30266 raft_consensus.cc:606] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Received request to transfer leadership to TS 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:08.094897 30488 consensus_queue.cc:1048] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.100016 30418 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
mode: GRACEFUL
new_leader_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:21:08.100684 30418 raft_consensus.cc:606] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Received request to transfer leadership to TS 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:08.108625 30417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e43053a49b84739a63891147ff8837a"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
mode: GRACEFUL
new_leader_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:21:08.109177 30417 raft_consensus.cc:606] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Received request to transfer leadership to TS 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:08.158774 30464 consensus_queue.cc:1048] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.169507 30485 consensus_queue.cc:1048] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.209903 30495 consensus_queue.cc:1048] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.220970 30513 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.221179 30464 consensus_queue.cc:1048] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.230234 30495 raft_consensus.cc:993] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6: : Instructing follower 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:08.230789 30495 raft_consensus.cc:1081] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Signalling peer 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:08.232983 30342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:42638
I20260709 12:21:08.234220 30342 raft_consensus.cc:493] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.234603 30342 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.240231 30469 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.241856 30342 raft_consensus.cc:515] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.246224 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:08.246969 30417 raft_consensus.cc:3055] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:08.247340 30417 raft_consensus.cc:740] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:08.248131 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:08.248426 30342 leader_election.cc:290] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:08.248211 30417 consensus_queue.cc:260] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.249483 30417 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.248817 30267 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.252344 30540 raft_consensus.cc:993] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:08.252787 30540 raft_consensus.cc:1081] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:08.254601 30266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37236
I20260709 12:21:08.255142 30266 raft_consensus.cc:493] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.255507 30266 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.256419 30267 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:08.256419 30417 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:08.257614 30307 leader_election.cc:304] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:08.258708 30469 raft_consensus.cc:2804] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:08.259184 30469 raft_consensus.cc:697] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:08.259974 30469 consensus_queue.cc:237] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.262271 30266 raft_consensus.cc:515] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.265733 30266 leader_election.cc:290] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:08.266422 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:08.269508 30342 raft_consensus.cc:3055] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:08.269874 30342 raft_consensus.cc:740] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:08.267117 30469 consensus_queue.cc:1048] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.270722 30342 consensus_queue.cc:260] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.271984 30342 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.267910 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:08.272657 30417 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.268561 30164 catalog_manager.cc:5697] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 1 to 2, leader changed from 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67) to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 2 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.279117 30513 raft_consensus.cc:993] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:08.279235 30342 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 2.
I20260709 12:21:08.279660 30513 raft_consensus.cc:1081] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:08.280547 30230 leader_election.cc:304] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:08.281313 30417 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 2.
I20260709 12:21:08.282033 30527 raft_consensus.cc:2804] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:08.283447 30527 raft_consensus.cc:697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:08.284345 30527 consensus_queue.cc:237] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.281983 30266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37236
I20260709 12:21:08.288312 30540 consensus_queue.cc:1048] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.288599 30266 raft_consensus.cc:493] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.289426 30266 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.293622 30469 consensus_queue.cc:1048] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.300805 30266 raft_consensus.cc:515] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:08.306495 30266 leader_election.cc:290] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:08.308260 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:08.308830 30164 catalog_manager.cc:5697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 1 to 2, leader changed from 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 2 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.311230 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:08.311888 30342 raft_consensus.cc:3055] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:08.312220 30342 raft_consensus.cc:740] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:08.312973 30342 consensus_queue.cc:260] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:08.315981 30342 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.316046 30540 consensus_queue.cc:1048] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:08.322901 30342 raft_consensus.cc:2468] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 2.
I20260709 12:21:08.324329 30230 leader_election.cc:304] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:08.325227 30527 raft_consensus.cc:2804] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:08.325837 30527 raft_consensus.cc:697] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:08.326735 30527 consensus_queue.cc:237] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:08.335510 30163 catalog_manager.cc:5697] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 1 to 2, leader changed from 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 2 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:08.387953 30527 consensus_queue.cc:1048] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.395884 30488 raft_consensus.cc:993] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e: : Instructing follower 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:08.396414 30490 raft_consensus.cc:1081] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Signalling peer 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:08.398216 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:42640
I20260709 12:21:08.398985 30341 raft_consensus.cc:493] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.399377 30341 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.401155 30490 consensus_queue.cc:1048] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:08.408289 30341 raft_consensus.cc:515] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.414173 30341 leader_election.cc:290] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:08.414992 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:08.415576 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:08.415622 30267 raft_consensus.cc:3055] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:08.416242 30417 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.416175 30267 raft_consensus.cc:740] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:08.417153 30267 consensus_queue.cc:260] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
W20260709 12:21:08.418164 30490 consensus_queue.cc:1175] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:21:08.418340 30267 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.423517 30417 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:08.427157 30309 leader_election.cc:304] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:08.428006 30540 raft_consensus.cc:2804] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:08.428488 30540 raft_consensus.cc:697] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:08.429651 30267 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:08.429318 30540 consensus_queue.cc:237] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.436033 30163 catalog_manager.cc:5697] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 1 to 2, leader changed from 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65) to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 2 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.443663 30495 raft_consensus.cc:993] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:08.444164 30464 raft_consensus.cc:1081] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:08.445815 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "137a2db5be614860a25334718f9caac8"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37228
I20260709 12:21:08.446331 30267 raft_consensus.cc:493] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.446656 30267 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.451462 30267 raft_consensus.cc:515] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.453199 30267 leader_election.cc:290] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:08.454195 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:08.454447 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:08.454833 30341 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.455231 30417 raft_consensus.cc:3055] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:08.455556 30417 raft_consensus.cc:740] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:08.456378 30417 consensus_queue.cc:260] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.457636 30417 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.462023 30341 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 2.
I20260709 12:21:08.463441 30230 leader_election.cc:304] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:08.464274 30490 raft_consensus.cc:2804] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:08.464515 30417 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 2.
I20260709 12:21:08.464761 30490 raft_consensus.cc:697] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:08.465544 30490 consensus_queue.cc:237] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.471892 30163 catalog_manager.cc:5697] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 1 to 2, leader changed from 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 2 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.532145 30495 raft_consensus.cc:993] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6: : Instructing follower 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:08.532660 30464 raft_consensus.cc:1081] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Signalling peer 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:08.534377 30341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e43053a49b84739a63891147ff8837a"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:42638
I20260709 12:21:08.534936 30341 raft_consensus.cc:493] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:08.535333 30341 raft_consensus.cc:3060] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.541838 30341 raft_consensus.cc:515] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.544028 30341 leader_election.cc:290] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:08.544974 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e43053a49b84739a63891147ff8837a" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:08.545084 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e43053a49b84739a63891147ff8837a" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:08.545732 30267 raft_consensus.cc:3060] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.545864 30417 raft_consensus.cc:3055] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:08.546212 30417 raft_consensus.cc:740] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:08.547067 30417 consensus_queue.cc:260] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.548308 30417 raft_consensus.cc:3060] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.553994 30267 raft_consensus.cc:2468] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:08.555330 30307 leader_election.cc:304] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:08.556427 30540 raft_consensus.cc:2804] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:08.556597 30417 raft_consensus.cc:2468] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:08.556986 30540 raft_consensus.cc:697] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:08.557924 30540 consensus_queue.cc:237] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:08.565903 30163 catalog_manager.cc:5697] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 1 to 2, leader changed from 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67) to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 2 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:08.657313 30417 raft_consensus.cc:1275] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.658950 30540 consensus_queue.cc:1048] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.666982 30267 raft_consensus.cc:1275] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.668448 30469 consensus_queue.cc:1048] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.774516 30341 raft_consensus.cc:1275] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.775921 30490 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.785574 30417 raft_consensus.cc:1275] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.788187 30490 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.869311 30267 raft_consensus.cc:1275] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.870774 30540 consensus_queue.cc:1048] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.878629 30417 raft_consensus.cc:1275] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.880139 30513 consensus_queue.cc:1048] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.885190 30341 raft_consensus.cc:1275] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.886823 30490 consensus_queue.cc:1048] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.898439 30417 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:08.905370 30417 raft_consensus.cc:1275] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.906733 30490 consensus_queue.cc:1048] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.949067 30267 raft_consensus.cc:1275] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.950364 30513 consensus_queue.cc:1048] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:08.958906 30417 raft_consensus.cc:1275] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:08.960925 30469 consensus_queue.cc:1048] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:09.043439 30341 raft_consensus.cc:1275] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:09.044721 30490 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:09.053256 30417 raft_consensus.cc:1275] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:09.054909 30488 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:11.147061 29609 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:21:11.147871 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:11.170998 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "137a2db5be614860a25334718f9caac8"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
mode: GRACEFUL
new_leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:46140
I20260709 12:21:11.171494 30267 raft_consensus.cc:606] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Received request to transfer leadership to TS 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:11.173977 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
mode: GRACEFUL
new_leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:46140
I20260709 12:21:11.174428 30267 raft_consensus.cc:606] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Received request to transfer leadership to TS 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:11.175426 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:11.175868 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:11.452875 30488 raft_consensus.cc:993] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e: : Instructing follower 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:11.453361 30554 raft_consensus.cc:1081] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Signalling peer 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:11.455152 30417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:37720
I20260709 12:21:11.455811 30417 raft_consensus.cc:493] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:11.456152 30417 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.461225 30417 raft_consensus.cc:515] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:11.462859 30417 leader_election.cc:290] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 3 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:11.463939 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:11.464298 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:11.464632 30267 raft_consensus.cc:3055] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:11.464964 30342 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.465044 30267 raft_consensus.cc:740] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:11.466045 30267 consensus_queue.cc:260] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:11.467119 30267 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.472483 30342 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 3.
I20260709 12:21:11.472754 30267 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 3.
I20260709 12:21:11.473749 30382 leader_election.cc:304] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:11.474550 30464 raft_consensus.cc:2804] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:11.475596 30464 raft_consensus.cc:697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:11.476356 30464 consensus_queue.cc:237] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:11.483589 30163 catalog_manager.cc:5697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 2 to 3, leader changed from 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65) to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:11.532060 30488 raft_consensus.cc:993] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e: : Instructing follower 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:11.532519 30554 raft_consensus.cc:1081] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Signalling peer 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:11.534081 30417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "137a2db5be614860a25334718f9caac8"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:37720
I20260709 12:21:11.534679 30417 raft_consensus.cc:493] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:11.535001 30417 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.539976 30417 raft_consensus.cc:515] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:11.541448 30417 leader_election.cc:290] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 3 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:11.542563 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:11.542832 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:11.543102 30267 raft_consensus.cc:3055] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:11.543428 30342 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.543440 30267 raft_consensus.cc:740] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:11.544320 30267 consensus_queue.cc:260] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:11.545287 30267 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:11.548427 30342 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 3.
I20260709 12:21:11.549546 30382 leader_election.cc:304] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:11.550313 30267 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 3.
I20260709 12:21:11.550402 30464 raft_consensus.cc:2804] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:11.550987 30464 raft_consensus.cc:697] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:11.551790 30464 consensus_queue.cc:237] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:11.558889 30163 catalog_manager.cc:5697] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 2 to 3, leader changed from 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65) to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:11.909889 30267 raft_consensus.cc:1275] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:11.911118 30464 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:11.921144 30342 raft_consensus.cc:1275] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:11.924032 30566 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:12.138141 30342 raft_consensus.cc:1275] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:12.139719 30566 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.151842 30267 raft_consensus.cc:1275] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:12.153119 30557 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.176887 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:12.182528 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:12.183043 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:13.184072 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:13.190156 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:13.190618 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:14.191826 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:14.197412 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:14.197937 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:15.199301 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.206687 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:15.207158 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:16.208483 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:16.217012 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:16.217512 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:17.218592 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:17.225596 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:17.226106 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:18.227196 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:18.233178 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:18.233644 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:19.234726 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:19.240751 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:19.241269 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:20.242547 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:20.248818 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:20.249336 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:21.286342 29609 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:21:21.295337 30417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:21:21.296175 30417 raft_consensus.cc:606] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:21.305240 30417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "137a2db5be614860a25334718f9caac8"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37736
I20260709 12:21:21.305960 30417 raft_consensus.cc:606] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:21.314776 30342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:42648
I20260709 12:21:21.315265 30342 raft_consensus.cc:606] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:21.321099 30342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:42648
I20260709 12:21:21.321671 30342 raft_consensus.cc:606] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:21.327143 30342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
mode: GRACEFUL
new_leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:42648
I20260709 12:21:21.327777 30342 raft_consensus.cc:606] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Received request to transfer leadership to TS 4a8b90ebdbc34c4b9b9b34dda955f34e
I20260709 12:21:21.349483 30583 raft_consensus.cc:993] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.350131 30582 raft_consensus.cc:1081] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.351897 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37228
I20260709 12:21:21.352357 30267 raft_consensus.cc:493] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.352638 30267 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.358707 30267 raft_consensus.cc:515] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.360386 30267 leader_election.cc:290] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 4 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:21.361584 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:21.361605 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c6f1f5fa454f8ab9bb8d890df08e89" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:21.362356 30342 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.362401 30417 raft_consensus.cc:3055] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:21.362792 30417 raft_consensus.cc:740] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:21.363641 30417 consensus_queue.cc:260] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.364660 30417 raft_consensus.cc:3060] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.368270 30342 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 4.
I20260709 12:21:21.369690 30230 leader_election.cc:304] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:21.370576 30417 raft_consensus.cc:2468] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 4.
I20260709 12:21:21.370769 30554 raft_consensus.cc:2804] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:21.371868 30554 raft_consensus.cc:697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:21.372611 30554 consensus_queue.cc:237] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.380353 30161 catalog_manager.cc:5697] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 3 to 4, leader changed from 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 4 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.408157 30577 raft_consensus.cc:993] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.408747 30590 raft_consensus.cc:1081] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.410576 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37236
I20260709 12:21:21.411041 30267 raft_consensus.cc:493] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.411345 30267 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:21.415980 30267 raft_consensus.cc:515] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.417563 30267 leader_election.cc:290] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 3 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:21.418485 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:21.418553 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f7d2aceeff445fb78486496e801b3c" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:21.419063 30342 raft_consensus.cc:3055] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:21.419404 30342 raft_consensus.cc:740] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:21.419410 30417 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:21.420176 30342 consensus_queue.cc:260] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.421113 30342 raft_consensus.cc:3060] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:21.424079 30417 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 3.
I20260709 12:21:21.425318 30232 leader_election.cc:304] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
I20260709 12:21:21.425439 30342 raft_consensus.cc:2468] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 3.
I20260709 12:21:21.426064 30554 raft_consensus.cc:2804] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:21.426563 30554 raft_consensus.cc:697] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:21.427366 30554 consensus_queue.cc:237] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.434490 30161 catalog_manager.cc:5697] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 2 to 3, leader changed from 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 3 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.436641 30577 raft_consensus.cc:993] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.437134 30590 raft_consensus.cc:1081] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.438753 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37236
I20260709 12:21:21.439221 30267 raft_consensus.cc:493] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.439500 30267 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.445892 30267 raft_consensus.cc:515] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.447758 30267 leader_election.cc:290] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:21.448606 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:21.448755 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:21.449239 30342 raft_consensus.cc:3055] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:21.449290 30417 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.449513 30342 raft_consensus.cc:740] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:21.450387 30342 consensus_queue.cc:260] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.451433 30342 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.454291 30417 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 2.
I20260709 12:21:21.455437 30232 leader_election.cc:304] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
I20260709 12:21:21.455852 30342 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 2.
I20260709 12:21:21.456138 30554 raft_consensus.cc:2804] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.456624 30554 raft_consensus.cc:697] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:21.457531 30554 consensus_queue.cc:237] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.464579 30161 catalog_manager.cc:5697] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 1 to 2, leader changed from 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 2 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.596026 30583 raft_consensus.cc:993] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.596484 30582 raft_consensus.cc:1081] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.598001 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "137a2db5be614860a25334718f9caac8"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37228
I20260709 12:21:21.598572 30267 raft_consensus.cc:493] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.598959 30267 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.604732 30267 raft_consensus.cc:515] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.606465 30267 leader_election.cc:290] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 4 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:21.607268 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:21.607714 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137a2db5be614860a25334718f9caac8" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:21.607915 30342 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.608294 30417 raft_consensus.cc:3055] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:21:21.608625 30417 raft_consensus.cc:740] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:21.609452 30417 consensus_queue.cc:260] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.610792 30417 raft_consensus.cc:3060] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:21:21.615044 30342 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 4.
I20260709 12:21:21.616339 30230 leader_election.cc:304] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:21.617233 30554 raft_consensus.cc:2804] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:21:21.617628 30554 raft_consensus.cc:697] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:21.617987 30417 raft_consensus.cc:2468] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 4.
I20260709 12:21:21.618490 30554 consensus_queue.cc:237] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.625357 30161 catalog_manager.cc:5697] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 3 to 4, leader changed from 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 4 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.639839 30577 raft_consensus.cc:993] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d: : Instructing follower 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.640298 30590 raft_consensus.cc:1081] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Signalling peer 4a8b90ebdbc34c4b9b9b34dda955f34e to start an election
I20260709 12:21:21.641993 30267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
 from {username='slave'} at 127.0.0.1:37236
I20260709 12:21:21.642390 30267 raft_consensus.cc:493] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:21.642616 30267 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:21.646944 30267 raft_consensus.cc:515] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.648819 30267 leader_election.cc:290] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 3 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:21.649592 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:21.649921 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502d6953dc714a82982ab1c3057fab36" candidate_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:21.650193 30342 raft_consensus.cc:3055] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:21.650451 30417 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:21.650547 30342 raft_consensus.cc:740] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:21.651432 30342 consensus_queue.cc:260] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.652552 30342 raft_consensus.cc:3060] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:21.656872 30417 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 3.
I20260709 12:21:21.658118 30232 leader_election.cc:304] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a8b90ebdbc34c4b9b9b34dda955f34e, 5f7d02bc70464623bb8c4025ab29ddf6; no voters: 
I20260709 12:21:21.658847 30342 raft_consensus.cc:2468] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a8b90ebdbc34c4b9b9b34dda955f34e in term 3.
I20260709 12:21:21.658901 30554 raft_consensus.cc:2804] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:21.659433 30554 raft_consensus.cc:697] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 LEADER]: Becoming Leader. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:21.660290 30554 consensus_queue.cc:237] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:21.668224 30161 catalog_manager.cc:5697] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e reported cstate change: term changed from 2 to 3, leader changed from 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66) to 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65). New cstate: current_term: 3 leader_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.800787 30342 raft_consensus.cc:1275] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:21.802279 30554 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:21.816903 30417 raft_consensus.cc:1275] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:21.818895 30554 consensus_queue.cc:1048] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:21.831002 30342 raft_consensus.cc:1275] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:21.832404 30554 consensus_queue.cc:1048] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:21.843627 30417 raft_consensus.cc:1275] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:21.846261 30597 consensus_queue.cc:1048] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:21.948134 30417 raft_consensus.cc:1275] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.949537 30597 consensus_queue.cc:1048] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:21.959389 30342 raft_consensus.cc:1275] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:21.961027 30584 consensus_queue.cc:1048] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:22.078964 30417 raft_consensus.cc:1275] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:22.080391 30584 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:22.093040 30342 raft_consensus.cc:1275] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:21:22.094668 30602 consensus_queue.cc:1048] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:22.122844 30342 raft_consensus.cc:1275] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:22.124290 30602 consensus_queue.cc:1048] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:22.131426 30417 raft_consensus.cc:1275] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Refusing update from remote peer 4a8b90ebdbc34c4b9b9b34dda955f34e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:22.133253 30554 consensus_queue.cc:1048] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:24.372308 29609 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:21:24.372977 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:24.381289 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
mode: GRACEFUL
new_leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:46140
I20260709 12:21:24.381945 30267 raft_consensus.cc:606] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Received request to transfer leadership to TS 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:24.385015 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
mode: GRACEFUL
new_leader_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:46140
I20260709 12:21:24.385510 30267 raft_consensus.cc:606] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Received request to transfer leadership to TS 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:24.388166 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
mode: GRACEFUL
new_leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:46140
I20260709 12:21:24.388722 30267 raft_consensus.cc:606] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Received request to transfer leadership to TS 5f7d02bc70464623bb8c4025ab29ddf6
I20260709 12:21:24.391386 30267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "debc6092f29746b28020e981cd2737d3"
dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
mode: GRACEFUL
new_leader_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:46140
I20260709 12:21:24.391841 30267 raft_consensus.cc:606] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Received request to transfer leadership to TS 803ce617652546fab54bd1d24bb3fd2d
I20260709 12:21:24.393079 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:21:24.393563 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:24.454111 30554 raft_consensus.cc:993] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e: : Instructing follower 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:24.454663 30611 raft_consensus.cc:1081] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Signalling peer 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:24.456259 30342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "debc6092f29746b28020e981cd2737d3"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:42640
I20260709 12:21:24.456719 30342 raft_consensus.cc:493] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:24.456969 30342 raft_consensus.cc:3060] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:24.462886 30342 raft_consensus.cc:515] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.464973 30342 leader_election.cc:290] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:24.465991 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc6092f29746b28020e981cd2737d3" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:24.465996 30417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "debc6092f29746b28020e981cd2737d3" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:24.466778 30417 raft_consensus.cc:3060] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:24.466770 30267 raft_consensus.cc:3055] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:24.467268 30267 raft_consensus.cc:740] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:24.468052 30267 consensus_queue.cc:260] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.469247 30267 raft_consensus.cc:3060] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:24.473482 30417 raft_consensus.cc:2468] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:24.474896 30309 leader_election.cc:304] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:24.475746 30590 raft_consensus.cc:2804] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:24.476250 30554 raft_consensus.cc:993] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e: : Instructing follower 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:24.476112 30267 raft_consensus.cc:2468] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 2.
I20260709 12:21:24.476955 30590 raft_consensus.cc:697] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:24.477331 30554 raft_consensus.cc:1081] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Signalling peer 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:24.478055 30590 consensus_queue.cc:237] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.479897 30418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:37720
I20260709 12:21:24.480438 30418 raft_consensus.cc:493] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:24.480774 30418 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:24.486589 30163 catalog_manager.cc:5697] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 1 to 2, leader changed from 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65) to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 2 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.487267 30418 raft_consensus.cc:515] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:24.490087 30418 leader_election.cc:290] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 3 election: Requested vote from peers 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103), 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663)
I20260709 12:21:24.490731 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:24.491205 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac978b5f5d45d7a8bd1e8a69d89641" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:24.491360 30342 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:24.491798 30267 raft_consensus.cc:3055] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:24.492115 30267 raft_consensus.cc:740] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:24.492947 30267 consensus_queue.cc:260] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:24.494302 30267 raft_consensus.cc:3060] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:24.498373 30342 raft_consensus.cc:2468] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 3.
I20260709 12:21:24.499802 30382 leader_election.cc:304] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:24.500591 30582 raft_consensus.cc:2804] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:24.501235 30267 raft_consensus.cc:2468] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 3.
I20260709 12:21:24.501821 30582 raft_consensus.cc:697] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:24.502899 30582 consensus_queue.cc:237] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } }
I20260709 12:21:24.511090 30163 catalog_manager.cc:5697] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 2 to 3, leader changed from 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65) to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.543668 30611 raft_consensus.cc:993] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e: : Instructing follower 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:24.544234 30554 raft_consensus.cc:1081] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Signalling peer 5f7d02bc70464623bb8c4025ab29ddf6 to start an election
I20260709 12:21:24.545913 30418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc"
dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
 from {username='slave'} at 127.0.0.1:37720
I20260709 12:21:24.546516 30418 raft_consensus.cc:493] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:24.546881 30418 raft_consensus.cc:3060] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:24.552420 30418 raft_consensus.cc:515] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.554503 30418 leader_election.cc:290] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 2 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103)
I20260709 12:21:24.555452 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:24.555670 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18756c69a82643aebea4266b7ec4a8dc" candidate_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
I20260709 12:21:24.556157 30267 raft_consensus.cc:3055] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:24.556244 30342 raft_consensus.cc:3060] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:24.556630 30267 raft_consensus.cc:740] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:24.557406 30267 consensus_queue.cc:260] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.558777 30267 raft_consensus.cc:3060] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:24.561798 30342 raft_consensus.cc:2468] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 2.
I20260709 12:21:24.562935 30382 leader_election.cc:304] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:24.563808 30582 raft_consensus.cc:2804] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:24.564282 30582 raft_consensus.cc:697] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 LEADER]: Becoming Leader. State: Replica: 5f7d02bc70464623bb8c4025ab29ddf6, State: Running, Role: LEADER
I20260709 12:21:24.564448 30267 raft_consensus.cc:2468] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f7d02bc70464623bb8c4025ab29ddf6 in term 2.
I20260709 12:21:24.565399 30582 consensus_queue.cc:237] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.572923 30163 catalog_manager.cc:5697] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 reported cstate change: term changed from 1 to 2, leader changed from 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65) to 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:24.879328 30611 raft_consensus.cc:993] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e: : Instructing follower 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:24.879964 30554 raft_consensus.cc:1081] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Signalling peer 803ce617652546fab54bd1d24bb3fd2d to start an election
I20260709 12:21:24.881538 30342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2"
dest_uuid: "803ce617652546fab54bd1d24bb3fd2d"
 from {username='slave'} at 127.0.0.1:42640
I20260709 12:21:24.882086 30342 raft_consensus.cc:493] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:24.882341 30342 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:24.887053 30342 raft_consensus.cc:515] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.888811 30342 leader_election.cc:290] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 3 election: Requested vote from peers 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663), 5f7d02bc70464623bb8c4025ab29ddf6 (127.28.234.67:38943)
I20260709 12:21:24.889606 30267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e"
I20260709 12:21:24.889887 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89dae12c7700483bb4c07964cbb811b2" candidate_uuid: "803ce617652546fab54bd1d24bb3fd2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f7d02bc70464623bb8c4025ab29ddf6"
I20260709 12:21:24.890266 30267 raft_consensus.cc:3055] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:24.890648 30418 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:24.890691 30267 raft_consensus.cc:740] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4a8b90ebdbc34c4b9b9b34dda955f34e, State: Running, Role: LEADER
I20260709 12:21:24.891791 30267 consensus_queue.cc:260] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.892711 30267 raft_consensus.cc:3060] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:24.896085 30418 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 3.
I20260709 12:21:24.897192 30267 raft_consensus.cc:2468] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 803ce617652546fab54bd1d24bb3fd2d in term 3.
I20260709 12:21:24.897239 30309 leader_election.cc:304] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f7d02bc70464623bb8c4025ab29ddf6, 803ce617652546fab54bd1d24bb3fd2d; no voters: 
I20260709 12:21:24.898129 30590 raft_consensus.cc:2804] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:24.898690 30590 raft_consensus.cc:697] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 3 LEADER]: Becoming Leader. State: Replica: 803ce617652546fab54bd1d24bb3fd2d, State: Running, Role: LEADER
I20260709 12:21:24.899457 30590 consensus_queue.cc:237] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } }
I20260709 12:21:24.906890 30163 catalog_manager.cc:5697] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d reported cstate change: term changed from 2 to 3, leader changed from 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65) to 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66). New cstate: current_term: 3 leader_uuid: "803ce617652546fab54bd1d24bb3fd2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:24.980544 30267 raft_consensus.cc:1275] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:24.982630 30590 consensus_queue.cc:1048] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:25.003984 30418 raft_consensus.cc:1275] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:25.007604 30342 raft_consensus.cc:1275] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:25.009454 30625 consensus_queue.cc:1048] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:25.011933 30582 consensus_queue.cc:1048] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:25.030150 30267 raft_consensus.cc:1275] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:25.033345 30582 consensus_queue.cc:1048] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:25.036505 30342 raft_consensus.cc:1275] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:25.038300 30630 consensus_queue.cc:1048] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "803ce617652546fab54bd1d24bb3fd2d" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 37103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:25.055325 30267 raft_consensus.cc:1275] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Refusing update from remote peer 5f7d02bc70464623bb8c4025ab29ddf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:25.058104 30582 consensus_queue.cc:1048] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:25.394797 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:25.401324 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:25.401937 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:25.496284 30418 raft_consensus.cc:1275] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:25.497678 30625 consensus_queue.cc:1048] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f7d02bc70464623bb8c4025ab29ddf6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:25.508911 30267 raft_consensus.cc:1275] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Refusing update from remote peer 803ce617652546fab54bd1d24bb3fd2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:25.510385 30590 consensus_queue.cc:1048] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a8b90ebdbc34c4b9b9b34dda955f34e" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:26.403164 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.411091 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:26.411580 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:27.412684 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:27.418799 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:27.419314 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:28.420356 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:28.427143 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:28.427614 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:29.428594 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:29.434103 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:29.434621 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:30.435796 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:30.441890 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:30.442399 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:31.443415 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:31.449070 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:31.449544 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:32.450719 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:32.456635 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:32.457209 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:33.458403 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:33.465829 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:33.466322 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:34.501960 29609 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:21:34.502600 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
I20260709 12:21:34.532208 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:34.533208 29609 tablet_replica.cc:333] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.533946 29609 raft_consensus.cc:2243] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.534746 29609 raft_consensus.cc:2272] T a3f7d2aceeff445fb78486496e801b3c P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.536790 29609 tablet_replica.cc:333] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.537366 29609 raft_consensus.cc:2243] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.538259 29609 raft_consensus.cc:2272] T 502d6953dc714a82982ab1c3057fab36 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.540120 29609 tablet_replica.cc:333] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.540618 29609 raft_consensus.cc:2243] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.540997 29609 raft_consensus.cc:2272] T 18756c69a82643aebea4266b7ec4a8dc P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.542852 29609 tablet_replica.cc:333] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.543295 29609 raft_consensus.cc:2243] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.543995 29609 raft_consensus.cc:2272] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.545665 29609 tablet_replica.cc:333] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.546191 29609 raft_consensus.cc:2243] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.546545 29609 raft_consensus.cc:2272] T 89dae12c7700483bb4c07964cbb811b2 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.548226 29609 tablet_replica.cc:333] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.548729 29609 raft_consensus.cc:2243] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.549173 29609 raft_consensus.cc:2272] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.550993 29609 tablet_replica.cc:333] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.551499 29609 raft_consensus.cc:2243] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.551934 29609 raft_consensus.cc:2272] T 72d9e1c2fc6840b480154fb8112bd941 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.553685 29609 tablet_replica.cc:333] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.554250 29609 raft_consensus.cc:2243] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.554688 29609 raft_consensus.cc:2272] T debc6092f29746b28020e981cd2737d3 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.556367 29609 tablet_replica.cc:333] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.556834 29609 raft_consensus.cc:2243] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.557600 29609 raft_consensus.cc:2272] T 137a2db5be614860a25334718f9caac8 P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.559418 29609 tablet_replica.cc:333] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e: stopping tablet replica
I20260709 12:21:34.559880 29609 raft_consensus.cc:2243] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.560289 29609 raft_consensus.cc:2272] T 7e43053a49b84739a63891147ff8837a P 4a8b90ebdbc34c4b9b9b34dda955f34e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:34.582641 30307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:38663: connect: Connection refused (error 111) [suppressed 4 similar messages]
W20260709 12:21:34.586339 30307 consensus_peers.cc:597] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d -> Peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Couldn't send request to peer 4a8b90ebdbc34c4b9b9b34dda955f34e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:38663: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.593219 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
I20260709 12:21:34.616643 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
I20260709 12:21:34.643698 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:34.644441 29609 tablet_replica.cc:333] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.645365 29609 raft_consensus.cc:2243] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.646082 29609 raft_consensus.cc:2272] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.647832 29609 tablet_replica.cc:333] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.648339 29609 raft_consensus.cc:2243] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.648715 29609 raft_consensus.cc:2272] T 18756c69a82643aebea4266b7ec4a8dc P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.650372 29609 tablet_replica.cc:333] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.650848 29609 raft_consensus.cc:2243] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.651351 29609 raft_consensus.cc:2272] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.653337 29609 tablet_replica.cc:333] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.653926 29609 raft_consensus.cc:2243] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.654696 29609 raft_consensus.cc:2272] T 89dae12c7700483bb4c07964cbb811b2 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:34.656661 30382 consensus_peers.cc:597] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 -> Peer 803ce617652546fab54bd1d24bb3fd2d (127.28.234.66:37103): Couldn't send request to peer 803ce617652546fab54bd1d24bb3fd2d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.656957 29609 tablet_replica.cc:333] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.657593 29609 raft_consensus.cc:2243] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.658164 29609 raft_consensus.cc:2272] T 502d6953dc714a82982ab1c3057fab36 P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:34.660085 30307 consensus_peers.cc:597] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d -> Peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Couldn't send request to peer 4a8b90ebdbc34c4b9b9b34dda955f34e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:38663: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.660185 29609 tablet_replica.cc:333] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.660733 29609 raft_consensus.cc:2243] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.661473 29609 raft_consensus.cc:2272] T debc6092f29746b28020e981cd2737d3 P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.663293 29609 tablet_replica.cc:333] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.663817 29609 raft_consensus.cc:2243] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.664252 29609 raft_consensus.cc:2272] T 72d9e1c2fc6840b480154fb8112bd941 P 803ce617652546fab54bd1d24bb3fd2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.666188 29609 tablet_replica.cc:333] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.666669 29609 raft_consensus.cc:2243] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.667111 29609 raft_consensus.cc:2272] T 137a2db5be614860a25334718f9caac8 P 803ce617652546fab54bd1d24bb3fd2d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.669005 29609 tablet_replica.cc:333] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.669497 29609 raft_consensus.cc:2243] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.670328 29609 raft_consensus.cc:2272] T 7e43053a49b84739a63891147ff8837a P 803ce617652546fab54bd1d24bb3fd2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.672046 29609 tablet_replica.cc:333] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d: stopping tablet replica
I20260709 12:21:34.672506 29609 raft_consensus.cc:2243] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.672916 29609 raft_consensus.cc:2272] T a3f7d2aceeff445fb78486496e801b3c P 803ce617652546fab54bd1d24bb3fd2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.703341 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
W20260709 12:21:34.723670 30382 consensus_peers.cc:597] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 -> Peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Couldn't send request to peer 4a8b90ebdbc34c4b9b9b34dda955f34e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:38663: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:34.729701 30382 consensus_peers.cc:597] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 -> Peer 4a8b90ebdbc34c4b9b9b34dda955f34e (127.28.234.65:38663): Couldn't send request to peer 4a8b90ebdbc34c4b9b9b34dda955f34e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:38663: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:34.731418 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
I20260709 12:21:34.758358 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:34.759188 29609 tablet_replica.cc:333] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.759946 29609 raft_consensus.cc:2243] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.760937 29609 raft_consensus.cc:2272] T 9eac978b5f5d45d7a8bd1e8a69d89641 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.763382 29609 tablet_replica.cc:333] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.764209 29609 raft_consensus.cc:2243] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.764868 29609 raft_consensus.cc:2272] T 502d6953dc714a82982ab1c3057fab36 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.766757 29609 tablet_replica.cc:333] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.767294 29609 raft_consensus.cc:2243] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.767742 29609 raft_consensus.cc:2272] T a3f7d2aceeff445fb78486496e801b3c P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.769975 29609 tablet_replica.cc:333] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.770516 29609 raft_consensus.cc:2243] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.771015 29609 raft_consensus.cc:2272] T c2c6f1f5fa454f8ab9bb8d890df08e89 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.772760 29609 tablet_replica.cc:333] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.773296 29609 raft_consensus.cc:2243] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.773823 29609 raft_consensus.cc:2272] T 89dae12c7700483bb4c07964cbb811b2 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.775455 29609 tablet_replica.cc:333] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.775954 29609 raft_consensus.cc:2243] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.776369 29609 raft_consensus.cc:2272] T 7e43053a49b84739a63891147ff8837a P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.778147 29609 tablet_replica.cc:333] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.778630 29609 raft_consensus.cc:2243] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.779415 29609 raft_consensus.cc:2272] T 72d9e1c2fc6840b480154fb8112bd941 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.781145 29609 tablet_replica.cc:333] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.781638 29609 raft_consensus.cc:2243] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.782104 29609 raft_consensus.cc:2272] T debc6092f29746b28020e981cd2737d3 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.783681 29609 tablet_replica.cc:333] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.784155 29609 raft_consensus.cc:2243] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:34.784569 29609 raft_consensus.cc:2272] T 137a2db5be614860a25334718f9caac8 P 5f7d02bc70464623bb8c4025ab29ddf6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.786541 29609 tablet_replica.cc:333] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6: stopping tablet replica
I20260709 12:21:34.787056 29609 raft_consensus.cc:2243] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.788004 29609 raft_consensus.cc:2272] T 18756c69a82643aebea4266b7ec4a8dc P 5f7d02bc70464623bb8c4025ab29ddf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.819818 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
I20260709 12:21:34.840430 29609 master.cc:562] Master@127.28.234.126:41625 shutting down...
I20260709 12:21:34.862150 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:34.862752 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:34.863106 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P 795cffcd3ad247d19c39b31da744a6bc: stopping tablet replica
I20260709 12:21:34.883210 29609 master.cc:584] Master@127.28.234.126:41625 shutdown complete.
4a8b90ebdbc34c4b9b9b34dda955f34e  5
5f7d02bc70464623bb8c4025ab29ddf6  1
803ce617652546fab54bd1d24bb3fd2d  4
4a8b90ebdbc34c4b9b9b34dda955f34e  3
5f7d02bc70464623bb8c4025ab29ddf6  3
803ce617652546fab54bd1d24bb3fd2d  4
4a8b90ebdbc34c4b9b9b34dda955f34e  8
5f7d02bc70464623bb8c4025ab29ddf6  1
803ce617652546fab54bd1d24bb3fd2d  1
4a8b90ebdbc34c4b9b9b34dda955f34e  4
5f7d02bc70464623bb8c4025ab29ddf6  3
803ce617652546fab54bd1d24bb3fd2d  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28652 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:21:34.926854 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:42357
I20260709 12:21:34.928066 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:34.934531 30656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.934634 30657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:34.935148 30659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:34.935491 29609 server_base.cc:1061] running on GCE node
I20260709 12:21:34.936499 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:34.936678 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:34.936794 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599694936783 us; error 0 us; skew 500 ppm
I20260709 12:21:34.937256 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:34.939620 29609 webserver.cc:533] Webserver started at http://127.28.234.126:38535/ using document root <none> and password file <none>
I20260709 12:21:34.940065 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:34.940222 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:34.940491 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:34.942004 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "ed644613a0604f0ca9abeda3653f0a2f"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-8c39"
I20260709 12:21:34.946941 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:21:34.950865 30664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:34.951682 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:21:34.952044 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "ed644613a0604f0ca9abeda3653f0a2f"
format_stamp: "Formatted at 2026-07-09 12:21:34 on dist-test-slave-8c39"
I20260709 12:21:34.952391 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:34.968146 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:34.969676 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:35.024724 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:42357
I20260709 12:21:35.024799 30716 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:42357 every 8 connection(s)
I20260709 12:21:35.030036 30717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.040650 30717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Bootstrap starting.
I20260709 12:21:35.045885 30717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.050647 30717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: No bootstrap required, opened a new log
I20260709 12:21:35.053030 30717 raft_consensus.cc:359] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed644613a0604f0ca9abeda3653f0a2f" member_type: VOTER }
I20260709 12:21:35.053563 30717 raft_consensus.cc:385] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.053966 30717 raft_consensus.cc:740] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed644613a0604f0ca9abeda3653f0a2f, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.054774 30717 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed644613a0604f0ca9abeda3653f0a2f" member_type: VOTER }
I20260709 12:21:35.055267 30717 raft_consensus.cc:399] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:35.055508 30717 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:35.055868 30717 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:35.060775 30717 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed644613a0604f0ca9abeda3653f0a2f" member_type: VOTER }
I20260709 12:21:35.061398 30717 leader_election.cc:304] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ed644613a0604f0ca9abeda3653f0a2f; no voters: 
I20260709 12:21:35.062721 30717 leader_election.cc:290] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:35.063180 30720 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:35.064600 30720 raft_consensus.cc:697] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 1 LEADER]: Becoming Leader. State: Replica: ed644613a0604f0ca9abeda3653f0a2f, State: Running, Role: LEADER
I20260709 12:21:35.065300 30720 consensus_queue.cc:237] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed644613a0604f0ca9abeda3653f0a2f" member_type: VOTER }
I20260709 12:21:35.065938 30717 sys_catalog.cc:565] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:35.069006 30722 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ed644613a0604f0ca9abeda3653f0a2f. Latest consensus state: current_term: 1 leader_uuid: "ed644613a0604f0ca9abeda3653f0a2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed644613a0604f0ca9abeda3653f0a2f" member_type: VOTER } }
I20260709 12:21:35.069152 30721 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ed644613a0604f0ca9abeda3653f0a2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ed644613a0604f0ca9abeda3653f0a2f" member_type: VOTER } }
I20260709 12:21:35.069718 30722 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:35.069986 30721 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:35.074198 30726 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:35.082286 30726 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:35.083328 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:35.092451 30726 catalog_manager.cc:1383] Generated new cluster ID: 26d2836c7a874aa2962fcc0ebda45729
I20260709 12:21:35.092787 30726 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:35.118985 30726 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:35.120452 30726 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:35.132764 30726 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Generated new TSK 0
I20260709 12:21:35.133379 30726 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:35.150189 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:35.157684 30738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:35.158244 30739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:35.160477 30741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:35.160887 29609 server_base.cc:1061] running on GCE node
I20260709 12:21:35.161967 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:35.162215 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:35.162442 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599695162407 us; error 0 us; skew 500 ppm
I20260709 12:21:35.163038 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:35.165709 29609 webserver.cc:533] Webserver started at http://127.28.234.65:44187/ using document root <none> and password file <none>
I20260709 12:21:35.166333 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:35.166543 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:35.166878 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:35.168221 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
format_stamp: "Formatted at 2026-07-09 12:21:35 on dist-test-slave-8c39"
I20260709 12:21:35.173259 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:21:35.177047 30746 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.177862 29609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:35.178175 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
format_stamp: "Formatted at 2026-07-09 12:21:35 on dist-test-slave-8c39"
I20260709 12:21:35.178467 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:35.194908 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:35.196365 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:35.198004 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:35.200524 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:35.200778 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.201043 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:35.201231 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.244577 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:46329
I20260709 12:21:35.244695 30809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:46329 every 8 connection(s)
I20260709 12:21:35.249783 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:35.257503 30814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:35.258509 30815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:35.262590 29609 server_base.cc:1061] running on GCE node
W20260709 12:21:35.263119 30817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:35.264287 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:35.264488 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:35.264690 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599695264674 us; error 0 us; skew 500 ppm
I20260709 12:21:35.265264 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:35.268088 29609 webserver.cc:533] Webserver started at http://127.28.234.66:33693/ using document root <none> and password file <none>
I20260709 12:21:35.268740 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:35.268991 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:35.269364 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:35.269949 30810 heartbeater.cc:344] Connected to a master server at 127.28.234.126:42357
I20260709 12:21:35.270398 30810 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:35.271067 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "764ebfd36ce64b2a86e6d290ae92e276"
format_stamp: "Formatted at 2026-07-09 12:21:35 on dist-test-slave-8c39"
I20260709 12:21:35.271287 30810 heartbeater.cc:507] Master 127.28.234.126:42357 requested a full tablet report, sending...
I20260709 12:21:35.274011 30682 ts_manager.cc:194] Registered new tserver with Master: 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:35.276161 30682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48034
I20260709 12:21:35.276621 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:21:35.280938 30822 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.281898 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:35.282191 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "764ebfd36ce64b2a86e6d290ae92e276"
format_stamp: "Formatted at 2026-07-09 12:21:35 on dist-test-slave-8c39"
I20260709 12:21:35.282444 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:35.303692 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:35.304885 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:35.306500 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:35.308869 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:35.309055 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.309357 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:35.309522 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.351958 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:33903
I20260709 12:21:35.352209 30884 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:33903 every 8 connection(s)
I20260709 12:21:35.357028 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:35.364924 30888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:35.366578 30889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:35.368485 30891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:35.370869 30885 heartbeater.cc:344] Connected to a master server at 127.28.234.126:42357
I20260709 12:21:35.371353 30885 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:35.372179 30885 heartbeater.cc:507] Master 127.28.234.126:42357 requested a full tablet report, sending...
I20260709 12:21:35.372488 29609 server_base.cc:1061] running on GCE node
I20260709 12:21:35.373521 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:35.373759 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:35.374022 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599695373990 us; error 0 us; skew 500 ppm
I20260709 12:21:35.374467 30682 ts_manager.cc:194] Registered new tserver with Master: 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:35.374614 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:35.376142 30682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48042
I20260709 12:21:35.378096 29609 webserver.cc:533] Webserver started at http://127.28.234.67:39845/ using document root <none> and password file <none>
I20260709 12:21:35.378726 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:35.378957 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:35.379240 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:35.380582 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "47c0d0bc235a443aad3c62643e91b081"
format_stamp: "Formatted at 2026-07-09 12:21:35 on dist-test-slave-8c39"
I20260709 12:21:35.385314 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:21:35.389019 30896 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.389925 29609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:35.390265 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "47c0d0bc235a443aad3c62643e91b081"
format_stamp: "Formatted at 2026-07-09 12:21:35 on dist-test-slave-8c39"
I20260709 12:21:35.390674 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:35.408746 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:35.410091 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:35.411556 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:35.414021 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:35.414217 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.414521 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:35.414680 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:35.458315 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:38729
I20260709 12:21:35.458408 30959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:38729 every 8 connection(s)
I20260709 12:21:35.473469 30960 heartbeater.cc:344] Connected to a master server at 127.28.234.126:42357
I20260709 12:21:35.473932 30960 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:35.474711 30960 heartbeater.cc:507] Master 127.28.234.126:42357 requested a full tablet report, sending...
I20260709 12:21:35.476724 30682 ts_manager.cc:194] Registered new tserver with Master: 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:35.477461 29609 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01577187s
I20260709 12:21:35.478134 30682 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48052
I20260709 12:21:35.505656 30682 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48058:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:35.512035 30682 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:35.724438 30774 tablet_service.cc:1511] Processing CreateTablet for tablet be932375e2fb44fa82101764b7f51427 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:35.726449 30925 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4b6cc51cc8447b9a8b62bee637d000 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:35.726958 30773 tablet_service.cc:1511] Processing CreateTablet for tablet c98f068de024412f94b2929c4ee5d313 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:35.728011 30925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4b6cc51cc8447b9a8b62bee637d000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.728415 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98f068de024412f94b2929c4ee5d313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.731036 30772 tablet_service.cc:1511] Processing CreateTablet for tablet edd831e647294525a980327a839a575d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:35.732522 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd831e647294525a980327a839a575d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.733042 30770 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0380987e96472c9097a4c4df135a2c (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:35.734817 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0380987e96472c9097a4c4df135a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.739178 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 21608c221fae4caf8e15b6588f457432 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:35.740717 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21608c221fae4caf8e15b6588f457432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.742996 30775 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4b6cc51cc8447b9a8b62bee637d000 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:35.743592 30924 tablet_service.cc:1511] Processing CreateTablet for tablet be932375e2fb44fa82101764b7f51427 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:35.744442 30775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4b6cc51cc8447b9a8b62bee637d000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.745000 30924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be932375e2fb44fa82101764b7f51427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.750100 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be932375e2fb44fa82101764b7f51427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.755148 30769 tablet_service.cc:1511] Processing CreateTablet for tablet 51aa6529d4b94351878a667ab81a26a8 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:35.755609 30768 tablet_service.cc:1511] Processing CreateTablet for tablet f58ba86a26f747dba6c34dc628302aaf (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:35.756834 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aa6529d4b94351878a667ab81a26a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.756318 30923 tablet_service.cc:1511] Processing CreateTablet for tablet c98f068de024412f94b2929c4ee5d313 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:35.757994 30923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98f068de024412f94b2929c4ee5d313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.758512 30767 tablet_service.cc:1511] Processing CreateTablet for tablet d1b446a35b93488395d93db5de7d9d0b (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:35.759935 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b446a35b93488395d93db5de7d9d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.763516 30766 tablet_service.cc:1511] Processing CreateTablet for tablet e2f2d1a1b8c441c8958b81ea7473c359 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:35.765048 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f2d1a1b8c441c8958b81ea7473c359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.765529 30975 tablet_bootstrap.cc:492] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:35.767676 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58ba86a26f747dba6c34dc628302aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.769135 30772 tablet_service.cc:1511] Processing CreateTablet for tablet 576cba7acdde4bbda553612d2ad1076d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:35.770571 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576cba7acdde4bbda553612d2ad1076d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.770803 30922 tablet_service.cc:1511] Processing CreateTablet for tablet edd831e647294525a980327a839a575d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:35.772102 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd831e647294525a980327a839a575d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.777915 30975 tablet_bootstrap.cc:654] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.781966 30921 tablet_service.cc:1511] Processing CreateTablet for tablet 21608c221fae4caf8e15b6588f457432 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:35.784201 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21608c221fae4caf8e15b6588f457432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.790539 30769 tablet_service.cc:1511] Processing CreateTablet for tablet d1bb0331e5b641b99a413ba3e4475499 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:35.791188 30920 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0380987e96472c9097a4c4df135a2c (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:35.792758 30920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0380987e96472c9097a4c4df135a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.795109 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 51aa6529d4b94351878a667ab81a26a8 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:35.797480 30918 tablet_service.cc:1511] Processing CreateTablet for tablet f58ba86a26f747dba6c34dc628302aaf (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:35.802162 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58ba86a26f747dba6c34dc628302aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.803658 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aa6529d4b94351878a667ab81a26a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.804461 30917 tablet_service.cc:1511] Processing CreateTablet for tablet d1b446a35b93488395d93db5de7d9d0b (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:35.805919 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b446a35b93488395d93db5de7d9d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.812628 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bb0331e5b641b99a413ba3e4475499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.814602 30772 tablet_service.cc:1511] Processing CreateTablet for tablet 99ea8dcf093e47afa22421b9be4659ef (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:35.816035 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ea8dcf093e47afa22421b9be4659ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.819831 30975 tablet_bootstrap.cc:492] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:35.820372 30975 ts_tablet_manager.cc:1403] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.055s	user 0.006s	sys 0.005s
I20260709 12:21:35.823493 30975 raft_consensus.cc:359] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:35.824251 30975 raft_consensus.cc:385] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.824563 30975 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.836261 30916 tablet_service.cc:1511] Processing CreateTablet for tablet e2f2d1a1b8c441c8958b81ea7473c359 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:35.837795 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f2d1a1b8c441c8958b81ea7473c359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.838073 30975 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:35.850899 30772 tablet_service.cc:1511] Processing CreateTablet for tablet d1459f4eb71440ae996b2745034179c9 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:35.851467 30770 tablet_service.cc:1511] Processing CreateTablet for tablet c518d33b8e184a1089ca6c043d90c270 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:35.852290 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1459f4eb71440ae996b2745034179c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.853389 30774 tablet_service.cc:1511] Processing CreateTablet for tablet de79bb6a5d7d4dea85d1e4029984c0d3 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:35.854907 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de79bb6a5d7d4dea85d1e4029984c0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.843969 30766 tablet_service.cc:1511] Processing CreateTablet for tablet e3496a4982a343f782fa2b4adc27d108 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:35.858883 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3496a4982a343f782fa2b4adc27d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.860731 30770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c518d33b8e184a1089ca6c043d90c270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.864387 30810 heartbeater.cc:499] Master 127.28.234.126:42357 was elected leader, sending a full tablet report...
I20260709 12:21:35.864939 30975 ts_tablet_manager.cc:1434] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.001s
I20260709 12:21:35.871130 30975 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:35.872514 30767 tablet_service.cc:1511] Processing CreateTablet for tablet d15199b73310443a816e4f4916c77ebb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:35.873980 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15199b73310443a816e4f4916c77ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.877919 30975 tablet_bootstrap.cc:654] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:35.879835 30771 tablet_service.cc:1511] Processing CreateTablet for tablet ea1fc0f15e994691a2edf5f0c3b096eb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:35.881227 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1fc0f15e994691a2edf5f0c3b096eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.882721 30918 tablet_service.cc:1511] Processing CreateTablet for tablet d1bb0331e5b641b99a413ba3e4475499 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:35.884097 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bb0331e5b641b99a413ba3e4475499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.899767 30923 tablet_service.cc:1511] Processing CreateTablet for tablet 576cba7acdde4bbda553612d2ad1076d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:35.885576 30773 tablet_service.cc:1511] Processing CreateTablet for tablet 464359e0b4944cf9868ca1cb6bd2546a (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:35.916769 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464359e0b4944cf9868ca1cb6bd2546a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.899767 30924 tablet_service.cc:1511] Processing CreateTablet for tablet 99ea8dcf093e47afa22421b9be4659ef (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:35.872514 30768 tablet_service.cc:1511] Processing CreateTablet for tablet b23b41846a694f24a76e3aa05d9e54b2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:35.923924 30850 tablet_service.cc:1511] Processing CreateTablet for tablet 4e4b6cc51cc8447b9a8b62bee637d000 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:21:35.925282 30850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e4b6cc51cc8447b9a8b62bee637d000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.927414 30769 tablet_service.cc:1511] Processing CreateTablet for tablet ec82b6c4e54048a8a16a319c0cb38d23 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:35.911752 30775 tablet_service.cc:1511] Processing CreateTablet for tablet d3635826198a49c885a3b5c762743eb3 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:35.932281 30922 tablet_service.cc:1511] Processing CreateTablet for tablet e3496a4982a343f782fa2b4adc27d108 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:35.936806 30849 tablet_service.cc:1511] Processing CreateTablet for tablet be932375e2fb44fa82101764b7f51427 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:21:35.938303 30849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be932375e2fb44fa82101764b7f51427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.943389 30774 tablet_service.cc:1511] Processing CreateTablet for tablet ae2135797f024066b30a0fb14e174518 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:35.947589 30848 tablet_service.cc:1511] Processing CreateTablet for tablet c98f068de024412f94b2929c4ee5d313 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:21:35.949064 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98f068de024412f94b2929c4ee5d313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.957674 30975 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:35.958606 30975 ts_tablet_manager.cc:1403] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.065s
I20260709 12:21:35.962256 30975 raft_consensus.cc:359] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:35.963315 30975 raft_consensus.cc:385] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:35.963651 30975 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:35.964257 30847 tablet_service.cc:1511] Processing CreateTablet for tablet edd831e647294525a980327a839a575d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:21:35.965775 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3496a4982a343f782fa2b4adc27d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.967535 30920 tablet_service.cc:1511] Processing CreateTablet for tablet c518d33b8e184a1089ca6c043d90c270 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:35.965955 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd831e647294525a980327a839a575d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.968964 30920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c518d33b8e184a1089ca6c043d90c270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.971349 30919 tablet_service.cc:1511] Processing CreateTablet for tablet de79bb6a5d7d4dea85d1e4029984c0d3 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:35.972797 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de79bb6a5d7d4dea85d1e4029984c0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.973021 30979 tablet_bootstrap.cc:492] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:35.978188 30924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ea8dcf093e47afa22421b9be4659ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.978767 30975 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:35.980259 30921 tablet_service.cc:1511] Processing CreateTablet for tablet d15199b73310443a816e4f4916c77ebb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:35.978799 30925 tablet_service.cc:1511] Processing CreateTablet for tablet d1459f4eb71440ae996b2745034179c9 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:35.986104 30975 ts_tablet_manager.cc:1434] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 12:21:35.987213 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15199b73310443a816e4f4916c77ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.987340 30975 tablet_bootstrap.cc:492] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:35.990700 30925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1459f4eb71440ae996b2745034179c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:35.994500 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 047196043bb744a6b94cb3b634b80771 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:35.999910 30979 tablet_bootstrap.cc:654] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.000710 30923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576cba7acdde4bbda553612d2ad1076d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.012879 30846 tablet_service.cc:1511] Processing CreateTablet for tablet 21608c221fae4caf8e15b6588f457432 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:21:36.014587 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21608c221fae4caf8e15b6588f457432. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.019971 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 5a0380987e96472c9097a4c4df135a2c (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:21:36.021569 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a0380987e96472c9097a4c4df135a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.031630 30979 tablet_bootstrap.cc:492] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:36.033308 30979 ts_tablet_manager.cc:1403] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.009s
I20260709 12:21:35.924309 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b23b41846a694f24a76e3aa05d9e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.042436 30775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3635826198a49c885a3b5c762743eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.043650 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2135797f024066b30a0fb14e174518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.045166 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047196043bb744a6b94cb3b634b80771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.045625 30842 tablet_service.cc:1511] Processing CreateTablet for tablet d1b446a35b93488395d93db5de7d9d0b (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:21:36.047204 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b446a35b93488395d93db5de7d9d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.050549 30841 tablet_service.cc:1511] Processing CreateTablet for tablet e2f2d1a1b8c441c8958b81ea7473c359 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:21:36.050760 30917 tablet_service.cc:1511] Processing CreateTablet for tablet ea1fc0f15e994691a2edf5f0c3b096eb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:36.052178 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2f2d1a1b8c441c8958b81ea7473c359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.054112 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82b6c4e54048a8a16a319c0cb38d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.042135 30844 tablet_service.cc:1511] Processing CreateTablet for tablet 51aa6529d4b94351878a667ab81a26a8 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:21:36.043537 30843 tablet_service.cc:1511] Processing CreateTablet for tablet f58ba86a26f747dba6c34dc628302aaf (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:21:36.056202 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aa6529d4b94351878a667ab81a26a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.057235 30975 tablet_bootstrap.cc:654] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.055225 30979 raft_consensus.cc:359] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:36.060739 30979 raft_consensus.cc:385] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.061079 30979 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.061305 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58ba86a26f747dba6c34dc628302aaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.061916 30979 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:36.052174 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1fc0f15e994691a2edf5f0c3b096eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:36.078478 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:36.079527 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 464359e0b4944cf9868ca1cb6bd2546a (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:36.080957 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464359e0b4944cf9868ca1cb6bd2546a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.084878 30919 tablet_service.cc:1511] Processing CreateTablet for tablet d3635826198a49c885a3b5c762743eb3 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:36.086397 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3635826198a49c885a3b5c762743eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.088179 30771 tablet_service.cc:1511] Processing CreateTablet for tablet abd414d2ac774e99a1548b0ff34a4f37 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:36.089514 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd414d2ac774e99a1548b0ff34a4f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.099529 30920 tablet_service.cc:1511] Processing CreateTablet for tablet 047196043bb744a6b94cb3b634b80771 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:36.100950 30920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047196043bb744a6b94cb3b634b80771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.103892 30925 tablet_service.cc:1511] Processing CreateTablet for tablet ec82b6c4e54048a8a16a319c0cb38d23 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:36.105247 30925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82b6c4e54048a8a16a319c0cb38d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.107573 30918 tablet_service.cc:1511] Processing CreateTablet for tablet ae2135797f024066b30a0fb14e174518 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:36.109043 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2135797f024066b30a0fb14e174518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.041682 30922 tablet_service.cc:1511] Processing CreateTablet for tablet b23b41846a694f24a76e3aa05d9e54b2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:36.113106 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b23b41846a694f24a76e3aa05d9e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.148880 30975 tablet_bootstrap.cc:492] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:36.149432 30975 ts_tablet_manager.cc:1403] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.162s	user 0.022s	sys 0.010s
I20260709 12:21:36.158735 30841 tablet_service.cc:1511] Processing CreateTablet for tablet 576cba7acdde4bbda553612d2ad1076d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:21:36.159687 30923 tablet_service.cc:1511] Processing CreateTablet for tablet abd414d2ac774e99a1548b0ff34a4f37 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:36.160481 30843 tablet_service.cc:1511] Processing CreateTablet for tablet d1bb0331e5b641b99a413ba3e4475499 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:21:36.160662 30975 raft_consensus.cc:359] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.160123 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 576cba7acdde4bbda553612d2ad1076d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.161463 30975 raft_consensus.cc:385] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.161811 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 99ea8dcf093e47afa22421b9be4659ef (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:21:36.163816 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ea8dcf093e47afa22421b9be4659ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.164448 30846 tablet_service.cc:1511] Processing CreateTablet for tablet e3496a4982a343f782fa2b4adc27d108 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:21:36.161160 30923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd414d2ac774e99a1548b0ff34a4f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.174785 30960 heartbeater.cc:499] Master 127.28.234.126:42357 was elected leader, sending a full tablet report...
I20260709 12:21:36.181488 30979 ts_tablet_manager.cc:1434] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.147s	user 0.015s	sys 0.006s
I20260709 12:21:36.165702 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3496a4982a343f782fa2b4adc27d108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.171468 30975 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.184947 30979 tablet_bootstrap.cc:492] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:36.189857 30769 tablet_service.cc:1511] Processing CreateTablet for tablet 145501f8904547999755a27a5d421157 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:36.191279 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145501f8904547999755a27a5d421157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.193307 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 68688b51d09c48d6b63fec7f6e414d95 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:36.194712 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68688b51d09c48d6b63fec7f6e414d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.196954 30979 tablet_bootstrap.cc:654] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.197561 30975 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.171756 30845 tablet_service.cc:1511] Processing CreateTablet for tablet ea1fc0f15e994691a2edf5f0c3b096eb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:21:36.199656 30983 tablet_bootstrap.cc:492] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:36.200035 30775 tablet_service.cc:1511] Processing CreateTablet for tablet e6c0595eb2284ea9b8da2832d8558f7e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:36.201390 30775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c0595eb2284ea9b8da2832d8558f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.202452 30922 tablet_service.cc:1511] Processing CreateTablet for tablet 145501f8904547999755a27a5d421157 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:36.202913 30919 tablet_service.cc:1511] Processing CreateTablet for tablet e6c0595eb2284ea9b8da2832d8558f7e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:36.203774 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145501f8904547999755a27a5d421157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.204579 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c0595eb2284ea9b8da2832d8558f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.206120 30975 ts_tablet_manager.cc:1434] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:21:36.207211 30975 tablet_bootstrap.cc:492] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:36.211782 30844 tablet_service.cc:1511] Processing CreateTablet for tablet d1459f4eb71440ae996b2745034179c9 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:21:36.216738 30849 tablet_service.cc:1511] Processing CreateTablet for tablet de79bb6a5d7d4dea85d1e4029984c0d3 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:21:36.218833 30842 tablet_service.cc:1511] Processing CreateTablet for tablet c518d33b8e184a1089ca6c043d90c270 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:21:36.217132 30850 tablet_service.cc:1511] Processing CreateTablet for tablet d15199b73310443a816e4f4916c77ebb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:21:36.228420 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bb0331e5b641b99a413ba3e4475499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.229368 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c518d33b8e184a1089ca6c043d90c270. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.232897 30850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d15199b73310443a816e4f4916c77ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.248062 30768 tablet_service.cc:1511] Processing CreateTablet for tablet 64f8ac94405742eb87e6d195387d7c6f (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:36.248901 30979 tablet_bootstrap.cc:492] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:36.239414 30977 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.249630 30979 ts_tablet_manager.cc:1403] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.003s
I20260709 12:21:36.249889 30977 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.250222 30917 tablet_service.cc:1511] Processing CreateTablet for tablet 68688b51d09c48d6b63fec7f6e414d95 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:36.251489 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68688b51d09c48d6b63fec7f6e414d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.251772 30768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ac94405742eb87e6d195387d7c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.252609 30977 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:36.232548 30848 tablet_service.cc:1511] Processing CreateTablet for tablet b23b41846a694f24a76e3aa05d9e54b2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:21:36.259440 30774 tablet_service.cc:1511] Processing CreateTablet for tablet 89472c03e684475c9254c1b3c2ad6350 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:36.266925 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89472c03e684475c9254c1b3c2ad6350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.260798 30849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de79bb6a5d7d4dea85d1e4029984c0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.267268 30979 raft_consensus.cc:359] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.268055 30979 raft_consensus.cc:385] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.268172 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1fc0f15e994691a2edf5f0c3b096eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.268411 30979 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.278797 30918 tablet_service.cc:1511] Processing CreateTablet for tablet 89472c03e684475c9254c1b3c2ad6350 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:36.279857 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1459f4eb71440ae996b2745034179c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.280407 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89472c03e684475c9254c1b3c2ad6350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.286113 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b23b41846a694f24a76e3aa05d9e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.286659 30979 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.259876 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 64f8ac94405742eb87e6d195387d7c6f (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:36.288731 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ac94405742eb87e6d195387d7c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.289186 30979 ts_tablet_manager.cc:1434] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 12:21:36.292276 30982 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.300429 30841 tablet_service.cc:1511] Processing CreateTablet for tablet d3635826198a49c885a3b5c762743eb3 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:21:36.299659 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 48c55f87983e421bae7549aa563643a2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:36.307551 30979 tablet_bootstrap.cc:492] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:36.308677 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c55f87983e421bae7549aa563643a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.306878 30982 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:36.311946 30982 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:36.341003 30977 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.341673 30977 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.344213 30977 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:36.350090 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3635826198a49c885a3b5c762743eb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.352556 30975 tablet_bootstrap.cc:654] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.352658 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf061659071464dadafceeb712b1c5d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:36.357445 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf061659071464dadafceeb712b1c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.362205 30983 tablet_bootstrap.cc:654] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.293792 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 464359e0b4944cf9868ca1cb6bd2546a (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:21:36.386070 30885 heartbeater.cc:499] Master 127.28.234.126:42357 was elected leader, sending a full tablet report...
I20260709 12:21:36.387072 30775 tablet_service.cc:1511] Processing CreateTablet for tablet f3139ddb2dda48ce8a138dbb3cf05035 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:36.401155 30975 tablet_bootstrap.cc:492] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:36.401741 30975 ts_tablet_manager.cc:1403] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.195s	user 0.007s	sys 0.008s
I20260709 12:21:36.402523 30979 tablet_bootstrap.cc:654] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.407510 30843 tablet_service.cc:1511] Processing CreateTablet for tablet ec82b6c4e54048a8a16a319c0cb38d23 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:21:36.405125 30975 raft_consensus.cc:359] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.410104 30975 raft_consensus.cc:385] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.410462 30975 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.414521 30923 tablet_service.cc:1511] Processing CreateTablet for tablet 48c55f87983e421bae7549aa563643a2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:36.417707 30923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c55f87983e421bae7549aa563643a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.418081 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464359e0b4944cf9868ca1cb6bd2546a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.426669 30775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3139ddb2dda48ce8a138dbb3cf05035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.426894 30922 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf061659071464dadafceeb712b1c5d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:36.428306 30922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf061659071464dadafceeb712b1c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.428367 30769 tablet_service.cc:1511] Processing CreateTablet for tablet 49daeb92ae08415eb56869e7df8fc686 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:36.429721 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49daeb92ae08415eb56869e7df8fc686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.444380 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82b6c4e54048a8a16a319c0cb38d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.448982 30925 tablet_service.cc:1511] Processing CreateTablet for tablet f3139ddb2dda48ce8a138dbb3cf05035 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:36.450534 30925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3139ddb2dda48ce8a138dbb3cf05035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.460299 30920 tablet_service.cc:1511] Processing CreateTablet for tablet 49daeb92ae08415eb56869e7df8fc686 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:36.460731 30771 tablet_service.cc:1511] Processing CreateTablet for tablet bb8ca824cf6744b2ac7815f82ca8b276 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:36.461867 30920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49daeb92ae08415eb56869e7df8fc686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.462091 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8ca824cf6744b2ac7815f82ca8b276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.485642 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:36.442356 30975 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:36.490257 30900 leader_election.cc:343] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.489428 30846 tablet_service.cc:1511] Processing CreateTablet for tablet 047196043bb744a6b94cb3b634b80771 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:21:36.494388 30977 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.499471 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047196043bb744a6b94cb3b634b80771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.499384 30977 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.500221 30773 tablet_service.cc:1511] Processing CreateTablet for tablet e63671b1e5b245ca8343f52f6239b6ae (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:36.501612 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63671b1e5b245ca8343f52f6239b6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.505801 30977 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:36.490679 30848 tablet_service.cc:1511] Processing CreateTablet for tablet ae2135797f024066b30a0fb14e174518 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:21:36.510612 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae2135797f024066b30a0fb14e174518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.525574 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:36.527204 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:36.528734 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:36.531121 30750 leader_election.cc:343] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:36.532022 30750 leader_election.cc:343] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:36.532819 30750 leader_election.cc:343] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.537200 30772 tablet_service.cc:1511] Processing CreateTablet for tablet c5d48dd4a93a42d09268f3dee7887550 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:36.537734 30979 tablet_bootstrap.cc:492] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:36.538301 30979 ts_tablet_manager.cc:1403] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.232s	user 0.017s	sys 0.005s
I20260709 12:21:36.538751 30772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d48dd4a93a42d09268f3dee7887550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.541951 30917 tablet_service.cc:1511] Processing CreateTablet for tablet bb8ca824cf6744b2ac7815f82ca8b276 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:36.543431 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8ca824cf6744b2ac7815f82ca8b276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.546823 30843 tablet_service.cc:1511] Processing CreateTablet for tablet abd414d2ac774e99a1548b0ff34a4f37 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:21:36.548336 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd414d2ac774e99a1548b0ff34a4f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.548542 30919 tablet_service.cc:1511] Processing CreateTablet for tablet e63671b1e5b245ca8343f52f6239b6ae (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:36.550720 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63671b1e5b245ca8343f52f6239b6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.541644 30979 raft_consensus.cc:359] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.566092 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:36.566207 30979 raft_consensus.cc:385] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.566869 30979 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.568398 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:36.568312 30921 tablet_service.cc:1511] Processing CreateTablet for tablet c5d48dd4a93a42d09268f3dee7887550 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:36.569707 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d48dd4a93a42d09268f3dee7887550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.570556 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:21:36.572172 30750 leader_election.cc:343] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.572752 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:36.574649 30850 tablet_service.cc:1511] Processing CreateTablet for tablet 145501f8904547999755a27a5d421157 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:21:36.576566 30850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145501f8904547999755a27a5d421157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.569079 30844 tablet_service.cc:1511] Processing CreateTablet for tablet e6c0595eb2284ea9b8da2832d8558f7e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:21:36.583487 30975 ts_tablet_manager.cc:1434] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.181s	user 0.011s	sys 0.007s
I20260709 12:21:36.584712 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c0595eb2284ea9b8da2832d8558f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.597038 30774 tablet_service.cc:1511] Processing CreateTablet for tablet 2323a4fe46444265864acf0869016ef4 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:36.602048 30774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2323a4fe46444265864acf0869016ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.594547 30975 tablet_bootstrap.cc:492] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:36.618239 30995 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.617964 30979 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.620114 30842 tablet_service.cc:1511] Processing CreateTablet for tablet 68688b51d09c48d6b63fec7f6e414d95 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:21:36.628690 30849 tablet_service.cc:1511] Processing CreateTablet for tablet 89472c03e684475c9254c1b3c2ad6350 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:21:36.629191 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68688b51d09c48d6b63fec7f6e414d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.629314 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:36.630862 30975 tablet_bootstrap.cc:654] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:36.631237 30899 leader_election.cc:343] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.631721 30899 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:36.632647 30982 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.634366 30982 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.634891 30982 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.637166 30982 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:36.620632 30979 ts_tablet_manager.cc:1434] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.008s
W20260709 12:21:36.622562 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 50422.4us
I20260709 12:21:36.638054 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:36.638549 30750 leader_election.cc:343] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.638993 30979 tablet_bootstrap.cc:492] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:36.638782 30918 tablet_service.cc:1511] Processing CreateTablet for tablet 2323a4fe46444265864acf0869016ef4 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:21:36.638968 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:21:36.639523 30899 leader_election.cc:343] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.640228 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2323a4fe46444265864acf0869016ef4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:36.640290 30750 leader_election.cc:343] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.640817 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:36.641155 30849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89472c03e684475c9254c1b3c2ad6350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.626958 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 64f8ac94405742eb87e6d195387d7c6f (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:21:36.642169 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ac94405742eb87e6d195387d7c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.646195 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:36.649971 30977 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.650735 30977 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:21:36.653175 30900 leader_election.cc:343] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.653687 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:36.655851 30982 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.674990 30767 tablet_service.cc:1511] Processing CreateTablet for tablet c32de69a76624466ad038a06e78980dd (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:36.675061 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 48c55f87983e421bae7549aa563643a2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:21:36.676616 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32de69a76624466ad038a06e78980dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.678385 30983 tablet_bootstrap.cc:492] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:36.678913 30983 ts_tablet_manager.cc:1403] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.480s	user 0.021s	sys 0.008s
I20260709 12:21:36.692400 30983 raft_consensus.cc:359] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:36.693203 30983 raft_consensus.cc:385] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.693518 30983 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.694394 30983 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:36.695366 30846 tablet_service.cc:1511] Processing CreateTablet for tablet 9cf061659071464dadafceeb712b1c5d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:21:36.696429 30916 tablet_service.cc:1511] Processing CreateTablet for tablet c32de69a76624466ad038a06e78980dd (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:36.698284 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32de69a76624466ad038a06e78980dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.702785 30975 tablet_bootstrap.cc:492] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:36.694527 30847 tablet_service.cc:1511] Processing CreateTablet for tablet f3139ddb2dda48ce8a138dbb3cf05035 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:21:36.696887 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf061659071464dadafceeb712b1c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.714608 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48c55f87983e421bae7549aa563643a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.715332 30975 ts_tablet_manager.cc:1403] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.011s
I20260709 12:21:36.718995 30975 raft_consensus.cc:359] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.721653 30975 raft_consensus.cc:385] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.722131 30975 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.720820 30842 tablet_service.cc:1511] Processing CreateTablet for tablet 49daeb92ae08415eb56869e7df8fc686 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:21:36.724670 30975 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.726125 30841 tablet_service.cc:1511] Processing CreateTablet for tablet bb8ca824cf6744b2ac7815f82ca8b276 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:21:36.735373 30975 ts_tablet_manager.cc:1434] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:21:36.736660 30979 tablet_bootstrap.cc:654] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.744395 30975 tablet_bootstrap.cc:492] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:36.747025 30769 tablet_service.cc:1511] Processing CreateTablet for tablet fcf69f43966d4209837d8bca1cecb1ab (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:36.762460 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf69f43966d4209837d8bca1cecb1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.769505 30918 tablet_service.cc:1511] Processing CreateTablet for tablet fcf69f43966d4209837d8bca1cecb1ab (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:36.771183 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf69f43966d4209837d8bca1cecb1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.781155 30975 tablet_bootstrap.cc:654] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.781879 30995 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.782444 30995 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.784813 30995 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:36.787007 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:36.788868 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:36.753507 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3139ddb2dda48ce8a138dbb3cf05035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.795332 30850 tablet_service.cc:1511] Processing CreateTablet for tablet 2323a4fe46444265864acf0869016ef4 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:21:36.791486 30750 leader_election.cc:343] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.793218 30771 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9956c598e54d3cb1778d39d8196a85 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:21:36.796794 30750 leader_election.cc:343] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.796927 30850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2323a4fe46444265864acf0869016ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.797019 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9956c598e54d3cb1778d39d8196a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.797276 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:36.798826 30995 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.802548 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49daeb92ae08415eb56869e7df8fc686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.805572 30843 tablet_service.cc:1511] Processing CreateTablet for tablet c5d48dd4a93a42d09268f3dee7887550 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:21:36.806965 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d48dd4a93a42d09268f3dee7887550. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.787012 30848 tablet_service.cc:1511] Processing CreateTablet for tablet e63671b1e5b245ca8343f52f6239b6ae (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:21:36.823452 30844 tablet_service.cc:1511] Processing CreateTablet for tablet fcf69f43966d4209837d8bca1cecb1ab (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:21:36.828945 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9956c598e54d3cb1778d39d8196a85 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:36.830312 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9956c598e54d3cb1778d39d8196a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.830724 30983 ts_tablet_manager.cc:1434] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.151s	user 0.016s	sys 0.024s
I20260709 12:21:36.831817 30983 tablet_bootstrap.cc:492] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:36.825695 30849 tablet_service.cc:1511] Processing CreateTablet for tablet c32de69a76624466ad038a06e78980dd (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:21:36.835238 30773 tablet_service.cc:1511] Processing CreateTablet for tablet 99675411e6424bd6a95cbc666a5ece32 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:36.836510 30773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99675411e6424bd6a95cbc666a5ece32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.840047 30979 tablet_bootstrap.cc:492] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:36.840566 30979 ts_tablet_manager.cc:1403] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.202s	user 0.000s	sys 0.023s
I20260709 12:21:36.842572 30841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8ca824cf6744b2ac7815f82ca8b276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.843227 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e63671b1e5b245ca8343f52f6239b6ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.843415 30923 tablet_service.cc:1511] Processing CreateTablet for tablet 99675411e6424bd6a95cbc666a5ece32 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:36.844676 30923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99675411e6424bd6a95cbc666a5ece32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.848981 30766 tablet_service.cc:1511] Processing CreateTablet for tablet dd65da5a34854820ae636ab77116f737 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:36.850531 30849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32de69a76624466ad038a06e78980dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.852195 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd65da5a34854820ae636ab77116f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.855074 30998 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.855595 30998 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:36.860023 30998 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:36.865307 30979 raft_consensus.cc:359] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.866160 30979 raft_consensus.cc:385] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.866456 30979 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.867265 30979 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.868284 30975 tablet_bootstrap.cc:492] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:36.872924 30975 ts_tablet_manager.cc:1403] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.129s	user 0.028s	sys 0.018s
I20260709 12:21:36.873984 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf69f43966d4209837d8bca1cecb1ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.890605 30982 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:36.891358 30982 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.895319 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:36.896834 30899 leader_election.cc:343] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.898453 30916 tablet_service.cc:1511] Processing CreateTablet for tablet dd65da5a34854820ae636ab77116f737 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:36.899856 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd65da5a34854820ae636ab77116f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.901815 30982 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:36.899457 30975 raft_consensus.cc:359] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.918398 30975 raft_consensus.cc:385] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.918967 30975 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.919436 30979 ts_tablet_manager.cc:1434] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 12:21:36.920291 30975 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:36.921041 30979 tablet_bootstrap.cc:492] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:36.925549 30975 ts_tablet_manager.cc:1434] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260709 12:21:36.932781 30983 tablet_bootstrap.cc:654] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.951788 30845 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9956c598e54d3cb1778d39d8196a85 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:21:36.938982 30771 tablet_service.cc:1511] Processing CreateTablet for tablet b3e3882211ee442daf1d37e6649ccb9f (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:36.941506 30919 tablet_service.cc:1511] Processing CreateTablet for tablet a17ff7050be449b8928f071ef46b1d4c (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:36.943137 30769 tablet_service.cc:1511] Processing CreateTablet for tablet a17ff7050be449b8928f071ef46b1d4c (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:36.954039 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17ff7050be449b8928f071ef46b1d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.955638 30843 tablet_service.cc:1511] Processing CreateTablet for tablet 99675411e6424bd6a95cbc666a5ece32 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:21:36.956732 30975 tablet_bootstrap.cc:492] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:36.961009 30979 tablet_bootstrap.cc:654] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.968571 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:36.969601 30767 tablet_service.cc:1511] Processing CreateTablet for tablet 9506af0dc4e245e4a321265c053f82cb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:21:36.970105 30900 leader_election.cc:343] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:36.971235 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:36.972538 30982 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:36.972975 30918 tablet_service.cc:1511] Processing CreateTablet for tablet b3e3882211ee442daf1d37e6649ccb9f (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:36.974299 30918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e3882211ee442daf1d37e6649ccb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.977790 30921 tablet_service.cc:1511] Processing CreateTablet for tablet 9506af0dc4e245e4a321265c053f82cb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:36.979169 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9506af0dc4e245e4a321265c053f82cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.979578 30771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e3882211ee442daf1d37e6649ccb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.980335 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9506af0dc4e245e4a321265c053f82cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.980962 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17ff7050be449b8928f071ef46b1d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.982630 30850 tablet_service.cc:1511] Processing CreateTablet for tablet dd65da5a34854820ae636ab77116f737 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:21:36.994022 30845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9956c598e54d3cb1778d39d8196a85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.995023 30775 tablet_service.cc:1511] Processing CreateTablet for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:36.996476 30775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.998456 30850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd65da5a34854820ae636ab77116f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.999897 30846 tablet_service.cc:1511] Processing CreateTablet for tablet a17ff7050be449b8928f071ef46b1d4c (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:21:37.001242 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17ff7050be449b8928f071ef46b1d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.004470 30842 tablet_service.cc:1511] Processing CreateTablet for tablet b3e3882211ee442daf1d37e6649ccb9f (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:21:37.006654 30975 tablet_bootstrap.cc:654] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.008569 30983 tablet_bootstrap.cc:492] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.009163 30983 ts_tablet_manager.cc:1403] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.178s	user 0.008s	sys 0.008s
I20260709 12:21:37.011010 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 9506af0dc4e245e4a321265c053f82cb (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:21:37.013911 30843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99675411e6424bd6a95cbc666a5ece32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.016930 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9506af0dc4e245e4a321265c053f82cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.018133 30842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3e3882211ee442daf1d37e6649ccb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.039165 30983 raft_consensus.cc:359] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.040016 30983 raft_consensus.cc:385] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.040391 30983 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.047108 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:37.048498 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.040655 30848 tablet_service.cc:1511] Processing CreateTablet for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:21:37.051620 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.060043 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:37.067660 30825 leader_election.cc:343] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.067932 30917 tablet_service.cc:1511] Processing CreateTablet for tablet c86ad2fde72a4917a713ec09d50d16ef (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:37.068418 30979 tablet_bootstrap.cc:492] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:37.068907 30979 ts_tablet_manager.cc:1403] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.148s	user 0.015s	sys 0.005s
I20260709 12:21:37.068660 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe828317ecc4cca97bd1b284e5f2785 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:37.069253 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86ad2fde72a4917a713ec09d50d16ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.069907 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe828317ecc4cca97bd1b284e5f2785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.071913 30979 raft_consensus.cc:359] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.072675 30979 raft_consensus.cc:385] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.072999 30979 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.054628 30983 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:37.081043 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:37.073733 30979 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.102663 30979 ts_tablet_manager.cc:1434] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.033s	user 0.001s	sys 0.007s
I20260709 12:21:37.103760 30979 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:37.083115 30767 tablet_service.cc:1511] Processing CreateTablet for tablet c86ad2fde72a4917a713ec09d50d16ef (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:37.107179 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86ad2fde72a4917a713ec09d50d16ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.091802 30849 tablet_service.cc:1511] Processing CreateTablet for tablet c86ad2fde72a4917a713ec09d50d16ef (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:21:37.111321 30849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86ad2fde72a4917a713ec09d50d16ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.115214 30975 tablet_bootstrap.cc:492] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:37.115747 30975 ts_tablet_manager.cc:1403] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.012s
I20260709 12:21:37.099679 30983 ts_tablet_manager.cc:1434] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.090s	user 0.001s	sys 0.005s
I20260709 12:21:37.117846 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.124987 30935 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:37.126075 30975 raft_consensus.cc:359] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.126492 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:37.126715 30983 tablet_bootstrap.cc:492] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.132454 30844 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe828317ecc4cca97bd1b284e5f2785 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:37.138568 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe828317ecc4cca97bd1b284e5f2785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.139772 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 91c561a0b4404fcb8adb9d2002e0c15d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:37.141038 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c561a0b4404fcb8adb9d2002e0c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.134910 30919 tablet_service.cc:1511] Processing CreateTablet for tablet d22f521a944e4f66a81bcb842c1ae363 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:37.142566 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22f521a944e4f66a81bcb842c1ae363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.143842 30983 tablet_bootstrap.cc:654] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.127709 30998 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.145937 30998 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.146322 30998 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.151013 30979 tablet_bootstrap.cc:654] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.128911 30847 tablet_service.cc:1511] Processing CreateTablet for tablet d22f521a944e4f66a81bcb842c1ae363 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:37.153003 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22f521a944e4f66a81bcb842c1ae363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.157624 30983 tablet_bootstrap.cc:492] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.158234 30983 ts_tablet_manager.cc:1403] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.007s
I20260709 12:21:37.130544 30769 tablet_service.cc:1511] Processing CreateTablet for tablet d22f521a944e4f66a81bcb842c1ae363 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:21:37.132874 30995 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.161321 30983 raft_consensus.cc:359] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.162335 30983 raft_consensus.cc:385] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.162077 30995 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.162731 30983 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.163568 30983 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.164183 30995 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.166523 30979 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:37.167029 30979 ts_tablet_manager.cc:1403] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.006s
I20260709 12:21:37.166790 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.167652 30935 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:37.168073 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:37.169111 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:21:37.170157 30750 leader_election.cc:343] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.170878 30995 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.171403 30995 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.171814 30995 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.173558 30983 ts_tablet_manager.cc:1434] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:21:37.176959 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d22f521a944e4f66a81bcb842c1ae363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.126853 30975 raft_consensus.cc:385] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.179252 30975 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.186312 30983 tablet_bootstrap.cc:492] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.187126 30998 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:37.190523 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:37.191350 30935 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.197088 30983 tablet_bootstrap.cc:654] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.200716 30935 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:37.134219 30923 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe828317ecc4cca97bd1b284e5f2785 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:21:37.207865 30923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe828317ecc4cca97bd1b284e5f2785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.251890 31008 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.252453 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:21:37.252758 30668 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 78582.5us
I20260709 12:21:37.253573 30979 raft_consensus.cc:359] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.253860 30975 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.254457 30979 raft_consensus.cc:385] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.254792 30979 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.255581 30979 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.258025 31009 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.258278 30979 ts_tablet_manager.cc:1434] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.087s	user 0.022s	sys 0.064s
I20260709 12:21:37.258591 30983 tablet_bootstrap.cc:492] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.259303 30983 ts_tablet_manager.cc:1403] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.013s
I20260709 12:21:37.263833 30975 ts_tablet_manager.cc:1434] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.148s	user 0.010s	sys 0.002s
I20260709 12:21:37.260085 30979 tablet_bootstrap.cc:492] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:37.264950 30975 tablet_bootstrap.cc:492] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:37.267915 30917 tablet_service.cc:1511] Processing CreateTablet for tablet 91c561a0b4404fcb8adb9d2002e0c15d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:37.270126 30982 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.270658 30982 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.271687 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c561a0b4404fcb8adb9d2002e0c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.271124 30983 raft_consensus.cc:359] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.272627 30983 raft_consensus.cc:385] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.273030 30983 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.260329 30849 tablet_service.cc:1511] Processing CreateTablet for tablet 91c561a0b4404fcb8adb9d2002e0c15d (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:21:37.252452 31008 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.263705 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:37.276676 30849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c561a0b4404fcb8adb9d2002e0c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.260829 30998 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
W20260709 12:21:37.277824 30825 leader_election.cc:343] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.286190 30767 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6b5782c4be491f89e3db5e94722436 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:37.288010 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6b5782c4be491f89e3db5e94722436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.303133 30979 tablet_bootstrap.cc:654] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.306310 30983 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.308537 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:37.308390 30995 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.308866 30983 ts_tablet_manager.cc:1434] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.045s	user 0.013s	sys 0.006s
I20260709 12:21:37.309201 30785 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:37.310298 30983 tablet_bootstrap.cc:492] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.312336 30899 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:37.306886 30982 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:37.321919 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:37.323765 30900 leader_election.cc:343] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.326709 31008 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.327771 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:37.328501 30785 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:37.329892 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:37.330824 31008 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.331203 31008 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.331547 31008 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.332551 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.327278 30982 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:37.334136 30826 leader_election.cc:343] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.334156 30982 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.336603 30846 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6b5782c4be491f89e3db5e94722436 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:37.337189 30982 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.338155 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6b5782c4be491f89e3db5e94722436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.350034 31011 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.350646 31011 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.352903 31011 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.356184 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:37.356904 30858 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:37.358103 31011 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.358130 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.358649 31011 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.360502 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:37.360891 31011 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.361472 31011 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.336606 30983 tablet_bootstrap.cc:654] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.361851 31011 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.366532 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 9a6b5782c4be491f89e3db5e94722436 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:21:37.369074 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6b5782c4be491f89e3db5e94722436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.373509 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5ec4b5b8a34d7192f60102179eb425 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:37.374768 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5ec4b5b8a34d7192f60102179eb425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.375037 31012 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.375645 30975 tablet_bootstrap.cc:654] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.375497 31012 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.368239 31011 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.378638 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:37.379316 30785 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:37.380815 30825 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:37.381702 30998 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.382109 30998 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.382459 30998 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:37.393260 30750 leader_election.cc:343] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.395221 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:37.395354 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.396415 30998 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.397177 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:37.397876 30934 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.397909 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:37.402915 30750 leader_election.cc:343] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:37.403710 30750 leader_election.cc:343] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.404134 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:37.405299 31012 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:37.405973 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 95344.7us
I20260709 12:21:37.406478 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.407124 30935 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:37.407759 30979 tablet_bootstrap.cc:492] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:37.408418 30979 ts_tablet_manager.cc:1403] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.149s	user 0.040s	sys 0.025s
I20260709 12:21:37.370776 30995 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.382488 31008 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.429849 30979 raft_consensus.cc:359] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.430454 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:37.430686 30979 raft_consensus.cc:385] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.431071 30785 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.430836 30923 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5ec4b5b8a34d7192f60102179eb425 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:37.418431 31015 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.413810 30982 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.369952 31009 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:37.433053 30844 tablet_service.cc:1511] Processing CreateTablet for tablet 3e5ec4b5b8a34d7192f60102179eb425 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:21:37.440021 30785 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:37.440469 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5ec4b5b8a34d7192f60102179eb425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.417652 30934 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
W20260709 12:21:37.410641 30750 leader_election.cc:343] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.441464 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:37.432758 31008 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.442405 31012 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.442584 30767 tablet_service.cc:1511] Processing CreateTablet for tablet 84dde2d8ff054417a11a7ec410d2ffd2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:37.433928 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:37.438315 31009 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:37.443895 30982 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:37.445391 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:37.446259 30998 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.447245 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:37.447853 30933 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.450377 30847 tablet_service.cc:1511] Processing CreateTablet for tablet 84dde2d8ff054417a11a7ec410d2ffd2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:37.442930 31012 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:37.452391 30983 tablet_bootstrap.cc:492] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.452886 30983 ts_tablet_manager.cc:1403] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.143s	user 0.018s	sys 0.037s
I20260709 12:21:37.452677 31012 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.451542 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:37.454034 30784 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:37.451439 30900 leader_election.cc:343] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.454681 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:37.455236 30785 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.456099 30983 raft_consensus.cc:359] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.456851 30983 raft_consensus.cc:385] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.457152 30983 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.458787 30767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dde2d8ff054417a11a7ec410d2ffd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.459908 30975 tablet_bootstrap.cc:492] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:37.460405 30975 ts_tablet_manager.cc:1403] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.005s
I20260709 12:21:37.452920 31011 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.461958 30847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dde2d8ff054417a11a7ec410d2ffd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.462410 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 84dde2d8ff054417a11a7ec410d2ffd2 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:21:37.442298 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:37.463248 30983 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.431046 30979 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.464550 31015 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.467824 30983 ts_tablet_manager.cc:1434] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:21:37.467756 30979 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.471107 30935 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.471449 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:37.472009 30858 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.468432 31015 raft_consensus.cc:697] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:37.469007 30983 tablet_bootstrap.cc:492] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.469689 30975 raft_consensus.cc:359] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.470393 30933 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:37.432601 30923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5ec4b5b8a34d7192f60102179eb425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.478647 30935 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:37.479882 30975 raft_consensus.cc:385] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.480485 30975 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.483891 31015 consensus_queue.cc:237] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.485342 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb0278198af4c1aba82199de860057a (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:37.485661 30846 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb0278198af4c1aba82199de860057a (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:37.486775 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb0278198af4c1aba82199de860057a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.481181 30858 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:37.489275 30846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb0278198af4c1aba82199de860057a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.489888 30975 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.490907 30917 tablet_service.cc:1511] Processing CreateTablet for tablet 3bb0278198af4c1aba82199de860057a (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:21:37.492627 30975 ts_tablet_manager.cc:1434] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.004s
I20260709 12:21:37.493691 30975 tablet_bootstrap.cc:492] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:37.495817 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:37.496344 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:37.496804 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:37.498283 30769 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc94a27f1f74fcea7449d3b7823d96e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:37.499298 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc94a27f1f74fcea7449d3b7823d96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.500298 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dde2d8ff054417a11a7ec410d2ffd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.480677 30784 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:37.500080 30995 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.498008 31011 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.501453 31008 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.512841 30849 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc94a27f1f74fcea7449d3b7823d96e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:37.514405 30849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc94a27f1f74fcea7449d3b7823d96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.509533 30917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb0278198af4c1aba82199de860057a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.528470 31011 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.529145 31011 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.528620 30681 catalog_manager.cc:5697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.531539 31011 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.506949 30785 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:37.552348 31008 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:21:37.553124 30750 leader_election.cc:343] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.574548 30979 ts_tablet_manager.cc:1434] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.166s	user 0.013s	sys 0.003s
I20260709 12:21:37.575685 30979 tablet_bootstrap.cc:492] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:37.578773 30919 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc94a27f1f74fcea7449d3b7823d96e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:21:37.580052 30919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc94a27f1f74fcea7449d3b7823d96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.580554 31008 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.583691 30983 tablet_bootstrap.cc:654] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.584575 30975 tablet_bootstrap.cc:654] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.587241 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:37.587985 30858 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:37.576653 30899 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:37.587348 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.589444 30933 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:37.589948 30982 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.591115 30982 raft_consensus.cc:697] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:37.590662 30682 catalog_manager.cc:5697] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.591964 30982 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.594724 30766 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2b1416a04848d99913731a9259dc8e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:37.595934 30766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2b1416a04848d99913731a9259dc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.598263 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:37.599221 31020 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.599642 31020 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.600145 31020 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.601014 30844 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2b1416a04848d99913731a9259dc8e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:37.602813 30979 tablet_bootstrap.cc:654] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.603718 30921 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2b1416a04848d99913731a9259dc8e (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:21:37.605283 30921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2b1416a04848d99913731a9259dc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.612010 30769 tablet_service.cc:1511] Processing CreateTablet for tablet 66c752ebb5cb4a9da00940d6b57922d7 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:37.613351 30769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c752ebb5cb4a9da00940d6b57922d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.616043 30844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2b1416a04848d99913731a9259dc8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.568074 30995 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:37.618016 31020 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.640817 30916 tablet_service.cc:1511] Processing CreateTablet for tablet 66c752ebb5cb4a9da00940d6b57922d7 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:37.651700 30979 tablet_bootstrap.cc:492] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:37.652421 30979 ts_tablet_manager.cc:1403] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.077s	user 0.007s	sys 0.010s
I20260709 12:21:37.659475 30995 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.663584 30979 raft_consensus.cc:359] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.664604 30979 raft_consensus.cc:385] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.664958 30979 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.666215 30979 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.669001 30916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c752ebb5cb4a9da00940d6b57922d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.670454 30848 tablet_service.cc:1511] Processing CreateTablet for tablet 66c752ebb5cb4a9da00940d6b57922d7 (DEFAULT_TABLE table=test-workload [id=7c950502687e4d09a4581a48a2cf1944]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:21:37.671799 30848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c752ebb5cb4a9da00940d6b57922d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.675334 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:37.675976 30858 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.678359 31020 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.688361 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:37.689028 30933 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.692055 30983 tablet_bootstrap.cc:492] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.692799 30983 ts_tablet_manager.cc:1403] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.224s	user 0.020s	sys 0.024s
I20260709 12:21:37.702011 30975 tablet_bootstrap.cc:492] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:37.702512 30975 ts_tablet_manager.cc:1403] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.209s	user 0.012s	sys 0.011s
I20260709 12:21:37.705257 30975 raft_consensus.cc:359] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.705971 30975 raft_consensus.cc:385] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.706252 30975 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.701329 30983 raft_consensus.cc:359] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.709965 30983 raft_consensus.cc:385] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.710429 30983 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.710274 30975 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.711925 30983 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.712904 30975 ts_tablet_manager.cc:1434] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:37.714087 30975 tablet_bootstrap.cc:492] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:37.715677 30979 ts_tablet_manager.cc:1434] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 12:21:37.718561 30979 tablet_bootstrap.cc:492] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:37.727244 30983 ts_tablet_manager.cc:1434] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 12:21:37.728719 30983 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.735394 30680 catalog_manager.cc:5697] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.738695 30979 tablet_bootstrap.cc:654] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.742262 30858 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:37.745398 31008 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.746060 31008 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.746644 30933 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:37.747998 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:37.748385 31008 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.748894 31020 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.749378 31020 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:37.750305 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:37.750223 31020 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:37.751859 30825 leader_election.cc:343] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.755730 30975 tablet_bootstrap.cc:654] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.759727 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.760419 30933 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:37.761811 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:37.762640 31008 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.762993 31008 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.763348 31008 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.767549 30983 tablet_bootstrap.cc:654] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.775362 31008 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.783155 30682 catalog_manager.cc:5697] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.785131 31008 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.785069 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:37.785835 30975 tablet_bootstrap.cc:492] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:37.785006 30682 catalog_manager.cc:5697] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.786289 30975 ts_tablet_manager.cc:1403] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.009s
I20260709 12:21:37.787227 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:37.787801 30933 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:37.787885 30825 leader_election.cc:343] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.789072 30975 raft_consensus.cc:359] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.789804 30975 raft_consensus.cc:385] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.790077 30975 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.790764 30975 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.793272 30975 ts_tablet_manager.cc:1434] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:21:37.794225 30975 tablet_bootstrap.cc:492] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:37.796574 30983 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.797034 30983 ts_tablet_manager.cc:1403] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.017s
I20260709 12:21:37.797091 30979 tablet_bootstrap.cc:492] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:37.797597 30979 ts_tablet_manager.cc:1403] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.000s
I20260709 12:21:37.799405 30983 raft_consensus.cc:359] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.799988 30983 raft_consensus.cc:385] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.800246 30983 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.800127 30979 raft_consensus.cc:359] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.800848 30979 raft_consensus.cc:385] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.801118 30979 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.801126 30983 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.801898 30979 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.803864 30979 ts_tablet_manager.cc:1434] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:21:37.804064 30983 ts_tablet_manager.cc:1434] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:37.804528 30933 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:37.804792 30979 tablet_bootstrap.cc:492] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:37.805078 30983 tablet_bootstrap.cc:492] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.811350 30983 tablet_bootstrap.cc:654] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.813925 30975 tablet_bootstrap.cc:654] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.815610 30979 tablet_bootstrap.cc:654] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.823632 30681 catalog_manager.cc:5697] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.830626 30681 catalog_manager.cc:5697] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.838682 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:37.840024 31008 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.840876 31008 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:37.842039 31008 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.859560 31008 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.867452 30983 tablet_bootstrap.cc:492] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.870287 30979 tablet_bootstrap.cc:492] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:37.871675 30983 ts_tablet_manager.cc:1403] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.020s
I20260709 12:21:37.869212 30682 catalog_manager.cc:5697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.870530 30975 tablet_bootstrap.cc:492] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:37.873070 30975 ts_tablet_manager.cc:1403] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.028s
I20260709 12:21:37.871675 30979 ts_tablet_manager.cc:1403] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.067s	user 0.030s	sys 0.024s
I20260709 12:21:37.874289 30982 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.874933 30982 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.875267 30983 raft_consensus.cc:359] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.876031 30983 raft_consensus.cc:385] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.876341 30983 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.877388 30982 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:37.877463 30979 raft_consensus.cc:359] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.877717 30983 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.878461 30979 raft_consensus.cc:385] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.879029 30979 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.879746 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:37.880208 30983 ts_tablet_manager.cc:1434] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:21:37.879823 30979 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.878440 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:37.880417 30858 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:37.880602 30975 raft_consensus.cc:359] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.881343 30785 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:37.881632 30975 raft_consensus.cc:385] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.881963 30975 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.881352 30983 tablet_bootstrap.cc:492] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.882635 30975 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.882800 30979 ts_tablet_manager.cc:1434] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:37.884122 30979 tablet_bootstrap.cc:492] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:37.882755 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:37.889920 30982 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.890354 30982 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.890743 30982 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.891484 30979 tablet_bootstrap.cc:654] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.894213 30983 tablet_bootstrap.cc:654] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.896981 30975 ts_tablet_manager.cc:1434] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 12:21:37.901099 30975 tablet_bootstrap.cc:492] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:37.905823 30979 tablet_bootstrap.cc:492] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:37.906471 30979 ts_tablet_manager.cc:1403] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 12:21:37.911629 30982 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.913932 31009 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:37.917974 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:37.918926 30784 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.924153 31009 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.924893 31009 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.926856 31014 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.927543 31014 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.931226 31014 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:37.933717 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:37.936050 30899 leader_election.cc:343] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.937211 30982 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:37.943482 30784 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:37.944531 30979 raft_consensus.cc:359] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.945302 30979 raft_consensus.cc:385] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.945706 30979 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.945127 30899 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:37.946846 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:37.946647 30979 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.947628 30783 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:21:37.947955 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:37.948801 30979 ts_tablet_manager.cc:1434] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.042s	user 0.016s	sys 0.011s
I20260709 12:21:37.949064 31014 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.949739 30979 tablet_bootstrap.cc:492] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:37.952666 31009 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.954490 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.955683 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:37.955945 30900 leader_election.cc:343] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.956148 30979 tablet_bootstrap.cc:654] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.956066 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:37.956363 30858 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.956610 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:37.958211 30982 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.960672 31009 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.964238 31020 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.970497 30983 tablet_bootstrap.cc:492] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:37.971093 30983 ts_tablet_manager.cc:1403] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.090s	user 0.005s	sys 0.008s
I20260709 12:21:37.972498 31008 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:37.972592 31012 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:37.974119 30975 tablet_bootstrap.cc:654] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.973888 30983 raft_consensus.cc:359] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.975277 30983 raft_consensus.cc:385] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.975540 30983 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.976212 30983 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.978705 30983 ts_tablet_manager.cc:1434] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:37.982108 31020 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.982609 31020 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:37.983212 30983 tablet_bootstrap.cc:492] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:37.983675 30858 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:37.984896 31020 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:37.990111 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:37.993137 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:37.994602 30935 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 1: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:21:37.996560 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:37.997949 31020 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.011708 30979 tablet_bootstrap.cc:492] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.012243 30979 ts_tablet_manager.cc:1403] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.007s
I20260709 12:21:38.013374 30859 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.015491 30979 raft_consensus.cc:359] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.016304 30979 raft_consensus.cc:385] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.016588 30979 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
W20260709 12:21:38.018221 30961 tablet.cc:2406] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:38.018392 30979 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.020195 30979 ts_tablet_manager.cc:1434] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:21:38.021106 30979 tablet_bootstrap.cc:492] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.011631 31008 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:21:38.023337 30995 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.021116 31014 raft_consensus.cc:697] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:38.024866 31014 consensus_queue.cc:237] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:38.028957 30825 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.029057 31020 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.033360 30979 tablet_bootstrap.cc:654] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.042508 30983 tablet_bootstrap.cc:654] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.046307 30975 tablet_bootstrap.cc:492] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.046166 31009 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.064286 31020 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.067500 31048 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.069685 30975 ts_tablet_manager.cc:1403] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.001s
I20260709 12:21:38.076236 30983 tablet_bootstrap.cc:492] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.078037 30983 ts_tablet_manager.cc:1403] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.011s
I20260709 12:21:38.075937 30975 raft_consensus.cc:359] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.081432 30983 raft_consensus.cc:359] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.082311 30983 raft_consensus.cc:385] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.082630 30983 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.081837 30975 raft_consensus.cc:385] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.083878 30983 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.084466 30975 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.086807 30983 ts_tablet_manager.cc:1434] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:21:38.087822 30983 tablet_bootstrap.cc:492] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.090384 30975 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.093711 30983 tablet_bootstrap.cc:654] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.096191 30975 ts_tablet_manager.cc:1434] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:21:38.097322 30975 tablet_bootstrap.cc:492] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.099088 30982 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:38.104846 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:38.109896 30975 tablet_bootstrap.cc:654] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.105618 30983 tablet_bootstrap.cc:492] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.110746 30983 ts_tablet_manager.cc:1403] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:21:38.107178 30682 catalog_manager.cc:5697] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.116109 30983 raft_consensus.cc:359] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.117067 30983 raft_consensus.cc:385] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.117374 30983 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.118081 30983 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.120455 30983 ts_tablet_manager.cc:1434] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:38.122375 30983 tablet_bootstrap.cc:492] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.122800 30932 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.123888 30979 tablet_bootstrap.cc:492] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.124348 30979 ts_tablet_manager.cc:1403] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.012s
I20260709 12:21:38.135360 30983 tablet_bootstrap.cc:654] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.141901 31015 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.143743 30979 raft_consensus.cc:359] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.144466 30979 raft_consensus.cc:385] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.144733 30979 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.145539 30975 tablet_bootstrap.cc:492] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.145390 30979 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.145998 30975 ts_tablet_manager.cc:1403] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.011s
I20260709 12:21:38.147946 30979 ts_tablet_manager.cc:1434] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:21:38.148895 30979 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.149912 30975 raft_consensus.cc:359] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:38.150578 30975 raft_consensus.cc:385] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.150830 30975 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.151602 30975 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:38.154752 30975 ts_tablet_manager.cc:1434] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:38.155669 30975 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.157061 30979 tablet_bootstrap.cc:654] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.162672 30975 tablet_bootstrap.cc:654] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.163940 30983 tablet_bootstrap.cc:492] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.164441 30983 ts_tablet_manager.cc:1403] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:21:38.171918 30983 raft_consensus.cc:359] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.172914 30983 raft_consensus.cc:385] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.173271 30983 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.175454 30983 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.180523 30983 ts_tablet_manager.cc:1434] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:21:38.181866 30983 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.189261 30979 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.189826 30979 ts_tablet_manager.cc:1403] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.005s
I20260709 12:21:38.190199 30983 tablet_bootstrap.cc:654] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.195559 30979 raft_consensus.cc:359] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.196408 30979 raft_consensus.cc:385] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.196771 30979 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.197526 30979 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.199499 30979 ts_tablet_manager.cc:1434] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:38.200237 30975 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.200768 30975 ts_tablet_manager.cc:1403] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.036s
I20260709 12:21:38.201503 30979 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.203539 30975 raft_consensus.cc:359] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.204244 30975 raft_consensus.cc:385] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.204524 30975 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.205329 30975 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.207489 30979 tablet_bootstrap.cc:654] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.213842 30983 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.214413 30983 ts_tablet_manager.cc:1403] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.000s
I20260709 12:21:38.215200 30975 ts_tablet_manager.cc:1434] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 12:21:38.216223 30975 tablet_bootstrap.cc:492] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.217299 30983 raft_consensus.cc:359] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.218050 30983 raft_consensus.cc:385] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.218287 30983 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.219019 30983 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.219501 31014 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.220042 31014 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.221309 30983 ts_tablet_manager.cc:1434] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:38.222188 30975 tablet_bootstrap.cc:654] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.222285 31014 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.224620 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.225492 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.225929 30983 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
W20260709 12:21:38.227443 30900 leader_election.cc:343] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:38.230679 30899 leader_election.cc:343] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.231343 30899 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:38.232553 30983 tablet_bootstrap.cc:654] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.232883 30979 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.232779 31014 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.233456 30979 ts_tablet_manager.cc:1403] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:21:38.237454 30979 raft_consensus.cc:359] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.237756 31015 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.238270 30979 raft_consensus.cc:385] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.238579 30979 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.239277 30979 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.241400 30979 ts_tablet_manager.cc:1434] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:38.237455 30975 tablet_bootstrap.cc:492] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.247509 30975 ts_tablet_manager.cc:1403] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.008s
I20260709 12:21:38.250276 31015 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.250430 30975 raft_consensus.cc:359] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.251125 30975 raft_consensus.cc:385] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.251410 30975 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.252081 30975 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.254230 30979 tablet_bootstrap.cc:492] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.261540 30979 tablet_bootstrap.cc:654] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.266335 30975 ts_tablet_manager.cc:1434] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:21:38.267500 30975 tablet_bootstrap.cc:492] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.274540 30975 tablet_bootstrap.cc:654] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.280388 30979 tablet_bootstrap.cc:492] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.281082 30979 ts_tablet_manager.cc:1403] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 12:21:38.288790 31014 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.288405 31054 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.289309 31014 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.290905 30979 raft_consensus.cc:359] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.291633 30979 raft_consensus.cc:385] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.291999 30979 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.291543 31014 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.292695 30979 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.288473 31015 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.294553 31015 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:21:38.299350 31015 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.300578 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.303098 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.304404 30859 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:38.303089 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.305902 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.306615 30982 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.306862 30979 ts_tablet_manager.cc:1434] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 12:21:38.303714 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.307777 30979 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.310385 31045 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.310977 31045 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.311444 31045 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.316085 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:38.317337 30784 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:38.307130 30982 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.322696 31054 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.323638 30983 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.324124 30983 ts_tablet_manager.cc:1403] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.098s	user 0.038s	sys 0.033s
I20260709 12:21:38.319243 31015 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.327857 30983 raft_consensus.cc:359] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.329429 30983 raft_consensus.cc:385] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.329707 30983 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.329774 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.330580 30785 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:38.332711 30899 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.333727 31014 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.334141 31014 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.334036 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.334527 31014 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.335353 30900 leader_election.cc:343] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.336704 30982 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.330582 30983 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.339773 30983 ts_tablet_manager.cc:1434] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:21:38.340735 30983 tablet_bootstrap.cc:492] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.343101 31014 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.345314 30975 tablet_bootstrap.cc:492] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.348178 30975 ts_tablet_manager.cc:1403] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.015s
I20260709 12:21:38.351814 31014 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.353051 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.353725 30785 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.348924 31045 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.357080 30975 raft_consensus.cc:359] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.358130 30975 raft_consensus.cc:385] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.358460 30975 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.359174 30975 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.359726 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.360394 30783 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.361559 30975 ts_tablet_manager.cc:1434] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:21:38.361918 30979 tablet_bootstrap.cc:654] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.362689 30975 tablet_bootstrap.cc:492] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.367859 31011 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.368441 31011 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.370111 30975 tablet_bootstrap.cc:654] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.371970 30983 tablet_bootstrap.cc:654] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.374374 30785 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:38.375797 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:38.376219 30899 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.379063 31014 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.379376 31011 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.379580 31014 raft_consensus.cc:697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:38.380950 30979 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.380532 31014 consensus_queue.cc:237] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.381431 30979 ts_tablet_manager.cc:1403] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.074s	user 0.002s	sys 0.008s
I20260709 12:21:38.383199 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.383636 30783 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:38.383922 30859 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:38.384255 30979 raft_consensus.cc:359] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.384964 30979 raft_consensus.cc:385] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.385000 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.385357 30979 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.385740 30934 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:38.386039 30975 tablet_bootstrap.cc:492] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.386549 30975 ts_tablet_manager.cc:1403] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:21:38.389364 30975 raft_consensus.cc:359] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.389786 31015 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.390116 30975 raft_consensus.cc:385] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.390424 30975 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.390266 31015 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.391114 30975 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.392472 31015 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.393116 30983 tablet_bootstrap.cc:492] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.393282 30975 ts_tablet_manager.cc:1434] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:38.393607 30983 ts_tablet_manager.cc:1403] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.004s
I20260709 12:21:38.396870 30975 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.397055 30979 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.393569 30899 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.376665 30860 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.378113 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:38.400486 30900 leader_election.cc:343] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.404621 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.404925 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.405648 30982 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.404433 30983 raft_consensus.cc:359] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.405730 30934 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:38.412760 30979 ts_tablet_manager.cc:1434] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:21:38.410527 31048 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:21:38.415380 30860 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:38.417845 30979 tablet_bootstrap.cc:492] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.406351 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.413793 30975 tablet_bootstrap.cc:654] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.420651 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.421643 31020 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:38.421860 30750 leader_election.cc:343] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.422081 31020 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.422497 31020 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.428781 31020 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.429171 30681 catalog_manager.cc:5697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.413568 30983 raft_consensus.cc:385] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.432217 30983 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.433202 31020 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.374390 31045 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.437376 31020 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.437949 31020 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.438398 31020 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.445960 30982 raft_consensus.cc:697] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:38.447243 30982 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.453274 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:38.454041 30858 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.456559 30983 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.461995 30858 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:38.462544 31020 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.464624 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:38.465258 30932 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.470124 31012 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.470681 31012 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.472653 30979 tablet_bootstrap.cc:654] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.472829 31012 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.471045 30983 ts_tablet_manager.cc:1434] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.002s
I20260709 12:21:38.475364 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.476065 30785 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:38.476280 30975 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.476460 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.476765 30975 ts_tablet_manager.cc:1403] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.021s
I20260709 12:21:38.477644 30825 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.478562 30932 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:38.478672 31054 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.479127 31054 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:21:38.479570 30826 leader_election.cc:343] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.479636 31054 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.480937 30975 raft_consensus.cc:359] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.481695 30975 raft_consensus.cc:385] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.482009 30975 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.483144 30975 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.484695 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.485519 31011 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.486030 31011 raft_consensus.cc:697] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:38.486649 30983 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.486857 31011 consensus_queue.cc:237] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.489167 31054 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.491132 31054 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.491865 30995 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.492401 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.493140 30785 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.493040 31085 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.496440 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:38.492426 30995 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.500046 30995 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.500267 31020 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.502619 30975 ts_tablet_manager.cc:1434] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:21:38.503708 30975 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
W20260709 12:21:38.503862 30826 leader_election.cc:343] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.505537 31054 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.506151 31054 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.507853 30983 tablet_bootstrap.cc:654] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.508353 31054 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.509660 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:38.509660 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.511413 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.511487 30784 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:38.512333 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.513710 30979 tablet_bootstrap.cc:492] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.514219 30979 ts_tablet_manager.cc:1403] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.001s
I20260709 12:21:38.514072 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.514962 30934 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:38.516456 30825 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.517653 31054 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.517598 30979 raft_consensus.cc:359] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.518177 31054 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.518443 30979 raft_consensus.cc:385] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.518599 31054 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.518784 30979 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.519655 30979 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.521303 30979 ts_tablet_manager.cc:1434] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:38.521608 30785 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:38.522998 30825 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:38.523841 31012 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.524348 31012 raft_consensus.cc:697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:38.524943 30983 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.525456 30983 ts_tablet_manager.cc:1403] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.006s
I20260709 12:21:38.525216 31012 consensus_queue.cc:237] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.526785 30975 tablet_bootstrap.cc:654] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.527652 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:38.528245 30934 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.528568 30983 raft_consensus.cc:359] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.529102 30979 tablet_bootstrap.cc:492] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.529289 30983 raft_consensus.cc:385] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.529661 30983 raft_consensus.cc:740] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.530424 30983 consensus_queue.cc:260] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.532809 30983 ts_tablet_manager.cc:1434] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:38.533917 30983 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.535617 30979 tablet_bootstrap.cc:654] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.540269 30983 tablet_bootstrap.cc:654] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.545872 30979 tablet_bootstrap.cc:492] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.546514 30979 ts_tablet_manager.cc:1403] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:21:38.549296 30681 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.552793 30975 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.553408 30975 ts_tablet_manager.cc:1403] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.001s
I20260709 12:21:38.557255 30975 raft_consensus.cc:359] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.558221 30975 raft_consensus.cc:385] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.558581 30975 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.559173 31055 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.559463 30975 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.559826 31055 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.562405 30979 raft_consensus.cc:359] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.563405 30979 raft_consensus.cc:385] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.563761 30979 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.563992 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.564703 30785 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:38.564962 30979 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.566107 30825 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.567054 31008 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.567215 30975 ts_tablet_manager.cc:1434] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:38.567473 31008 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.567926 31008 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.568532 30975 tablet_bootstrap.cc:492] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.572952 30785 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.575307 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.576049 30935 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:38.576426 30979 ts_tablet_manager.cc:1434] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:21:38.577131 30983 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.577647 30979 tablet_bootstrap.cc:492] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.577666 30983 ts_tablet_manager.cc:1403] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.026s
I20260709 12:21:38.562402 31055 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.581266 30983 raft_consensus.cc:359] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.582297 30983 raft_consensus.cc:385] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.582803 30983 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
W20260709 12:21:38.583905 30750 leader_election.cc:343] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:38.585052 30750 leader_election.cc:343] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.586477 30934 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:38.586723 31054 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.591849 30975 tablet_bootstrap.cc:654] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.592212 30983 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:38.598927 30750 leader_election.cc:343] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.605860 31008 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.608310 31008 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.609746 31054 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.605665 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:38.612694 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.613319 30784 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.613874 31020 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.615106 30679 catalog_manager.cc:5697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.616209 30979 tablet_bootstrap.cc:654] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.611891 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:38.618147 30932 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.619453 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:38.609886 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.621353 30783 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.621898 30934 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.627406 30784 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:38.629179 30983 ts_tablet_manager.cc:1434] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:21:38.628908 30825 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.630292 31009 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.610409 30681 catalog_manager.cc:5697] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.630668 30983 tablet_bootstrap.cc:492] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.639344 30783 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:38.641048 30825 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.642307 31054 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.642939 31054 raft_consensus.cc:697] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:38.643987 31054 consensus_queue.cc:237] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.630961 31009 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:38.646826 31009 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.652215 30982 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.633049 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:38.652786 30982 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.653885 30995 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.654418 30995 raft_consensus.cc:697] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:38.655088 30982 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.655292 30995 consensus_queue.cc:237] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.656183 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.656837 30784 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:38.658150 30899 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.659691 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.660358 30860 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:38.662369 30982 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.662791 30982 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.663115 30982 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.667788 30932 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:38.680197 30975 tablet_bootstrap.cc:492] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.680753 30975 ts_tablet_manager.cc:1403] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.005s
I20260709 12:21:38.683569 30975 raft_consensus.cc:359] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.684279 30975 raft_consensus.cc:385] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.684579 30975 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.685386 30975 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.687808 30975 ts_tablet_manager.cc:1434] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:38.688784 30975 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.693331 30983 tablet_bootstrap.cc:654] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.673230 30982 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.695060 30934 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:38.700840 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.701962 30979 tablet_bootstrap.cc:492] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:38.702191 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:38.699828 30982 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.702828 30860 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.701478 30783 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.702445 30979 ts_tablet_manager.cc:1403] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.125s	user 0.032s	sys 0.020s
I20260709 12:21:38.707393 30681 catalog_manager.cc:5697] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.714594 30783 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:38.716477 31085 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.716499 30899 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.717134 31085 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.716398 30860 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:38.719063 31048 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.720249 31085 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.720520 31048 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:38.721853 31048 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.724972 30979 raft_consensus.cc:359] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.725730 30979 raft_consensus.cc:385] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.726075 30979 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.726326 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.726790 30979 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:38.730368 30899 leader_election.cc:343] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.729699 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.731630 30979 ts_tablet_manager.cc:1434] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:21:38.731379 30860 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:38.736078 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:38.736902 31085 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.737279 31085 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.737622 31085 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.722180 30679 catalog_manager.cc:5697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.739914 30975 tablet_bootstrap.cc:654] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.739527 30679 catalog_manager.cc:5697] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.743050 30983 tablet_bootstrap.cc:492] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.743660 30983 ts_tablet_manager.cc:1403] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.013s
I20260709 12:21:38.744277 30979 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.746703 30983 raft_consensus.cc:359] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.746959 31085 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.747500 30983 raft_consensus.cc:385] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.747918 30983 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.749219 31085 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.748790 30983 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.750056 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.750362 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:38.751250 30860 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.751438 30899 leader_election.cc:343] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.752272 30983 ts_tablet_manager.cc:1434] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:21:38.753275 30983 tablet_bootstrap.cc:492] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.753443 31054 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.754220 30975 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.754680 30975 ts_tablet_manager.cc:1403] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.006s
I20260709 12:21:38.757383 30975 raft_consensus.cc:359] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.758136 30975 raft_consensus.cc:385] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.758476 30975 raft_consensus.cc:740] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.759438 30975 consensus_queue.cc:260] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.761668 30983 tablet_bootstrap.cc:654] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.753933 31054 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.765426 30975 ts_tablet_manager.cc:1434] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:21:38.765780 31054 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.766458 30975 tablet_bootstrap.cc:492] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.767598 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.768303 30783 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:38.777861 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.779685 30825 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:38.781035 30979 tablet_bootstrap.cc:654] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.782407 30681 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.783923 30975 tablet_bootstrap.cc:654] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.785388 31054 raft_consensus.cc:2804] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.785816 31054 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.786283 31054 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.790555 30826 leader_election.cc:343] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.808384 31048 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.820894 30860 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:38.829433 30979 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
W20260709 12:21:38.829660 30900 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:38.829994 30979 ts_tablet_manager.cc:1403] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.086s	user 0.022s	sys 0.018s
I20260709 12:21:38.832398 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:38.829013 31054 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.833146 30975 tablet_bootstrap.cc:492] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.833609 31048 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.833886 30975 ts_tablet_manager.cc:1403] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.067s	user 0.034s	sys 0.012s
I20260709 12:21:38.834187 31048 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:38.835035 31048 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.836654 31054 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.836683 30975 raft_consensus.cc:359] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.837493 30975 raft_consensus.cc:385] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.837819 30975 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.838636 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.839258 30785 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.840343 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:21:38.842285 30826 leader_election.cc:343] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.846272 30983 tablet_bootstrap.cc:492] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.847137 30983 ts_tablet_manager.cc:1403] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.094s	user 0.037s	sys 0.024s
I20260709 12:21:38.846239 30785 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:38.845321 30979 raft_consensus.cc:359] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.849814 30979 raft_consensus.cc:385] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.849566 30825 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:38.850126 30979 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.851092 31054 raft_consensus.cc:2804] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.851630 31054 raft_consensus.cc:697] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:38.852051 30975 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.852383 31054 consensus_queue.cc:237] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.853585 30983 raft_consensus.cc:359] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.854306 30975 ts_tablet_manager.cc:1434] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:21:38.854354 30983 raft_consensus.cc:385] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.854904 30983 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.855360 30975 tablet_bootstrap.cc:492] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.856304 30979 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.856611 31085 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.855898 30983 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.858819 30979 ts_tablet_manager.cc:1434] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:21:38.859813 30979 tablet_bootstrap.cc:492] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:38.860296 30983 ts_tablet_manager.cc:1434] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:38.861527 30983 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.861968 30975 tablet_bootstrap.cc:654] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.874559 30983 tablet_bootstrap.cc:654] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.878624 31085 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.886171 31045 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.886987 31045 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.888103 30679 catalog_manager.cc:5697] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.889462 30681 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.891327 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.892303 30785 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:38.894135 31045 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.898691 30899 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.886370 31085 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.899523 31045 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.899940 31045 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.901144 31085 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.901177 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.900321 31045 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.904206 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:38.904373 30900 leader_election.cc:343] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.906966 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:38.907860 30785 raft_consensus.cc:2393] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:21:38.909183 30899 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:38.912410 31085 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.923223 31085 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:38.932029 30995 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.932859 30995 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.934588 30979 tablet_bootstrap.cc:654] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:38.931622 31045 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.938259 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:38.938373 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:38.939245 30785 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:38.940405 30750 leader_election.cc:343] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.946883 30995 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.948097 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:38.948146 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:38.948988 30934 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
W20260709 12:21:38.949869 30900 leader_election.cc:343] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:38.950304 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:38.949920 30785 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:38.951702 30995 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:38.951815 31045 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:38.952164 30995 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:38.952589 30995 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.952675 30899 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:38.954028 31045 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.954852 31045 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:38.955794 31045 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.961244 30995 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.963528 30975 tablet_bootstrap.cc:492] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:38.964120 30975 ts_tablet_manager.cc:1403] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.109s	user 0.002s	sys 0.013s
I20260709 12:21:38.966800 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:38.967232 30983 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:38.967516 30934 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.967895 30983 ts_tablet_manager.cc:1403] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.014s
I20260709 12:21:38.968804 30975 raft_consensus.cc:359] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.969544 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:38.969789 30975 raft_consensus.cc:385] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.970223 30975 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.974356 30983 raft_consensus.cc:359] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.975838 30983 raft_consensus.cc:385] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:38.976238 30983 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:38.963533 30995 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:38.977283 30983 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.978331 30975 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.979571 30858 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:38.981035 30975 ts_tablet_manager.cc:1434] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:21:38.982194 30934 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:38.982421 30975 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:38.982775 30681 catalog_manager.cc:5697] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:38.988564 30983 ts_tablet_manager.cc:1434] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:21:38.989070 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:38.989610 30983 tablet_bootstrap.cc:492] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:38.990697 31011 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:38.991183 31011 raft_consensus.cc:697] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:38.991864 31054 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:38.992060 31011 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:38.992383 31054 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.000578 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.004654 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:39.005615 30934 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:39.007009 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:39.008445 31009 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.011842 31054 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.022383 30979 tablet_bootstrap.cc:492] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:39.022917 30979 ts_tablet_manager.cc:1403] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.163s	user 0.018s	sys 0.015s
I20260709 12:21:39.024797 31015 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.025709 31015 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.027676 31045 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:39.036269 31009 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.032217 30858 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:39.036875 30681 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.039515 30983 tablet_bootstrap.cc:654] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.037293 31015 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.042505 31009 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:21:39.050077 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:39.054116 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:21:39.054790 30750 leader_election.cc:343] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.054808 30932 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:39.056018 30979 raft_consensus.cc:359] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.060735 30979 raft_consensus.cc:385] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.062135 30979 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.061199 31015 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.060987 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.070144 31011 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.070698 31011 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.069410 30979 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.071108 31011 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.081163 30979 ts_tablet_manager.cc:1434] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 12:21:39.081408 31020 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.081980 31020 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.084044 31020 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.086968 31054 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.088415 31011 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.090742 31011 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.083985 30979 tablet_bootstrap.cc:492] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:39.102223 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:39.107961 31015 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.108755 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:39.109370 30932 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.110507 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:39.108186 30750 leader_election.cc:343] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.112807 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:39.114478 30750 leader_election.cc:343] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:39.120435 30750 leader_election.cc:343] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.122743 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.123601 31015 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.131623 30975 tablet_bootstrap.cc:654] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.118086 31054 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:21:39.134330 30983 tablet_bootstrap.cc:492] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.134703 30983 ts_tablet_manager.cc:1403] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.018s
I20260709 12:21:39.146975 30979 tablet_bootstrap.cc:654] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.148878 31055 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.149936 30932 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:39.149751 30983 raft_consensus.cc:359] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.150512 30983 raft_consensus.cc:385] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.151152 30983 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.155100 30983 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.157958 30983 ts_tablet_manager.cc:1434] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:21:39.158913 30983 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.164829 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:21:39.172329 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:39.176421 31015 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.177012 31015 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:39.178071 31015 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.183620 30983 tablet_bootstrap.cc:654] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.191465 30975 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.196810 30979 tablet_bootstrap.cc:492] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:39.197340 30979 ts_tablet_manager.cc:1403] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.114s	user 0.011s	sys 0.002s
I20260709 12:21:39.211656 30979 raft_consensus.cc:359] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.212231 30979 raft_consensus.cc:385] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.212329 30975 ts_tablet_manager.cc:1403] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.230s	user 0.016s	sys 0.001s
I20260709 12:21:39.212545 30979 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.213654 30979 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.216282 30979 ts_tablet_manager.cc:1434] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:21:39.215952 30975 raft_consensus.cc:359] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.216809 30975 raft_consensus.cc:385] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.217079 30975 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.217850 30979 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:39.217907 30975 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.212473 31054 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:21:39.220387 30975 ts_tablet_manager.cc:1434] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:39.221340 30975 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.222374 31009 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.223047 31009 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.226791 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.227095 31009 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.227511 30783 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:39.229022 30825 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:39.230158 31009 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.230695 31009 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.232264 31009 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.233796 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:39.234724 30932 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:39.236593 30979 tablet_bootstrap.cc:654] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.230309 30975 tablet_bootstrap.cc:654] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.240869 31009 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.244223 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:39.244845 30783 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.248728 31048 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.249377 31054 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.249935 31054 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.252051 31054 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.255095 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.258911 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:39.262777 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:39.257274 30681 catalog_manager.cc:5697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.267649 30783 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:39.269279 30825 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:39.270958 31009 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.272784 31054 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.274124 31054 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.274537 30975 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.274614 31054 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:39.275105 30975 ts_tablet_manager.cc:1403] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.000s
I20260709 12:21:39.275609 31054 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.277659 31015 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.276741 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:39.280383 30932 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.285697 31011 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.286713 31009 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.287402 30975 raft_consensus.cc:359] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.288368 30975 raft_consensus.cc:385] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.288703 30975 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.290751 30975 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.292693 30975 ts_tablet_manager.cc:1434] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:21:39.295303 30975 tablet_bootstrap.cc:492] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.297523 30983 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.298458 30983 ts_tablet_manager.cc:1403] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.140s	user 0.032s	sys 0.041s
I20260709 12:21:39.323278 30979 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:39.323443 30975 tablet_bootstrap.cc:654] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.323813 30979 ts_tablet_manager.cc:1403] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.006s
I20260709 12:21:39.324838 30982 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.334460 30983 raft_consensus.cc:359] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.335263 30983 raft_consensus.cc:385] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.335701 30983 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.336848 30983 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.344324 30983 ts_tablet_manager.cc:1434] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:21:39.345381 30983 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.349361 31009 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.349936 31009 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.353528 30681 catalog_manager.cc:5697] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.370242 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.362385 30932 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
W20260709 12:21:39.386284 30825 leader_election.cc:343] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.392264 31009 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.395349 30782 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.397608 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:21:39.401161 30826 leader_election.cc:343] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.401643 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:39.402694 31009 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.406464 30979 raft_consensus.cc:359] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.406811 30982 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.407234 30979 raft_consensus.cc:385] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.407557 30979 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.408296 30979 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.410957 31132 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.413009 31048 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.413569 31048 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.415752 31048 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:39.416726 31009 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.417354 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:39.418129 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:39.418756 30900 leader_election.cc:343] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.418763 30783 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:39.420980 30899 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.422820 30982 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.423296 30982 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.423753 30982 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.426239 30979 ts_tablet_manager.cc:1434] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.001s
I20260709 12:21:39.427287 30979 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:39.473109 30975 tablet_bootstrap.cc:492] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.473831 30975 ts_tablet_manager.cc:1403] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.012s
I20260709 12:21:39.477176 31045 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.479359 30982 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.483675 30860 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:39.485113 30826 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.485378 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:39.486583 30900 leader_election.cc:343] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.482445 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:39.488142 30783 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.494453 30979 tablet_bootstrap.cc:654] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.481633 30982 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:39.495220 30975 raft_consensus.cc:359] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.497077 30975 raft_consensus.cc:385] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.498407 30975 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.502496 30975 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.507628 30975 ts_tablet_manager.cc:1434] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:21:39.509584 30983 tablet_bootstrap.cc:654] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:39.512418 30900 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.510979 30975 tablet_bootstrap.cc:492] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.526983 31048 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:39.536145 30983 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.536702 30983 ts_tablet_manager.cc:1403] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.192s	user 0.011s	sys 0.002s
I20260709 12:21:39.545149 30979 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:39.545575 30979 ts_tablet_manager.cc:1403] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.008s
I20260709 12:21:39.546176 31015 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.546685 31015 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.548780 31015 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.554323 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:39.555051 30934 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:39.557044 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:39.558156 30983 raft_consensus.cc:359] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.558730 30983 raft_consensus.cc:385] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.559024 30983 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.559792 30783 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:39.559724 30983 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.561434 30983 ts_tablet_manager.cc:1434] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 12:21:39.561249 30899 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.561913 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:39.562767 30982 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.563184 31132 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.563594 31132 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.563476 30982 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:39.564083 31132 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:39.566833 30750 leader_election.cc:343] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.567219 30982 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.571430 30983 tablet_bootstrap.cc:492] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.577054 31015 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:39.581686 31015 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.585386 30979 raft_consensus.cc:359] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.586438 30979 raft_consensus.cc:385] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.586980 30979 raft_consensus.cc:740] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.588060 30979 consensus_queue.cc:260] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.591686 30975 tablet_bootstrap.cc:654] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.610934 31132 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.612547 30682 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:39.621207 31132 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.628338 30979 ts_tablet_manager.cc:1434] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 12:21:39.629659 30979 tablet_bootstrap.cc:492] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:39.630795 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:39.631688 30933 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.632776 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:39.634768 30750 leader_election.cc:343] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.637118 30983 tablet_bootstrap.cc:654] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:39.643249 30750 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:39.656852 30933 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:39.691049 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.691985 31132 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.692672 31132 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:39.693471 31132 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.704638 30983 tablet_bootstrap.cc:492] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.705139 30983 ts_tablet_manager.cc:1403] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.136s	user 0.037s	sys 0.051s
I20260709 12:21:39.707901 30983 raft_consensus.cc:359] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.708734 30983 raft_consensus.cc:385] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.709033 30983 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.711437 30975 tablet_bootstrap.cc:492] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.711933 30975 ts_tablet_manager.cc:1403] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.204s	user 0.016s	sys 0.012s
I20260709 12:21:39.709651 30983 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.714392 30975 raft_consensus.cc:359] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.715065 30975 raft_consensus.cc:385] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.715314 30975 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.716130 30983 ts_tablet_manager.cc:1434] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:21:39.715938 30975 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.717088 30983 tablet_bootstrap.cc:492] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.722836 30979 tablet_bootstrap.cc:654] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.729545 30983 tablet_bootstrap.cc:654] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.729605 30975 ts_tablet_manager.cc:1434] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:21:39.730840 30975 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.734596 30979 tablet_bootstrap.cc:492] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:39.743256 31054 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.743932 30975 tablet_bootstrap.cc:654] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.743244 30979 ts_tablet_manager.cc:1403] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.007s
I20260709 12:21:39.749194 30979 raft_consensus.cc:359] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.750160 30979 raft_consensus.cc:385] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.750522 30979 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.751559 30979 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.768151 31055 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:39.770375 31085 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.770929 31085 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.774374 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.776820 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:39.777189 30979 ts_tablet_manager.cc:1434] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:21:39.778270 30979 tablet_bootstrap.cc:492] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:39.778899 31085 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:39.782711 30900 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.784916 30975 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.788403 30983 tablet_bootstrap.cc:492] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.791790 30975 ts_tablet_manager.cc:1403] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.006s
I20260709 12:21:39.792583 30983 ts_tablet_manager.cc:1403] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.006s
I20260709 12:21:39.794544 31085 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.794843 30975 raft_consensus.cc:359] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.795547 30975 raft_consensus.cc:385] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.795812 30975 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.783349 30680 catalog_manager.cc:5697] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:39.796731 30975 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.798909 30975 ts_tablet_manager.cc:1434] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:39.799831 30975 tablet_bootstrap.cc:492] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.803717 30979 tablet_bootstrap.cc:654] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.795826 30983 raft_consensus.cc:359] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.806524 30983 raft_consensus.cc:385] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.806809 30983 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.807741 30983 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.810053 30983 ts_tablet_manager.cc:1434] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:21:39.810670 30975 tablet_bootstrap.cc:654] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.814406 30983 tablet_bootstrap.cc:492] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.820228 30983 tablet_bootstrap.cc:654] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.824683 30975 tablet_bootstrap.cc:492] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.825678 30975 ts_tablet_manager.cc:1403] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 12:21:39.828300 30975 raft_consensus.cc:359] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.828994 30975 raft_consensus.cc:385] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.829283 30975 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.829959 30975 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.831907 30975 ts_tablet_manager.cc:1434] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:39.832671 30979 tablet_bootstrap.cc:492] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:39.832749 30975 tablet_bootstrap.cc:492] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.833196 30979 ts_tablet_manager.cc:1403] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.007s
I20260709 12:21:39.835943 30983 tablet_bootstrap.cc:492] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.836402 30983 ts_tablet_manager.cc:1403] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:21:39.839064 30983 raft_consensus.cc:359] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.839764 30983 raft_consensus.cc:385] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.839548 30979 raft_consensus.cc:359] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.840088 30983 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.840317 30979 raft_consensus.cc:385] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.840646 30979 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.840777 30983 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.841424 30979 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.843238 30983 ts_tablet_manager.cc:1434] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:39.844194 30983 tablet_bootstrap.cc:492] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.847492 30975 tablet_bootstrap.cc:654] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.850883 30983 tablet_bootstrap.cc:654] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.851830 30979 ts_tablet_manager.cc:1434] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:39.852830 30979 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:39.858879 30979 tablet_bootstrap.cc:654] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.860242 30983 tablet_bootstrap.cc:492] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.860769 30983 ts_tablet_manager.cc:1403] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:21:39.863637 30983 raft_consensus.cc:359] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.864375 30983 raft_consensus.cc:385] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.864670 30983 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.867100 30975 tablet_bootstrap.cc:492] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.867616 30975 ts_tablet_manager.cc:1403] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 12:21:39.868137 30983 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.870652 30983 ts_tablet_manager.cc:1434] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:21:39.870256 30975 raft_consensus.cc:359] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.871119 30975 raft_consensus.cc:385] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.871403 30975 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.871892 30983 tablet_bootstrap.cc:492] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.872040 30975 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.872573 31054 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.873096 31054 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.874154 30975 ts_tablet_manager.cc:1434] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:39.875196 30975 tablet_bootstrap.cc:492] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.875259 31054 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.879405 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:39.879794 30983 tablet_bootstrap.cc:654] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.881166 31132 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.881659 31132 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.882725 30975 tablet_bootstrap.cc:654] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.883836 31132 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.885967 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.888260 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:39.888789 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:39.889410 30935 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
W20260709 12:21:39.889858 30750 leader_election.cc:343] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.890137 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:39.894942 31146 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:39.896239 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.897360 31132 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:39.897740 31132 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:39.898099 31132 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.908644 31132 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.911813 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:39.913023 30979 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
W20260709 12:21:39.913208 30750 leader_election.cc:343] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:39.914031 30979 ts_tablet_manager.cc:1403] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.007s
I20260709 12:21:39.915446 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:39.916040 30935 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.917925 31132 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.918169 30979 raft_consensus.cc:359] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.919162 30979 raft_consensus.cc:385] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.919538 30979 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.921047 30979 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.922135 30983 tablet_bootstrap.cc:492] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.922150 30975 tablet_bootstrap.cc:492] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.922736 30983 ts_tablet_manager.cc:1403] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.051s	user 0.027s	sys 0.012s
I20260709 12:21:39.922866 30975 ts_tablet_manager.cc:1403] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.024s
I20260709 12:21:39.922941 30935 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:39.924264 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:39.925349 31132 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:39.925595 30983 raft_consensus.cc:359] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.925859 30975 raft_consensus.cc:359] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.926410 30983 raft_consensus.cc:385] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.925884 31132 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:39.926729 30975 raft_consensus.cc:385] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.926769 30983 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.927287 30975 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.927448 31132 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.927721 30983 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.928040 30975 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.930279 30975 ts_tablet_manager.cc:1434] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:39.930429 30983 ts_tablet_manager.cc:1434] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:21:39.931327 30975 tablet_bootstrap.cc:492] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:39.931787 30983 tablet_bootstrap.cc:492] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.932783 30979 ts_tablet_manager.cc:1434] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:21:39.938143 30983 tablet_bootstrap.cc:654] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.938877 30975 tablet_bootstrap.cc:654] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.940799 30858 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.950255 30983 tablet_bootstrap.cc:492] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:39.950891 30983 ts_tablet_manager.cc:1403] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:21:39.955291 30983 raft_consensus.cc:359] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.956102 30983 raft_consensus.cc:385] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.956406 30983 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.957252 30975 tablet_bootstrap.cc:492] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:39.957208 30983 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.957887 30975 ts_tablet_manager.cc:1403] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.007s
I20260709 12:21:39.959654 30983 ts_tablet_manager.cc:1434] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:39.960845 30983 tablet_bootstrap.cc:492] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:39.960685 30975 raft_consensus.cc:359] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.961496 30975 raft_consensus.cc:385] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:39.961843 30975 raft_consensus.cc:740] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:39.962713 30975 consensus_queue.cc:260] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.964699 30979 tablet_bootstrap.cc:492] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:39.965412 31146 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:39.967381 31146 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.972915 31146 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:39.973953 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.974884 30785 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:21:39.981467 30983 tablet_bootstrap.cc:654] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:39.986922 30975 ts_tablet_manager.cc:1434] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.004s
I20260709 12:21:40.065181 31156 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.033676 31015 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.069929 30975 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:40.070075 31048 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.070210 31015 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.070621 31048 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.065212 30859 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:39.990319 31020 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.069947 31156 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:39.983476 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.078699 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:40.083177 30979 tablet_bootstrap.cc:654] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.073323 31020 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.083971 30935 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.083926 31015 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.086823 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.087400 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.098191 30785 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:40.089294 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:39.996829 31085 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.085s
I20260709 12:21:40.092151 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.093856 31156 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:40.090520 30682 catalog_manager.cc:5697] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.089437 30826 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:40.079025 31048 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:21:40.100854 30750 leader_election.cc:343] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.113628 30983 tablet_bootstrap.cc:492] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:40.115188 30983 ts_tablet_manager.cc:1403] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.155s	user 0.029s	sys 0.016s
I20260709 12:21:40.103868 30783 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:40.105726 31054 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.118332 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.120040 30858 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:40.101740 31020 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.112429 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:21:40.110632 30750 leader_election.cc:343] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.111701 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.138645 30860 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:40.139397 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:40.140985 31015 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.126888 31020 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.156332 31020 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.103507 30899 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:21:40.158674 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 55260.1us
I20260709 12:21:40.159248 31085 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.158722 31020 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:40.172909 30900 leader_election.cc:343] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.180706 31146 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:21:40.195170 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.159866 30899 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:40.192516 31011 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.238159 30979 tablet_bootstrap.cc:492] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:40.237665 31011 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.238819 30979 ts_tablet_manager.cc:1403] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.283s	user 0.014s	sys 0.008s
I20260709 12:21:40.192909 31085 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.240942 31085 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.200800 31146 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:40.207333 30750 leader_election.cc:343] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.247681 31085 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.249253 31085 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:40.250180 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:40.251701 31011 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.251749 31020 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.252514 31020 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.252871 31020 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:40.210505 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 105156us
I20260709 12:21:40.219084 30983 raft_consensus.cc:359] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.221835 31054 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.226714 30975 tablet_bootstrap.cc:654] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:40.232475 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:40.255378 30983 raft_consensus.cc:385] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.257480 30983 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.272439 30979 raft_consensus.cc:359] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.273281 30979 raft_consensus.cc:385] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.273626 30979 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.257295 31055 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.274485 30979 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.273176 30983 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:40.272440 30750 leader_election.cc:343] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.275028 31054 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.277576 31146 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:40.267804 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 108043us
I20260709 12:21:40.278640 30979 ts_tablet_manager.cc:1434] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:21:40.273296 31085 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.279690 31145 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.288203 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.289460 30979 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:40.274525 31055 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.282011 31085 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.281111 31054 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.290972 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.307495 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:40.295837 31085 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.318339 30975 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:40.318954 30975 ts_tablet_manager.cc:1403] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.251s	user 0.016s	sys 0.004s
I20260709 12:21:40.310994 30857 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.290807 31145 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.321126 31055 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.331033 31054 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.337467 31085 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.339622 31085 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:40.340505 30975 raft_consensus.cc:359] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.341252 30975 raft_consensus.cc:385] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.341544 30975 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.342350 30975 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.327260 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:40.343338 30785 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.352809 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.358248 30983 ts_tablet_manager.cc:1434] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.243s	user 0.014s	sys 0.007s
I20260709 12:21:40.359272 30983 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:40.359992 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.360872 30935 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:40.361066 31020 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.363970 30975 ts_tablet_manager.cc:1434] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:21:40.364826 30975 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
W20260709 12:21:40.355304 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62987.3us
I20260709 12:21:40.368855 31015 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:40.370194 30750 leader_election.cc:343] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.379040 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:40.379684 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:40.380888 30783 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.383333 31145 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.386339 31020 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.387789 30979 tablet_bootstrap.cc:654] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.387687 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:40.388989 30783 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:40.391181 30785 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:40.394795 30932 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.406464 30899 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:40.404348 30825 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:40.408895 31054 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:40.414160 31190 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.419582 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.420463 30933 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:40.421201 30899 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:40.425247 31048 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.425817 31048 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:40.422602 31190 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:40.429378 31190 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.429608 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:40.430881 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:40.429651 30750 leader_election.cc:343] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.432353 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:40.426653 31048 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.434605 30932 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:40.435837 31020 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.439991 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:40.440809 31020 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.441238 30983 tablet_bootstrap.cc:654] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.443923 31020 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:40.446090 31020 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:40.453536 30900 leader_election.cc:343] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.456629 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.459760 30975 tablet_bootstrap.cc:654] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.463011 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.464484 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:40.465168 30784 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:40.476761 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:40.479360 30859 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.473142 31011 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:40.483122 30860 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.487349 30859 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:40.490365 31132 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.501181 31085 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:40.506472 30750 leader_election.cc:343] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.507321 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:40.528578 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:40.534868 30825 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:40.538579 30859 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.539552 30825 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:40.528851 31020 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.541354 31054 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.564272 30679 catalog_manager.cc:5697] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:40.566352 30826 leader_election.cc:343] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.568607 31132 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.569227 31132 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.571231 31145 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.574714 30979 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:40.568511 30679 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:40.575606 30979 ts_tablet_manager.cc:1403] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.286s	user 0.033s	sys 0.043s
I20260709 12:21:40.576803 31132 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:40.582340 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 75914us
I20260709 12:21:40.590437 30975 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:40.590978 30975 ts_tablet_manager.cc:1403] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.001s
I20260709 12:21:40.591843 30979 raft_consensus.cc:359] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.595235 30979 raft_consensus.cc:385] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.595568 30979 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.596213 30979 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.600912 30979 ts_tablet_manager.cc:1434] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:21:40.606721 30983 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:40.607234 30983 ts_tablet_manager.cc:1403] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.248s	user 0.025s	sys 0.009s
I20260709 12:21:40.613099 30975 raft_consensus.cc:359] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.613919 30975 raft_consensus.cc:385] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.614368 30975 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.615091 30975 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.617602 30975 ts_tablet_manager.cc:1434] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:21:40.618700 30975 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:40.621541 30979 tablet_bootstrap.cc:492] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:40.627195 30682 catalog_manager.cc:5697] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.633692 30983 raft_consensus.cc:359] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.635581 30983 raft_consensus.cc:385] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.636063 30983 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.609372 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:40.639539 30983 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.631996 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.645190 30983 ts_tablet_manager.cc:1434] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.004s
I20260709 12:21:40.648204 30859 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
W20260709 12:21:40.650815 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 51684.8us
I20260709 12:21:40.652299 31204 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.654390 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.655084 30859 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:40.643440 31146 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.644691 30932 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:40.667735 31146 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.668179 31146 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.668979 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:40.671145 30983 tablet_bootstrap.cc:492] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:40.677788 31011 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:40.679391 31011 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:40.682597 31011 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:40.685086 31197 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:21:40.692227 31201 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:21:40.712589 30979 tablet_bootstrap.cc:654] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.722440 31202 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.719453 31011 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.725895 31202 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.725335 30975 tablet_bootstrap.cc:654] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.731561 30979 tablet_bootstrap.cc:492] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:40.732128 30979 ts_tablet_manager.cc:1403] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.005s
I20260709 12:21:40.733107 30983 tablet_bootstrap.cc:654] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.729501 31146 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.740661 30979 raft_consensus.cc:359] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.741504 30979 raft_consensus.cc:385] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.742540 30979 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.743462 30979 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.745180 31187 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.745747 31187 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.746917 31202 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.747044 31011 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.745179 30979 ts_tablet_manager.cc:1434] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:21:40.748757 31187 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.749874 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.752979 31146 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.754058 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:40.754830 30935 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.756589 30979 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:40.763422 30935 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:40.764266 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:40.764667 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:40.765128 30784 raft_consensus.cc:2393] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:21:40.765648 31146 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.766343 31146 raft_consensus.cc:697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:40.766837 30983 tablet_bootstrap.cc:492] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:40.767377 31146 consensus_queue.cc:237] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.769749 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:40.770414 30784 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.767421 30983 ts_tablet_manager.cc:1403] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.004s
I20260709 12:21:40.778816 30784 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:40.783604 30979 tablet_bootstrap.cc:654] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.775871 30983 raft_consensus.cc:359] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.786834 30983 raft_consensus.cc:385] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.787264 30983 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
W20260709 12:21:40.788200 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 67870.8us
I20260709 12:21:40.788014 30983 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.791153 30825 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:40.791955 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.792081 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:40.792830 30932 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.789654 30983 ts_tablet_manager.cc:1434] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
W20260709 12:21:40.796814 30750 leader_election.cc:343] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.799062 31187 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.802198 30983 tablet_bootstrap.cc:492] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:40.807134 30979 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:40.807643 30979 ts_tablet_manager.cc:1403] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.005s
I20260709 12:21:40.809633 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:40.810279 30859 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:40.814587 31187 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.817637 30932 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:40.817795 30859 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:40.819779 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:40.820807 31212 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:40.821266 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:40.821326 31212 raft_consensus.cc:697] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:40.822412 31212 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.827200 30979 raft_consensus.cc:359] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.827975 30979 raft_consensus.cc:385] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.828270 30979 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.828799 30975 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:40.829282 30975 ts_tablet_manager.cc:1403] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.009s
W20260709 12:21:40.830070 30750 leader_election.cc:343] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.833552 30750 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:40.830394 30979 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.835208 31011 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.836237 30975 raft_consensus.cc:359] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.836979 30975 raft_consensus.cc:385] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.837284 30975 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.832235 30983 tablet_bootstrap.cc:654] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.837389 30979 ts_tablet_manager.cc:1434] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:21:40.838011 30975 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.838956 30979 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:40.840214 30975 ts_tablet_manager.cc:1434] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:21:40.830659 30682 catalog_manager.cc:5697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.843132 30983 tablet_bootstrap.cc:492] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:40.843606 30983 ts_tablet_manager.cc:1403] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 12:21:40.845928 30975 tablet_bootstrap.cc:492] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:40.846217 30983 raft_consensus.cc:359] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.846863 30983 raft_consensus.cc:385] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.847134 30983 raft_consensus.cc:740] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.847889 30983 consensus_queue.cc:260] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.850215 30983 ts_tablet_manager.cc:1434] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:21:40.852582 30975 tablet_bootstrap.cc:654] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.853859 30983 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:40.858018 31190 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.863091 30983 tablet_bootstrap.cc:654] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.868753 30681 catalog_manager.cc:5697] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:40.874742 31212 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.875353 31212 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.877313 30983 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:40.877534 31212 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:40.877874 30983 ts_tablet_manager.cc:1403] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 12:21:40.878057 30979 tablet_bootstrap.cc:654] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.879328 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:40.880821 30750 leader_election.cc:343] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.880827 30983 raft_consensus.cc:359] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.881698 30983 raft_consensus.cc:385] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.882091 30983 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.882994 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:40.883231 30983 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:40.885250 30750 leader_election.cc:343] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:40.885636 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:40.886610 31212 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:40.886720 30983 ts_tablet_manager.cc:1434] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:40.889396 31191 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.899482 30975 tablet_bootstrap.cc:492] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:40.900070 30975 ts_tablet_manager.cc:1403] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.016s
I20260709 12:21:40.906591 30975 raft_consensus.cc:359] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.907364 30975 raft_consensus.cc:385] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.907687 30975 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.908414 30975 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.914706 31048 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:40.916198 30975 ts_tablet_manager.cc:1434] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 12:21:40.917455 30975 tablet_bootstrap.cc:492] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:40.918694 30979 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:40.919188 30979 ts_tablet_manager.cc:1403] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.010s
I20260709 12:21:40.920959 30983 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:40.921967 30979 raft_consensus.cc:359] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.922660 30979 raft_consensus.cc:385] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.922925 30979 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.923473 30975 tablet_bootstrap.cc:654] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.923720 30979 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.926290 30979 ts_tablet_manager.cc:1434] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:40.927428 30979 tablet_bootstrap.cc:492] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:40.942163 30975 tablet_bootstrap.cc:492] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:40.942806 30975 ts_tablet_manager.cc:1403] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.015s
I20260709 12:21:40.945317 30979 tablet_bootstrap.cc:654] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.945462 30975 raft_consensus.cc:359] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.946192 30975 raft_consensus.cc:385] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:40.946473 30975 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:40.947150 30975 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.948746 30983 tablet_bootstrap.cc:654] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.949563 30975 ts_tablet_manager.cc:1434] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:40.950913 30975 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:40.970875 31212 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.974556 31156 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:40.978498 30975 tablet_bootstrap.cc:654] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:40.985728 30979 tablet_bootstrap.cc:492] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:40.986431 30979 ts_tablet_manager.cc:1403] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.059s	user 0.022s	sys 0.009s
I20260709 12:21:40.994867 31156 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:40.995414 31156 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:40.998454 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:40.999097 30784 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:41.000491 30899 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:41.001263 31190 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.001711 31190 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.002081 31190 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.002265 31156 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:41.006019 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:41.007918 30900 leader_election.cc:343] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.013602 30979 raft_consensus.cc:359] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.014436 30979 raft_consensus.cc:385] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.014734 30979 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.016746 30975 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.017233 30975 ts_tablet_manager.cc:1403] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.007s
I20260709 12:21:41.015416 30979 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.021991 30979 ts_tablet_manager.cc:1434] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:21:41.022944 30979 tablet_bootstrap.cc:492] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:41.021181 31190 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.026134 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:41.026847 30782 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.029598 31187 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.031208 30979 tablet_bootstrap.cc:654] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.030544 31187 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.035568 31187 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.036471 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.037719 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:41.049063 30784 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
W20260709 12:21:41.049750 30826 leader_election.cc:343] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.049863 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:41.051347 30900 leader_election.cc:343] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.041442 30782 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:41.042498 30979 tablet_bootstrap.cc:492] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:41.053468 30899 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:41.053463 30825 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:41.054414 31191 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.054955 31191 raft_consensus.cc:697] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:41.055241 31146 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.055836 31146 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.055780 31191 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.056476 31146 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.045457 31190 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:41.053961 30979 ts_tablet_manager.cc:1403] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.005s
I20260709 12:21:41.066905 30979 raft_consensus.cc:359] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.068560 30979 raft_consensus.cc:385] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.068958 30979 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.072826 31011 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.073385 31011 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.075492 31011 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.076570 31011 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.022557 30975 raft_consensus.cc:359] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.077576 30975 raft_consensus.cc:385] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.077894 30975 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.083544 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.086268 30975 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.088838 31146 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.092137 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:21:41.093415 30826 leader_election.cc:343] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.094491 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:41.095396 31146 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.095510 30782 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.099129 30975 ts_tablet_manager.cc:1434] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.002s
I20260709 12:21:41.100075 30975 tablet_bootstrap.cc:492] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:41.105417 30681 catalog_manager.cc:5697] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.106078 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:41.091538 30750 leader_election.cc:343] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.109000 30979 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.116833 30979 ts_tablet_manager.cc:1434] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
W20260709 12:21:41.117259 30750 leader_election.cc:343] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.117719 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:41.118024 30979 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:41.126715 30979 tablet_bootstrap.cc:654] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.131568 31146 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.132678 31146 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.136842 31146 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.139554 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:21:41.141336 30826 leader_election.cc:343] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.146037 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:41.144538 31212 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.147033 30784 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:41.153133 30975 tablet_bootstrap.cc:654] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.158269 30825 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:41.159919 31146 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.160369 31146 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.160741 31146 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.165603 30782 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:41.168568 30975 tablet_bootstrap.cc:492] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.168593 30983 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:41.169086 30975 ts_tablet_manager.cc:1403] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.002s
I20260709 12:21:41.169343 30983 ts_tablet_manager.cc:1403] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.249s	user 0.076s	sys 0.106s
I20260709 12:21:41.171753 31187 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.171975 30825 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:41.172305 31187 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.174659 31187 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.176236 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.176924 31188 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.177564 31188 raft_consensus.cc:697] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:41.178707 31188 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.180112 30979 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:41.180078 30975 raft_consensus.cc:359] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:41.180804 30826 leader_election.cc:343] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.180831 30975 raft_consensus.cc:385] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.181310 30975 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.178834 30983 raft_consensus.cc:359] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.175933 31146 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.180938 30979 ts_tablet_manager.cc:1403] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.005s
I20260709 12:21:41.182176 30983 raft_consensus.cc:385] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.182715 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:41.184883 30983 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.185267 30784 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:41.185889 30983 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.186702 30825 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:41.187163 30979 raft_consensus.cc:359] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.187525 31187 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.187839 30979 raft_consensus.cc:385] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.187951 31187 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.188396 31187 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.189119 30983 ts_tablet_manager.cc:1434] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:21:41.193861 30975 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.195272 31146 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.190127 30983 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:41.196496 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:21:41.197906 30826 leader_election.cc:343] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.197918 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:41.198800 30784 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.198928 31011 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.199556 31011 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.201880 31011 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.203477 30983 tablet_bootstrap.cc:654] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.205559 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.206288 30935 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:41.195403 31187 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.208432 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:41.208595 30975 ts_tablet_manager.cc:1434] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.039s	user 0.001s	sys 0.006s
I20260709 12:21:41.188169 30979 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.209491 31011 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.209973 31011 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.210467 31011 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.212368 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:41.213008 30859 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:41.217073 31187 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.217692 31188 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.218247 30784 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:41.221051 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:41.221841 30825 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:21:41.223331 30826 leader_election.cc:343] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.224469 31188 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.226302 30975 tablet_bootstrap.cc:492] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:41.225275 30979 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.225093 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:41.227181 30679 catalog_manager.cc:5697] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.229646 30784 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.232504 30979 ts_tablet_manager.cc:1434] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:21:41.225010 31188 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:41.233503 30979 tablet_bootstrap.cc:492] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:41.245321 31011 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.246033 31188 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.251132 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:41.251780 30859 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.252588 30983 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:41.253357 30983 ts_tablet_manager.cc:1403] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.015s
I20260709 12:21:41.254354 30975 tablet_bootstrap.cc:654] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.252981 31011 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.252707 31187 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:41.258386 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:41.259027 30935 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.261165 30983 raft_consensus.cc:359] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.261933 30983 raft_consensus.cc:385] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.262234 30983 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.262971 30983 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.267027 30983 ts_tablet_manager.cc:1434] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:41.270418 30983 tablet_bootstrap.cc:492] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:41.274034 31212 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.274729 31212 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.277201 31212 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.287230 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.293505 30784 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:41.293828 30933 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:41.298130 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:41.299896 31015 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.300330 31015 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.301443 31015 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.309484 31191 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.311945 31202 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.310056 31191 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.312474 30859 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:41.312458 31202 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.314288 31191 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:41.314594 31202 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.318747 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:41.319564 30825 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:41.309736 31212 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:21:41.321728 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:41.322144 31187 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.324468 31187 raft_consensus.cc:697] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:41.327185 30983 tablet_bootstrap.cc:654] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.326352 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:41.325527 30679 catalog_manager.cc:5697] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.328500 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.328202 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:41.329141 30933 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:41.329509 31212 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.330240 31212 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:41.319604 30784 raft_consensus.cc:2393] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:21:41.331499 30975 tablet_bootstrap.cc:492] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.331669 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:41.335318 30975 ts_tablet_manager.cc:1403] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.115s	user 0.027s	sys 0.018s
I20260709 12:21:41.325039 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:41.326247 31187 consensus_queue.cc:237] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.337050 31202 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.346547 30899 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:41.347514 31190 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.344887 31202 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.348551 31202 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.356281 31202 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.342831 31212 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.368315 31015 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.372249 30979 tablet_bootstrap.cc:654] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.374562 31190 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.365578 30935 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
W20260709 12:21:41.372375 30750 leader_election.cc:343] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.394917 31202 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.397439 30975 raft_consensus.cc:359] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.400315 30975 raft_consensus.cc:385] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.400588 30975 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.401659 30975 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.413359 31015 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.413266 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:41.414057 30935 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.414814 30975 ts_tablet_manager.cc:1434] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.001s
I20260709 12:21:41.418098 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:41.420857 30750 leader_election.cc:343] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:41.421727 30750 leader_election.cc:343] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.422832 31185 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.427083 31185 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.430553 30983 tablet_bootstrap.cc:492] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:41.430994 30983 ts_tablet_manager.cc:1403] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.161s	user 0.018s	sys 0.005s
I20260709 12:21:41.429463 31185 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.429553 30682 catalog_manager.cc:5697] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.435397 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.437984 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:41.440241 30975 tablet_bootstrap.cc:492] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:41.443056 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:41.443967 30782 raft_consensus.cc:2393] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:21:41.444908 30935 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:41.445173 30825 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:41.445290 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:41.446036 30934 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.446341 31185 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.447585 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:41.448333 31202 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.448827 31202 raft_consensus.cc:697] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:41.450139 31202 consensus_queue.cc:237] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.452574 30679 catalog_manager.cc:5697] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.442451 31212 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:21:41.458770 31185 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.463779 31190 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.468650 30975 tablet_bootstrap.cc:654] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.472000 30934 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:41.472416 30983 raft_consensus.cc:359] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.486370 30983 raft_consensus.cc:385] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.486640 30983 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.487190 30983 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.476598 30975 tablet_bootstrap.cc:492] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.489144 30975 ts_tablet_manager.cc:1403] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
W20260709 12:21:41.484838 30750 leader_election.cc:343] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.493650 30983 ts_tablet_manager.cc:1434] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 12:21:41.495487 30983 tablet_bootstrap.cc:492] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:41.496748 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:41.498272 31212 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.502265 31212 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:41.503592 31212 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:41.514860 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:41.508801 30975 raft_consensus.cc:359] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.518800 30975 raft_consensus.cc:385] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.519786 30975 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.520514 30975 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.523237 31190 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.523715 30975 ts_tablet_manager.cc:1434] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.003s
I20260709 12:21:41.524600 30975 tablet_bootstrap.cc:492] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:41.518293 30983 tablet_bootstrap.cc:654] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.535179 30975 tablet_bootstrap.cc:654] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.541321 30983 tablet_bootstrap.cc:492] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:41.541805 30983 ts_tablet_manager.cc:1403] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.005s
I20260709 12:21:41.544492 30983 raft_consensus.cc:359] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.545185 30983 raft_consensus.cc:385] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.545485 30983 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.546320 30983 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.548147 30975 tablet_bootstrap.cc:492] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.548303 30983 ts_tablet_manager.cc:1434] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:41.547971 30682 catalog_manager.cc:5697] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.548627 30975 ts_tablet_manager.cc:1403] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 12:21:41.549256 30983 tablet_bootstrap.cc:492] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:41.551347 30975 raft_consensus.cc:359] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.552011 30975 raft_consensus.cc:385] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.552270 30975 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.552912 30975 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.559096 30975 ts_tablet_manager.cc:1434] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:41.560277 30983 tablet_bootstrap.cc:654] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.560302 30975 tablet_bootstrap.cc:492] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:41.566639 30979 tablet_bootstrap.cc:492] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:41.567226 30979 ts_tablet_manager.cc:1403] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.334s	user 0.013s	sys 0.014s
I20260709 12:21:41.568945 30975 tablet_bootstrap.cc:654] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.570313 30979 raft_consensus.cc:359] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.575489 30979 raft_consensus.cc:385] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.575862 30979 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.575054 30682 catalog_manager.cc:5697] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.576686 30979 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.579089 30979 ts_tablet_manager.cc:1434] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:21:41.581068 30979 tablet_bootstrap.cc:492] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:41.584388 31187 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.587158 30975 tablet_bootstrap.cc:492] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.587584 30979 tablet_bootstrap.cc:654] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.590749 30975 ts_tablet_manager.cc:1403] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.004s
I20260709 12:21:41.596333 30975 raft_consensus.cc:359] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.597345 30975 raft_consensus.cc:385] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.597713 30975 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.598574 30975 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.603830 30975 ts_tablet_manager.cc:1434] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:41.604786 30975 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:41.610474 30975 tablet_bootstrap.cc:654] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.617749 30983 tablet_bootstrap.cc:492] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:41.618341 30983 ts_tablet_manager.cc:1403] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.009s
I20260709 12:21:41.619498 31188 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.636096 30935 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.654163 31185 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.655334 30983 raft_consensus.cc:359] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.656047 30983 raft_consensus.cc:385] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.656430 30983 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.657384 30983 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.659731 30983 ts_tablet_manager.cc:1434] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:21:41.660990 30983 tablet_bootstrap.cc:492] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:41.684068 30983 tablet_bootstrap.cc:654] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.708436 31187 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.728406 30983 tablet_bootstrap.cc:492] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:41.729035 30983 ts_tablet_manager.cc:1403] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.004s
I20260709 12:21:41.733036 30983 raft_consensus.cc:359] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.734030 30983 raft_consensus.cc:385] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.734393 30983 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.735425 30983 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.738651 30983 ts_tablet_manager.cc:1434] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 12:21:41.741073 30983 tablet_bootstrap.cc:492] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:41.741940 30979 tablet_bootstrap.cc:492] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:41.742404 30979 ts_tablet_manager.cc:1403] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.162s	user 0.042s	sys 0.057s
I20260709 12:21:41.744649 30975 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.745112 30975 ts_tablet_manager.cc:1403] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.141s	user 0.045s	sys 0.070s
I20260709 12:21:41.745297 30979 raft_consensus.cc:359] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.746114 30979 raft_consensus.cc:385] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.746398 30979 raft_consensus.cc:740] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.747387 30983 tablet_bootstrap.cc:654] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.747023 30979 consensus_queue.cc:260] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.747689 30975 raft_consensus.cc:359] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.748363 30975 raft_consensus.cc:385] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.748633 30975 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.749162 30979 ts_tablet_manager.cc:1434] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:41.749260 30975 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.750283 30979 tablet_bootstrap.cc:492] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:41.750701 31202 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.751180 31202 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.751603 30975 ts_tablet_manager.cc:1434] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:41.753921 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:41.755012 31202 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:41.755549 30750 leader_election.cc:343] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.756731 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:21:41.758287 30750 leader_election.cc:343] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.758656 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:41.758919 30975 tablet_bootstrap.cc:492] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:41.759683 31202 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.765383 30975 tablet_bootstrap.cc:654] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.778045 31185 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.778637 31185 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.780843 31185 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.783160 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:41.784215 30935 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:41.786238 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:41.786871 31202 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.807646 30825 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:41.808423 31187 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.815822 30979 tablet_bootstrap.cc:654] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.818553 31212 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.828898 30979 tablet_bootstrap.cc:492] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:41.829492 30979 ts_tablet_manager.cc:1403] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.008s
I20260709 12:21:41.832979 30979 raft_consensus.cc:359] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.833943 30979 raft_consensus.cc:385] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.834303 30979 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.835474 30979 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.838016 30979 ts_tablet_manager.cc:1434] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:21:41.842938 31187 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.850181 30934 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.858683 30983 tablet_bootstrap.cc:492] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:41.859846 30979 tablet_bootstrap.cc:492] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:41.863909 30983 ts_tablet_manager.cc:1403] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.123s	user 0.046s	sys 0.039s
I20260709 12:21:41.866734 30983 raft_consensus.cc:359] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.868130 30983 raft_consensus.cc:385] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.868489 30983 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.869191 30983 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.870597 30979 tablet_bootstrap.cc:654] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.870245 31212 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:41.871610 30983 ts_tablet_manager.cc:1434] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:41.872592 30983 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:41.874630 31212 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.875098 31212 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:41.878156 31185 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:41.880918 31212 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:41.882529 30975 tablet_bootstrap.cc:492] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:41.884958 31185 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.880724 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:41.919298 31185 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.020280 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.021399 30975 ts_tablet_manager.cc:1403] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.263s	user 0.035s	sys 0.045s
I20260709 12:21:42.023911 30983 tablet_bootstrap.cc:700] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent opening tablet: real 0.139s	user 0.022s	sys 0.007s
I20260709 12:21:42.027354 30983 tablet_bootstrap.cc:654] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.028419 30859 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.029371 30979 tablet_bootstrap.cc:492] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:42.029899 30979 ts_tablet_manager.cc:1403] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.010s
I20260709 12:21:42.028746 31185 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:42.037318 30750 leader_election.cc:343] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.049515 30979 raft_consensus.cc:359] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.050683 30979 raft_consensus.cc:385] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.051083 30979 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.052026 30979 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.061890 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.062753 30935 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:42.063164 31146 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:42.077454 30750 leader_election.cc:343] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.078733 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.089501 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.094553 31274 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.093835 31146 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.102092 31011 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.101318 31274 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.118002 31274 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.108551 31202 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.122376 30975 raft_consensus.cc:359] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.123145 30975 raft_consensus.cc:385] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.123369 30975 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.124607 30975 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.115397 31212 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.129046 30979 ts_tablet_manager.cc:1434] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.099s	user 0.016s	sys 0.007s
I20260709 12:21:42.130198 30979 tablet_bootstrap.cc:492] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:42.122344 31202 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.149932 31202 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.170182 31284 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.170732 31284 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.174712 31284 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.127933 31212 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.176033 31275 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.175515 31287 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:42.183843 31275 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.176783 31156 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.192777 31287 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.196194 31212 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.204968 30975 ts_tablet_manager.cc:1434] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.183s	user 0.012s	sys 0.004s
I20260709 12:21:42.206359 30975 tablet_bootstrap.cc:492] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:42.203867 31146 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.193437 31156 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.211822 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:42.212568 30782 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:42.204958 31287 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.223730 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.221462 31156 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:42.237344 30979 tablet_bootstrap.cc:654] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.244797 30983 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:42.242193 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.245198 30983 ts_tablet_manager.cc:1403] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.373s	user 0.027s	sys 0.025s
I20260709 12:21:42.245648 31287 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.248445 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.248804 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.249435 30929 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:42.205240 31274 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.250212 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.256685 30856 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
W20260709 12:21:42.253595 30750 leader_election.cc:343] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.260031 30750 leader_election.cc:343] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.265143 30750 leader_election.cc:343] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.265549 30750 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.266710 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:42.266717 30983 raft_consensus.cc:359] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.267652 31277 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.267820 30983 raft_consensus.cc:385] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.267774 31011 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.268474 30983 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.268507 31011 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.269119 31011 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.269511 30983 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.271507 30983 ts_tablet_manager.cc:1434] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:21:42.272408 30983 tablet_bootstrap.cc:492] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
W20260709 12:21:42.275203 31283 log.cc:927] Time spent T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.091s	user 0.004s	sys 0.000s
I20260709 12:21:42.275520 31289 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:21:42.284066 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.289824 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.290544 30929 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:42.296370 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:42.297199 30784 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:42.297830 31274 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.299412 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:42.305430 30826 leader_election.cc:343] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.307034 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.316813 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.317107 31282 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.317499 31282 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.317898 31282 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.320770 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.317567 31275 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.313730 31290 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 12:21:42.324971 30975 tablet_bootstrap.cc:654] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.332118 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.331377 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.333400 30934 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.332676 30935 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:42.343444 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.331061 31282 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.347486 31273 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.347834 31011 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.348062 31273 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.349817 31187 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:42.357234 31187 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:21:42.358734 31187 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.355634 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:42.362131 30859 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:21:42.366336 30783 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:42.373375 30979 tablet_bootstrap.cc:492] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:42.373937 30979 ts_tablet_manager.cc:1403] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.244s	user 0.010s	sys 0.014s
I20260709 12:21:42.388880 31011 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.393008 30983 tablet_bootstrap.cc:654] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.397344 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:42.399824 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:42.403880 30934 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:42.398350 30780 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.407944 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:42.408788 30856 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 1: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:21:42.406669 30979 raft_consensus.cc:359] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.411408 30979 raft_consensus.cc:385] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.411715 30979 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.412338 30979 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:42.412271 30750 leader_election.cc:343] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.419077 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.423552 31011 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.426133 30979 ts_tablet_manager.cc:1434] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:21:42.426815 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.428052 30935 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.428364 30979 tablet_bootstrap.cc:492] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:42.428720 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.429474 31188 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.429991 31188 raft_consensus.cc:697] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:42.430820 31188 consensus_queue.cc:237] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.431018 31273 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.438094 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:42.515406 31284 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.516497 30784 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:21:42.512825 31298 log.cc:927] Time spent T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.076s	user 0.004s	sys 0.013s
I20260709 12:21:42.474335 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.461071 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.441650 30780 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:42.429505 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:42.519937 30826 leader_election.cc:343] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.456831 30935 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:42.515518 30825 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:42.521029 30979 tablet_bootstrap.cc:654] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.436658 31187 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.461562 30899 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.527002 30779 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:42.528465 31272 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.529583 30859 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:42.522349 31273 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.530184 31273 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.530547 31273 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.458149 31282 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.537426 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.540371 31278 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.542927 31011 consensus_queue.cc:1059] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.549181 31011 raft_consensus.cc:3055] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:42.549553 31011 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:42.550271 31278 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:42.550560 31011 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.552666 31011 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.553524 31187 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.554201 30983 tablet_bootstrap.cc:492] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:42.554431 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.554683 30983 ts_tablet_manager.cc:1403] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.282s	user 0.013s	sys 0.004s
I20260709 12:21:42.557323 31278 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.564622 30975 tablet_bootstrap.cc:492] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:42.565598 30975 ts_tablet_manager.cc:1403] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.359s	user 0.017s	sys 0.019s
I20260709 12:21:42.566303 30983 raft_consensus.cc:359] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.569022 30983 raft_consensus.cc:385] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.569437 30983 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.576376 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:42.582645 30825 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:42.585026 31187 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.582361 31273 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:42.551311 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 89844us
I20260709 12:21:42.586369 30983 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.584498 30825 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:42.596160 30983 ts_tablet_manager.cc:1434] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.005s
I20260709 12:21:42.594595 31284 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.605338 31284 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.605855 31284 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.607594 31273 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.613324 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.614557 30935 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.616457 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:42.617101 30783 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.625928 30935 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:42.626577 30983 tablet_bootstrap.cc:492] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:42.631085 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.633662 31188 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.634202 31188 raft_consensus.cc:697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:42.651436 30975 raft_consensus.cc:359] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.652172 30975 raft_consensus.cc:385] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.652433 30975 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.653074 30975 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.654732 30975 ts_tablet_manager.cc:1434] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.089s	user 0.005s	sys 0.000s
I20260709 12:21:42.655690 30975 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
W20260709 12:21:42.648487 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:42.647895 30680 catalog_manager.cc:5697] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.668705 31015 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.669284 31015 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.669596 30679 catalog_manager.cc:5697] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.635069 31188 consensus_queue.cc:237] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.675544 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.666880 30783 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:42.678330 30856 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:42.679248 30979 tablet_bootstrap.cc:492] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:42.679783 30979 ts_tablet_manager.cc:1403] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.252s	user 0.014s	sys 0.006s
I20260709 12:21:42.681039 31015 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.682554 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.682664 30979 raft_consensus.cc:359] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.683424 30979 raft_consensus.cc:385] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.683749 30979 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
W20260709 12:21:42.684338 30750 leader_election.cc:343] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.684476 30979 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.685559 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:42.687247 30979 ts_tablet_manager.cc:1434] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:42.674392 30780 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:21:42.687752 31015 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.689890 31015 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.690920 30979 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:42.691530 31015 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.694799 30983 tablet_bootstrap.cc:654] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.697350 31284 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.699427 30825 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:42.699924 31284 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.700526 31284 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:42.701023 31284 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:42.703347 30975 tablet_bootstrap.cc:654] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.704327 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.705492 31284 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:42.705935 30826 leader_election.cc:343] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.714468 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:42.718390 30783 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.719146 30979 tablet_bootstrap.cc:654] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.724221 31015 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.728281 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:42.729272 30856 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.735162 30783 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:42.739308 30856 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:42.743615 30979 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:42.745375 31015 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.745838 30979 ts_tablet_manager.cc:1403] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.004s
I20260709 12:21:42.746363 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.747767 31020 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.748088 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.748333 31020 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:21:42.749272 30750 leader_election.cc:343] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.749423 31020 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.752525 30975 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:42.753154 30975 ts_tablet_manager.cc:1403] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.010s
I20260709 12:21:42.756313 30975 raft_consensus.cc:359] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.757138 30975 raft_consensus.cc:385] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.757596 30975 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.759075 30975 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.761806 30975 ts_tablet_manager.cc:1434] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:21:42.762923 30975 tablet_bootstrap.cc:492] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:42.766922 30983 tablet_bootstrap.cc:492] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:42.767449 30983 ts_tablet_manager.cc:1403] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.002s
I20260709 12:21:42.756224 30979 raft_consensus.cc:359] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.769798 30979 raft_consensus.cc:385] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.770208 30979 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.771062 30979 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.773084 30975 tablet_bootstrap.cc:654] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.773244 30979 ts_tablet_manager.cc:1434] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 12:21:42.774323 30979 tablet_bootstrap.cc:492] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:42.774353 30825 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:42.775534 31188 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.776012 31188 raft_consensus.cc:697] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:42.776911 31188 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.778489 31293 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.779145 31293 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.780216 30983 raft_consensus.cc:359] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.782636 30983 raft_consensus.cc:385] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.783191 30983 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.783972 30983 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.786196 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.787067 30859 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:42.785897 30979 tablet_bootstrap.cc:654] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.789458 30983 ts_tablet_manager.cc:1434] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:21:42.790522 30983 tablet_bootstrap.cc:492] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:42.796144 30679 catalog_manager.cc:5697] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.790694 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.798303 31285 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.798696 31285 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.799029 31285 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.800587 30975 tablet_bootstrap.cc:492] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:42.782543 31293 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:42.801076 30975 ts_tablet_manager.cc:1403] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.038s	user 0.030s	sys 0.001s
I20260709 12:21:42.802083 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:42.802814 30783 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:42.803898 30975 raft_consensus.cc:359] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.804659 30975 raft_consensus.cc:385] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.804908 30975 raft_consensus.cc:740] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.809417 30983 tablet_bootstrap.cc:654] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.805537 30975 consensus_queue.cc:260] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.813338 30975 ts_tablet_manager.cc:1434] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:21:42.814200 30975 tablet_bootstrap.cc:492] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:42.821224 30979 tablet_bootstrap.cc:492] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:42.821787 30979 ts_tablet_manager.cc:1403] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.005s
I20260709 12:21:42.824930 30682 catalog_manager.cc:5697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.827698 30979 raft_consensus.cc:359] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.828994 30979 raft_consensus.cc:385] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.829272 30979 raft_consensus.cc:740] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.829933 30979 consensus_queue.cc:260] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.830077 30682 catalog_manager.cc:5697] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.832011 30979 ts_tablet_manager.cc:1434] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:42.832904 30979 tablet_bootstrap.cc:492] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:42.836210 31285 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.841358 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:42.842193 30780 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.842631 31191 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.843115 31191 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.845228 31191 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:42.847134 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.847419 31285 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:42.848384 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:21:42.849561 30900 leader_election.cc:343] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.851753 30975 tablet_bootstrap.cc:654] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.852337 30979 tablet_bootstrap.cc:654] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.854449 30856 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.854688 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:42.856300 30899 leader_election.cc:343] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.858785 30899 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.859905 31191 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.864372 30780 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:42.866712 30899 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:42.867717 31191 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.868186 31191 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:42.869014 31191 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.871680 30856 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:42.874435 30983 tablet_bootstrap.cc:492] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:42.874950 30983 ts_tablet_manager.cc:1403] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.007s
I20260709 12:21:42.879195 30983 raft_consensus.cc:359] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.879937 30983 raft_consensus.cc:385] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.880220 30983 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.883069 30979 tablet_bootstrap.cc:492] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:42.883569 30979 ts_tablet_manager.cc:1403] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.004s
I20260709 12:21:42.883119 30975 tablet_bootstrap.cc:492] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:42.884580 30975 ts_tablet_manager.cc:1403] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.005s
I20260709 12:21:42.887247 30975 raft_consensus.cc:359] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.887908 30975 raft_consensus.cc:385] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.888157 30975 raft_consensus.cc:740] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.888759 30975 consensus_queue.cc:260] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.894294 31285 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.894798 31285 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.896896 31285 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:42.898007 30979 raft_consensus.cc:359] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.898705 30979 raft_consensus.cc:385] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.898981 30979 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.898952 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:42.899900 30783 raft_consensus.cc:2393] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:21:42.899861 30979 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.891670 30983 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.901697 30979 ts_tablet_manager.cc:1434] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.000s
I20260709 12:21:42.902595 30975 ts_tablet_manager.cc:1434] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:21:42.902778 30983 ts_tablet_manager.cc:1434] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:21:42.903882 30983 tablet_bootstrap.cc:492] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:42.898845 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.904031 30975 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:42.905217 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.906605 31293 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.902664 30979 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:42.914850 30975 tablet_bootstrap.cc:654] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.915414 31293 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.915591 30682 catalog_manager.cc:5697] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.920185 30983 tablet_bootstrap.cc:654] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.929384 30983 tablet_bootstrap.cc:492] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:42.930015 30983 ts_tablet_manager.cc:1403] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 12:21:42.932907 30983 raft_consensus.cc:359] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.933706 30983 raft_consensus.cc:385] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.934053 30983 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.934860 30979 tablet_bootstrap.cc:654] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.935962 30680 catalog_manager.cc:5697] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:42.937037 31015 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.937574 31015 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.938010 31288 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.938500 31288 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.939924 31015 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.940629 31288 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.952658 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.953055 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:42.953717 30933 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:42.954066 30979 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:42.954523 30979 ts_tablet_manager.cc:1403] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.008s
I20260709 12:21:42.956363 30975 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:42.956821 30975 ts_tablet_manager.cc:1403] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.004s
I20260709 12:21:42.957247 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.957312 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:42.959376 30750 leader_election.cc:343] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.960063 30750 leader_election.cc:343] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:42.960664 30750 leader_election.cc:343] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.960479 30975 raft_consensus.cc:359] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.961194 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.961369 30975 raft_consensus.cc:385] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.961843 30975 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.962452 30975 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.963712 31020 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.965061 30975 ts_tablet_manager.cc:1434] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:42.965945 30750 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:42.967288 30975 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:42.967224 31288 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.967830 31288 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.968308 31288 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.934839 30983 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.971016 30983 ts_tablet_manager.cc:1434] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:21:42.972201 30983 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:42.974961 31191 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.959234 30979 raft_consensus.cc:359] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.975956 30979 raft_consensus.cc:385] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.976356 30979 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.975504 31191 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.977408 30979 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.982120 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:42.982836 30859 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:42.984191 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:42.984962 31293 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.985297 31191 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:42.985347 31293 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.986634 31293 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.985675 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:42.991544 30779 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:42.992066 31288 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.993562 30979 ts_tablet_manager.cc:1434] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.005s
I20260709 12:21:42.994916 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:42.995659 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:42.996883 30935 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.997005 31293 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.001642 30983 tablet_bootstrap.cc:654] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:43.002034 30750 leader_election.cc:343] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.002362 30975 tablet_bootstrap.cc:654] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.011368 31275 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:43.016009 30935 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:43.017167 30750 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:43.018016 31020 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.018489 31020 raft_consensus.cc:697] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:43.019301 31020 consensus_queue.cc:237] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:42.996098 31288 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:42.997493 30979 tablet_bootstrap.cc:492] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:43.036252 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:43.037117 30779 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.040350 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:43.041188 30859 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.042420 31293 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:43.094696 31011 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.095255 31011 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.102097 31288 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.106338 30859 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:43.107924 30975 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:43.112962 30680 catalog_manager.cc:5697] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.114341 30975 ts_tablet_manager.cc:1403] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.147s	user 0.007s	sys 0.010s
I20260709 12:21:43.121104 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:43.120296 31191 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.123420 31285 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:43.129158 31285 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:43.130079 31285 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.132964 30983 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:43.133464 30983 ts_tablet_manager.cc:1403] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.161s	user 0.021s	sys 0.021s
I20260709 12:21:43.132507 31191 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.121536 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:43.134776 31275 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:43.124729 31011 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:43.144642 30979 tablet_bootstrap.cc:654] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.145529 30983 raft_consensus.cc:359] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.146658 30983 raft_consensus.cc:385] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.147086 30983 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.148203 30983 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.167500 30856 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:43.168920 30783 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.171257 31191 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:43.172104 30975 raft_consensus.cc:359] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.172946 30975 raft_consensus.cc:385] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.173262 30975 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.176689 30933 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.215930 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:43.230334 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:43.231032 30785 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:43.231341 30979 tablet_bootstrap.cc:492] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:43.231947 30979 ts_tablet_manager.cc:1403] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.235s	user 0.020s	sys 0.038s
I20260709 12:21:43.222293 31011 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.236284 31011 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.237887 31284 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.246559 30983 ts_tablet_manager.cc:1434] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.113s	user 0.020s	sys 0.011s
I20260709 12:21:43.247567 30983 tablet_bootstrap.cc:492] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:43.226454 30856 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:43.263799 30975 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.268144 30975 ts_tablet_manager.cc:1434] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.153s	user 0.009s	sys 0.003s
I20260709 12:21:43.268306 30979 raft_consensus.cc:359] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.269127 30979 raft_consensus.cc:385] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.269236 30975 tablet_bootstrap.cc:492] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:43.269486 30979 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.270485 30979 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.266776 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:43.241245 31330 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:21:43.282613 30979 ts_tablet_manager.cc:1434] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.002s
I20260709 12:21:43.294037 31285 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.306320 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:43.322685 30979 tablet_bootstrap.cc:492] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:43.336915 31015 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.337417 31015 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.337774 31015 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.338837 30933 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.305325 31011 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:43.309271 31285 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.347935 30979 tablet_bootstrap.cc:654] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.347875 31285 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.352388 30680 catalog_manager.cc:5697] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:43.367798 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 56732.5us
I20260709 12:21:43.349718 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:43.346506 31332 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:21:43.441293 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:43.384653 30779 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:43.431605 31188 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:21:43.448360 31340 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:21:43.432169 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 91845.9us
I20260709 12:21:43.451862 30983 tablet_bootstrap.cc:654] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.489338 31329 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:21:43.490245 31188 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.552995 31015 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.626338 31015 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:43.621650 31338 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.065s	user 0.007s	sys 0.000s
I20260709 12:21:43.689481 30975 tablet_bootstrap.cc:654] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:43.703357 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 56783.4us
I20260709 12:21:43.705195 30979 tablet_bootstrap.cc:492] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:43.705698 30979 ts_tablet_manager.cc:1403] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.391s	user 0.043s	sys 0.024s
W20260709 12:21:43.709183 30750 leader_election.cc:343] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:43.712649 30979 raft_consensus.cc:359] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.714275 30979 raft_consensus.cc:385] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.714577 30979 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.715221 30979 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.691275 31345 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:21:43.723716 30979 ts_tablet_manager.cc:1434] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
W20260709 12:21:43.732975 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:43.735296 30979 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:43.735317 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:43.738633 30930 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:43.712296 31347 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.699311 31188 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:43.732996 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:43.758690 30856 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.760063 30932 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.751574 31330 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:21:43.752050 31347 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:43.790314 30750 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:43.797825 30983 tablet_bootstrap.cc:492] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:43.798298 30983 ts_tablet_manager.cc:1403] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.551s	user 0.016s	sys 0.000s
I20260709 12:21:43.789160 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:43.808800 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:43.793429 31278 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:21:43.824486 30983 raft_consensus.cc:359] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.828658 30983 raft_consensus.cc:385] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:43.827373 31339 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.813890 31284 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:43.829182 30983 raft_consensus.cc:740] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:43.798990 31285 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.832075 31284 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:43.834254 31284 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:43.834051 31293 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:43.834538 30983 consensus_queue.cc:260] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:43.921927 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 73853.5us
I20260709 12:21:43.922935 30933 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 1: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:21:43.925851 31351 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.926384 31351 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.928299 30979 tablet_bootstrap.cc:654] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:43.934794 30983 ts_tablet_manager.cc:1434] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.136s	user 0.025s	sys 0.047s
I20260709 12:21:43.928316 31278 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:21:43.929292 31273 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:43.938644 30983 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:43.952463 30975 tablet_bootstrap.cc:492] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:43.952956 30975 ts_tablet_manager.cc:1403] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.684s	user 0.030s	sys 0.038s
W20260709 12:21:43.936584 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 86010.6us
I20260709 12:21:43.953540 30856 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:43.947158 31273 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:43.983423 31273 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:43.994163 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:21:44.062709 31357 log.cc:927] Time spent T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.229s	user 0.002s	sys 0.002s
I20260709 12:21:44.107975 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:44.045941 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:44.117204 30750 leader_election.cc:343] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.116657 30975 raft_consensus.cc:359] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.117734 30975 raft_consensus.cc:385] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.118201 30975 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.120708 31352 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.121287 31352 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.117617 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:44.119177 30975 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.136497 30979 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:44.136997 30979 ts_tablet_manager.cc:1403] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.402s	user 0.011s	sys 0.014s
I20260709 12:21:43.994274 31347 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:44.035195 31284 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.029155 31345 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.094s
I20260709 12:21:44.145810 30975 ts_tablet_manager.cc:1434] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.003s
I20260709 12:21:44.148131 30975 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:44.120733 31337 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.137909 31285 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:44.143075 30929 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 1: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:21:44.130435 31015 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.156206 31354 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:21:44.145663 30778 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:44.160171 31284 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:44.160333 31351 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:44.160956 31337 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:44.161885 31337 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.164801 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:44.168314 30852 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.168813 31352 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:44.170653 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:44.175427 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:44.182611 31346 consensus_queue.cc:1048] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:44.182971 31332 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:44.196790 30979 raft_consensus.cc:359] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.198156 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:44.200382 30979 raft_consensus.cc:385] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.200479 30785 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.201067 30979 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.202100 30979 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.177058 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:44.216434 30979 ts_tablet_manager.cc:1434] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.079s	user 0.011s	sys 0.000s
I20260709 12:21:44.217455 30979 tablet_bootstrap.cc:492] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:44.204636 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:44.246783 30785 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:44.231973 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:44.239954 30933 raft_consensus.cc:2393] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:44.269284 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:44.302577 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:44.311766 30680 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 101) took 1021 ms. Trace:
I20260709 12:21:44.318359 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:44.306146 31337 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.324570 31191 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:44.362128 30983 tablet_bootstrap.cc:654] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.365550 30979 tablet_bootstrap.cc:654] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.379390 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:44.386118 30856 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:44.390606 30975 tablet_bootstrap.cc:654] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.394573 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:44.351538 31337 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.319432 30680 rpcz_store.cc:276] 0709 12:21:43.287159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:43.287352 (+   193us) service_pool.cc:224] Handling call
0709 12:21:44.308808 (+1021456us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:21:43.378109 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:21:43.385746 (+  7637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:21:43.385838 (+    92us) write_op.cc:435] Acquired schema lock
0709 12:21:43.385861 (+    23us) tablet.cc:662] Decoding operations
0709 12:21:43.433854 (+ 47993us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:21:43.438791 (+  4937us) write_op.cc:641] Partition lock acquired for write op
0709 12:21:43.442387 (+  3596us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:21:43.491360 (+ 48973us) tablet.cc:701] Row locks acquired
0709 12:21:43.501883 (+ 10523us) write_op.cc:260] PREPARE: finished
0709 12:21:43.617085 (+115202us) write_op.cc:270] Start()
0709 12:21:43.627959 (+ 10874us) write_op.cc:276] Timestamp: P: 1783599703614850 usec, L: 0
0709 12:21:43.633827 (+  5868us) op_driver.cc:348] REPLICATION: starting
0709 12:21:43.635730 (+  1903us) log.cc:844] Serialized 540 byte log entry
0709 12:21:43.803052 (+167322us) op_driver.cc:464] REPLICATION: finished
0709 12:21:44.103093 (+300041us) write_op.cc:301] APPLY: starting
0709 12:21:44.103175 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:21:44.103286 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 12:21:44.121616 (+ 18330us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:21:44.121928 (+   312us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:21:44.122151 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:21:44.122224 (+    73us) write_op.cc:312] APPLY: finished
0709 12:21:44.122544 (+   320us) log.cc:844] Serialized 22 byte log entry
0709 12:21:44.142954 (+ 20410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:44.148150 (+  5196us) write_op.cc:454] Released schema lock
0709 12:21:44.150894 (+  2744us) write_op.cc:341] FINISH: Updating metrics
0709 12:21:44.158385 (+  7491us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:21:44.158418 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":932,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":295974,"apply.run_cpu_time_us":2754,"apply.run_wall_time_us":53905,"num_ops":1,"prepare.queue_time_us":145,"prepare.run_cpu_time_us":11315,"prepare.run_wall_time_us":257942,"replication_time_us":159198,"thread_start_us":158160,"threads_started":1}]]}
I20260709 12:21:44.398831 31285 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:21:44.421972 30750 leader_election.cc:343] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:44.422624 31374 log.cc:927] Time spent T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.072s	user 0.004s	sys 0.000s
I20260709 12:21:44.426348 31337 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:44.436609 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:21:44.461696 31377 log.cc:927] Time spent T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:21:44.476789 31378 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:21:44.495302 31373 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.068s	user 0.002s	sys 0.001s
I20260709 12:21:44.497798 30926 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:44.504637 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:44.505247 30935 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.516156 30935 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:44.527722 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:44.530421 31330 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.530632 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:44.536000 31330 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:44.539016 31330 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.532617 30899 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:44.573215 31344 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:44.582777 31384 log.cc:927] Time spent T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:21:44.583027 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 64123.8us
I20260709 12:21:44.608785 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:21:44.619457 30750 leader_election.cc:343] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.644740 31348 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.645296 31348 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.645685 31348 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.653920 30975 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:44.654433 30975 ts_tablet_manager.cc:1403] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.507s	user 0.020s	sys 0.004s
I20260709 12:21:44.659533 30979 tablet_bootstrap.cc:492] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:44.660185 30979 ts_tablet_manager.cc:1403] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.443s	user 0.018s	sys 0.005s
I20260709 12:21:44.666644 30983 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:44.667268 30983 ts_tablet_manager.cc:1403] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.729s	user 0.025s	sys 0.021s
I20260709 12:21:44.674319 30983 raft_consensus.cc:359] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.675041 30983 raft_consensus.cc:385] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.675331 30983 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.675910 30983 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.677987 30979 raft_consensus.cc:359] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.678685 30983 ts_tablet_manager.cc:1434] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:21:44.678685 30979 raft_consensus.cc:385] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.679113 30979 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.679735 30983 tablet_bootstrap.cc:492] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:44.679770 30979 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.680689 31348 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.684355 30979 ts_tablet_manager.cc:1434] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.001s
I20260709 12:21:44.685317 30979 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:44.685600 31348 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:44.691116 30975 raft_consensus.cc:359] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.691864 30975 raft_consensus.cc:385] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.692153 30975 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.700057 30825 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:44.702000 31275 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.704327 30979 tablet_bootstrap.cc:654] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.710331 30983 tablet_bootstrap.cc:654] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.715680 30682 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.718619 31188 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.719224 31188 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.721247 31188 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:44.725832 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:44.726722 30929 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:44.734452 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:44.728083 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:44.735121 30930 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.738806 31330 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.739223 31330 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.739571 31330 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.699347 30975 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.743347 30975 ts_tablet_manager.cc:1434] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.000s
I20260709 12:21:44.744118 30975 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:44.748566 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:44.753798 30930 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:44.762964 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:44.785000 31348 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.785844 31348 raft_consensus.cc:697] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:44.786888 31015 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.786823 31348 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.787554 31015 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.796620 31352 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.797219 31352 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.800429 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:44.801242 30778 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:44.802812 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:44.803859 31351 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.804322 31351 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.804737 31351 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.806824 30975 tablet_bootstrap.cc:654] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.807367 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:44.808830 30979 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:44.809327 30979 ts_tablet_manager.cc:1403] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.124s	user 0.022s	sys 0.033s
I20260709 12:21:44.810469 31352 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:44.813314 30983 tablet_bootstrap.cc:492] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:44.813871 30983 ts_tablet_manager.cc:1403] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.134s	user 0.023s	sys 0.033s
I20260709 12:21:44.816710 30983 raft_consensus.cc:359] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.817435 30983 raft_consensus.cc:385] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.817750 30983 raft_consensus.cc:740] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.818581 30983 consensus_queue.cc:260] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.821444 30983 ts_tablet_manager.cc:1434] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:44.822422 30983 tablet_bootstrap.cc:492] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:44.822472 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:44.823159 30979 raft_consensus.cc:359] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.795271 31015 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:44.823936 30979 raft_consensus.cc:385] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.818225 31351 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.805389 31330 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.834882 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:44.829360 30983 tablet_bootstrap.cc:654] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.836239 30854 raft_consensus.cc:2393] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 1: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:21:44.836833 31330 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:44.830296 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:44.830507 30979 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
W20260709 12:21:44.831518 30750 leader_election.cc:343] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.824509 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:44.840543 30900 leader_election.cc:343] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.841003 30856 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:44.841082 30979 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.833170 31351 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:44.833564 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:44.842615 30781 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.843631 30979 ts_tablet_manager.cc:1434] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:21:44.844722 30979 tablet_bootstrap.cc:492] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
W20260709 12:21:44.849261 30900 leader_election.cc:343] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.850939 30781 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:44.851377 30679 catalog_manager.cc:5697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.852267 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:44.853560 31348 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:44.857946 31352 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:44.858718 31352 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:44.870350 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:44.876389 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:21:44.879231 30750 leader_election.cc:343] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:44.880081 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:44.881582 31015 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.889484 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:44.892136 31336 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:21:44.905519 31288 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:44.906157 31288 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:44.906589 31288 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:44.885458 31352 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.929407 30983 tablet_bootstrap.cc:492] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:44.930131 30983 ts_tablet_manager.cc:1403] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.108s	user 0.027s	sys 0.006s
I20260709 12:21:44.912886 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:44.944653 30930 raft_consensus.cc:2393] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:44.946657 30979 tablet_bootstrap.cc:654] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:44.948549 30975 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:44.949057 30975 ts_tablet_manager.cc:1403] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.205s	user 0.031s	sys 0.022s
I20260709 12:21:44.952484 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:21:44.963559 31351 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:44.958515 31332 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:44.964115 31351 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.979250 30975 raft_consensus.cc:359] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.980290 30975 raft_consensus.cc:385] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:44.980638 30975 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:44.981446 30975 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:44.984736 30975 ts_tablet_manager.cc:1434] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:21:44.985951 30975 tablet_bootstrap.cc:492] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:44.989295 30680 catalog_manager.cc:5697] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:44.992671 31188 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:44.995167 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:44.995337 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:44.995862 30781 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
W20260709 12:21:44.997892 30900 leader_election.cc:343] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.000870 30983 raft_consensus.cc:359] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.002197 30983 raft_consensus.cc:385] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.002815 31351 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:45.002543 30983 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.017653 30983 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.023726 30899 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:45.026798 31353 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.027245 31353 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.027573 31353 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.029735 30983 ts_tablet_manager.cc:1434] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 12:21:45.031237 30983 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:45.067247 31348 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.067831 31348 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.030865 31288 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.075066 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:45.076658 30750 leader_election.cc:343] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.078398 31288 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.079510 31348 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.086675 30975 tablet_bootstrap.cc:654] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.090167 31353 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.092104 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:45.094247 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:45.094273 30983 tablet_bootstrap.cc:654] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.096146 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:45.096444 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:45.096760 30857 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:45.098080 30900 leader_election.cc:343] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.098866 31353 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:45.101624 30979 tablet_bootstrap.cc:492] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:45.102741 30979 ts_tablet_manager.cc:1403] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.258s	user 0.019s	sys 0.010s
I20260709 12:21:45.105924 30979 raft_consensus.cc:359] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.106622 30979 raft_consensus.cc:385] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.149865 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:45.181232 30779 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.163347 30682 catalog_manager.cc:5697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:21:45.150365 30750 leader_election.cc:343] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.191087 30857 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:45.196384 30779 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:45.189932 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:45.198355 30899 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:45.176409 30975 tablet_bootstrap.cc:492] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
W20260709 12:21:45.168339 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:45.218583 30983 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.219735 30983 ts_tablet_manager.cc:1403] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.001s
I20260709 12:21:45.239436 30975 ts_tablet_manager.cc:1403] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.254s	user 0.018s	sys 0.000s
I20260709 12:21:45.106863 30979 raft_consensus.cc:740] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.243078 31345 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.244194 30975 raft_consensus.cc:359] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.245293 30975 raft_consensus.cc:385] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.244230 31345 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:45.247342 31345 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:21:45.249907 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 99868.8us
W20260709 12:21:45.250985 30750 leader_election.cc:343] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.256017 31337 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.278789 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:45.284974 30979 consensus_queue.cc:260] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.245661 30975 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.287194 31343 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.287961 31343 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.288053 30975 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.290591 31343 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.291432 30975 ts_tablet_manager.cc:1434] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 12:21:45.292833 30975 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:45.294695 30979 ts_tablet_manager.cc:1434] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.192s	user 0.007s	sys 0.000s
I20260709 12:21:45.296355 30979 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:45.281121 30983 raft_consensus.cc:359] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.306304 30983 raft_consensus.cc:385] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.306696 30983 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.310168 30983 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.311983 30983 ts_tablet_manager.cc:1434] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.000s
I20260709 12:21:45.313338 30983 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:45.319154 31329 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.321686 30983 tablet_bootstrap.cc:654] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.324419 31337 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:21:45.324628 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46005.2us
I20260709 12:21:45.325199 31337 raft_consensus.cc:697] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:45.329262 31337 consensus_queue.cc:237] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.360989 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:45.362686 30857 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:45.364394 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:21:45.367878 30750 leader_election.cc:343] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.368521 31288 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.372320 31354 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:45.387780 30983 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.388427 30983 ts_tablet_manager.cc:1403] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.026s
I20260709 12:21:45.390669 30975 tablet_bootstrap.cc:654] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.393610 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:45.391459 30983 raft_consensus.cc:359] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.396535 30983 raft_consensus.cc:385] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.396955 30983 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.397702 30983 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.398314 30857 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.399937 30983 ts_tablet_manager.cc:1434] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:21:45.402083 31288 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.402635 31288 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.406037 31288 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.420799 30983 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:45.423635 30979 tablet_bootstrap.cc:654] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.428504 30682 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.446941 31353 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.450068 30679 catalog_manager.cc:5697] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.481204 30975 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:45.481710 30975 ts_tablet_manager.cc:1403] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.005s
I20260709 12:21:45.486150 30983 tablet_bootstrap.cc:654] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.486832 31288 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.520514 31352 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.524345 31288 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.521142 31352 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.528067 31352 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:45.529587 30975 raft_consensus.cc:359] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.530406 30975 raft_consensus.cc:385] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.530776 30975 raft_consensus.cc:740] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.531617 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:45.532546 30852 raft_consensus.cc:2393] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:45.540864 31344 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:45.545871 30979 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:45.545544 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:45.546530 30979 ts_tablet_manager.cc:1403] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.251s	user 0.011s	sys 0.022s
I20260709 12:21:45.531435 30975 consensus_queue.cc:260] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.555696 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:45.556394 30852 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.558526 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:45.568601 30979 raft_consensus.cc:359] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.571445 30979 raft_consensus.cc:385] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.571805 30979 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.572455 30979 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.574532 30899 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:45.575343 31352 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.578058 30975 ts_tablet_manager.cc:1434] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.003s
I20260709 12:21:45.581163 30979 ts_tablet_manager.cc:1434] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:21:45.582181 30983 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.582748 30983 ts_tablet_manager.cc:1403] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.012s
I20260709 12:21:45.584519 30979 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:45.589130 31352 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.597227 30852 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:45.599452 30983 raft_consensus.cc:359] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.602265 31353 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.605605 31353 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.606570 30983 raft_consensus.cc:385] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.606981 30983 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.607604 30983 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.608428 31353 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:45.612609 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:45.613229 30983 ts_tablet_manager.cc:1434] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.001s
I20260709 12:21:45.613459 30779 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:45.614426 30983 tablet_bootstrap.cc:492] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
W20260709 12:21:45.617218 30750 leader_election.cc:343] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.579178 30975 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:45.617805 30979 tablet_bootstrap.cc:654] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.625157 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:45.626271 30855 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 1: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:21:45.628511 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:45.629017 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:45.629720 31337 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.630491 31353 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.634073 30983 tablet_bootstrap.cc:654] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.640771 30975 tablet_bootstrap.cc:654] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.641700 30855 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.644006 31353 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:45.644111 31337 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:45.644972 31337 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.652200 31344 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.657148 30979 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:45.657594 30979 ts_tablet_manager.cc:1403] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.003s
I20260709 12:21:45.660354 30979 raft_consensus.cc:359] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.661060 30979 raft_consensus.cc:385] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.661335 30979 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.665280 30983 tablet_bootstrap.cc:492] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.665787 30983 ts_tablet_manager.cc:1403] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.052s	user 0.004s	sys 0.006s
I20260709 12:21:45.670614 30979 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.672928 30979 ts_tablet_manager.cc:1434] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 12:21:45.675274 30983 raft_consensus.cc:359] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.676059 30983 raft_consensus.cc:385] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.676337 30983 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.676237 30682 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.677371 30983 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.679878 30975 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:45.680377 30975 ts_tablet_manager.cc:1403] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.003s
I20260709 12:21:45.680514 31344 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.688014 30983 ts_tablet_manager.cc:1434] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:21:45.683660 30975 raft_consensus.cc:359] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.688696 30975 raft_consensus.cc:385] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.689095 30975 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.690013 30975 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.695408 30975 ts_tablet_manager.cc:1434] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:21:45.698593 30979 tablet_bootstrap.cc:492] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:45.703426 30983 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:45.701604 31288 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.706733 30975 tablet_bootstrap.cc:492] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:45.708513 31288 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.724277 30979 tablet_bootstrap.cc:654] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.728006 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:45.723649 31288 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:45.729988 30750 leader_election.cc:343] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.729890 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:45.730697 30852 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:45.732738 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:21:45.733695 31288 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.734122 31288 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.734468 31288 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.738157 30983 tablet_bootstrap.cc:654] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.739236 30975 tablet_bootstrap.cc:654] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.762835 31353 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.763530 30975 tablet_bootstrap.cc:492] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:45.763401 31353 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.764079 30975 ts_tablet_manager.cc:1403] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.017s
I20260709 12:21:45.764837 31288 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.765735 31353 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:45.766803 30975 raft_consensus.cc:359] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.767503 30975 raft_consensus.cc:385] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.767616 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:45.768353 30779 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 0.
I20260709 12:21:45.769423 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:21:45.772640 30900 leader_election.cc:343] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.774953 30979 tablet_bootstrap.cc:492] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:45.775791 30983 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.777608 30983 ts_tablet_manager.cc:1403] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.010s
I20260709 12:21:45.778841 30899 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:21:45.780676 31352 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.781040 31352 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.767838 30975 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.781375 31352 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.781627 30983 raft_consensus.cc:359] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.781997 30975 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.782423 30983 raft_consensus.cc:385] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.782800 30983 raft_consensus.cc:740] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.783687 30975 ts_tablet_manager.cc:1434] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.005s
I20260709 12:21:45.783434 30979 ts_tablet_manager.cc:1403] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.014s
I20260709 12:21:45.789135 30983 consensus_queue.cc:260] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.789958 30975 tablet_bootstrap.cc:492] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: Bootstrap starting.
I20260709 12:21:45.791908 30983 ts_tablet_manager.cc:1434] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:21:45.793429 30983 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:45.767124 31288 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.795300 31352 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.798271 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:45.798866 30779 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.802201 30983 tablet_bootstrap.cc:654] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.807315 30975 tablet_bootstrap.cc:654] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.807435 30979 raft_consensus.cc:359] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.809970 30979 raft_consensus.cc:385] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.810588 30979 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.813666 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:45.818625 30852 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.821471 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:45.814517 30983 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.823361 30983 ts_tablet_manager.cc:1403] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.002s
I20260709 12:21:45.817489 30975 tablet_bootstrap.cc:492] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: No bootstrap required, opened a new log
I20260709 12:21:45.825378 30975 ts_tablet_manager.cc:1403] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.002s
I20260709 12:21:45.826728 30983 raft_consensus.cc:359] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.827543 30983 raft_consensus.cc:385] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.827839 30983 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.829180 30975 raft_consensus.cc:359] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.829919 30975 raft_consensus.cc:385] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.830186 30975 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.830962 30975 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.831802 30852 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:45.832571 30975 ts_tablet_manager.cc:1434] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:45.832854 30983 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.833678 30979 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.838255 30934 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.835215 30983 ts_tablet_manager.cc:1434] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:45.839828 30983 tablet_bootstrap.cc:492] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:45.841740 30779 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:45.842857 30899 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:45.843801 31344 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.844949 31344 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:21:45.846359 30983 tablet_bootstrap.cc:654] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.846650 31344 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.851125 30934 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:45.853094 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:45.853664 30979 ts_tablet_manager.cc:1434] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:21:45.853842 30852 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.854804 30979 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:45.861918 30979 tablet_bootstrap.cc:654] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.862167 30852 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:21:45.863080 31352 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:45.868388 30983 tablet_bootstrap.cc:492] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.870078 30983 ts_tablet_manager.cc:1403] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.000s
I20260709 12:21:45.875607 30983 raft_consensus.cc:359] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.876650 30983 raft_consensus.cc:385] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.877020 30983 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.877828 30983 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.880597 30983 ts_tablet_manager.cc:1434] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:21:45.883913 30983 tablet_bootstrap.cc:492] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Bootstrap starting.
I20260709 12:21:45.881316 30681 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:45.886814 30979 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:45.888010 30979 ts_tablet_manager.cc:1403] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.004s
I20260709 12:21:45.870177 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:45.891588 31288 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.891862 30983 tablet_bootstrap.cc:654] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.892151 31288 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:45.893276 30979 raft_consensus.cc:359] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.894176 30979 raft_consensus.cc:385] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.894454 30979 raft_consensus.cc:740] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.895097 30979 consensus_queue.cc:260] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.897384 30979 ts_tablet_manager.cc:1434] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.002s
I20260709 12:21:45.893211 31288 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.901136 30979 tablet_bootstrap.cc:492] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:45.881901 31187 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.907425 31187 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.909614 31187 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.916683 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:21:45.917409 30778 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 0.
I20260709 12:21:45.920076 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:45.921620 31275 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.922014 31275 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.922343 31275 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.924175 31354 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:45.938709 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:45.941311 31275 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.942095 31337 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:45.954388 30826 leader_election.cc:343] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:45.958844 30983 tablet_bootstrap.cc:492] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: No bootstrap required, opened a new log
I20260709 12:21:45.958859 31275 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.959566 30983 ts_tablet_manager.cc:1403] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.021s
I20260709 12:21:45.963003 30983 raft_consensus.cc:359] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.963935 30983 raft_consensus.cc:385] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.964254 30983 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.964982 30983 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.967512 30983 ts_tablet_manager.cc:1434] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:21:45.969139 31288 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:45.969671 31288 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.971982 31288 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:45.977088 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:45.977861 30857 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:45.980459 30680 catalog_manager.cc:5697] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:45.981387 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:45.982252 30929 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:45.983850 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:21:45.984532 30779 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.984341 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:45.986090 31337 raft_consensus.cc:2804] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:45.986492 31337 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:45.986873 31337 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.989393 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:45.995630 30779 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:21:45.993563 31337 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:45.997046 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:45.999994 31337 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:46.000427 30826 leader_election.cc:343] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:46.003901 31330 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.004451 31330 raft_consensus.cc:697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:21:46.005052 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:46.005723 30934 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.005388 31330 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.011296 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:46.012029 30852 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.014138 30934 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:46.019536 30979 tablet_bootstrap.cc:654] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.022769 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:46.023842 31348 raft_consensus.cc:2804] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.024482 31348 raft_consensus.cc:697] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:46.025410 31348 consensus_queue.cc:237] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.027822 30852 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:46.055536 30679 catalog_manager.cc:5697] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.059995 30979 tablet_bootstrap.cc:492] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:46.060643 30979 ts_tablet_manager.cc:1403] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.160s	user 0.026s	sys 0.009s
I20260709 12:21:46.063684 30979 raft_consensus.cc:359] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.064371 30979 raft_consensus.cc:385] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.064628 30979 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.065317 30979 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.067559 30979 ts_tablet_manager.cc:1434] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:46.068579 30979 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:46.071334 30681 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 0 to 1, leader changed from <none> to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.074572 30979 tablet_bootstrap.cc:654] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.086302 30979 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:46.086819 30979 ts_tablet_manager.cc:1403] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:21:46.089807 30979 raft_consensus.cc:359] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.090554 30979 raft_consensus.cc:385] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.090849 30979 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.091749 30979 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.094097 30979 ts_tablet_manager.cc:1434] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:46.095295 30979 tablet_bootstrap.cc:492] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Bootstrap starting.
I20260709 12:21:46.101627 30979 tablet_bootstrap.cc:654] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:46.108474 30979 tablet_bootstrap.cc:492] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: No bootstrap required, opened a new log
I20260709 12:21:46.108938 30979 ts_tablet_manager.cc:1403] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:21:46.111536 30979 raft_consensus.cc:359] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.112286 30979 raft_consensus.cc:385] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:46.112612 30979 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Initialized, Role: FOLLOWER
I20260709 12:21:46.113320 30979 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.115586 30979 ts_tablet_manager.cc:1434] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:46.173530 31337 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.174045 31337 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.176122 31337 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:46.177305 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:46.177377 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:46.178273 30929 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:46.178165 30854 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:46.179927 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:46.179862 31288 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:46.180841 31337 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.181205 31337 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.181509 31337 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.188531 31337 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.191056 31337 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:46.192404 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:46.193001 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:46.193236 30854 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.193568 30934 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.198432 30934 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:46.199702 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:46.200461 31337 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.200934 31337 raft_consensus.cc:697] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:46.201776 31337 consensus_queue.cc:237] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.209479 30854 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:46.213027 31348 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.229640 30681 catalog_manager.cc:5697] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.255865 31337 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:46.256356 31337 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.258123 31337 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:46.258682 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:21:46.258971 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:21:46.259330 30852 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:46.259528 30934 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 0.
I20260709 12:21:46.260598 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:21:46.261309 31337 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:46.261730 31337 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:46.262140 31337 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:46.264564 30730 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:46.267762 31337 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.272090 31337 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:46.273289 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:21:46.273209 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:21:46.274032 30852 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.273914 30934 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.279628 30934 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:46.279803 30852 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:21:46.280611 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:21:46.281188 31337 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:46.281697 31337 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:21:46.282465 31337 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:46.293949 31352 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.293803 30679 catalog_manager.cc:5697] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:46.304563 31353 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.363226 31343 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.391896 31343 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.411799 30934 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:46.428176 31330 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.461479 31330 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.492648 31343 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.507957 31348 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.674088 31343 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.687014 31354 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.827747 31348 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:46.829720 31348 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:47.753454 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:47.787873 31465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:47.788061 31466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:47.788300 31468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:47.792318 29609 server_base.cc:1061] running on GCE node
I20260709 12:21:47.793577 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:47.793857 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:47.794075 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599707794055 us; error 0 us; skew 500 ppm
I20260709 12:21:47.794689 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:47.802192 29609 webserver.cc:533] Webserver started at http://127.28.234.68:35039/ using document root <none> and password file <none>
I20260709 12:21:47.803073 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:47.803340 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:47.803829 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:47.805202 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-3-root/instance:
uuid: "7857bffc34ce4e1db3617488701b9810"
format_stamp: "Formatted at 2026-07-09 12:21:47 on dist-test-slave-8c39"
I20260709 12:21:47.810046 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:21:47.813565 31473 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:47.814544 29609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:21:47.814966 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-3-root
uuid: "7857bffc34ce4e1db3617488701b9810"
format_stamp: "Formatted at 2026-07-09 12:21:47 on dist-test-slave-8c39"
I20260709 12:21:47.815376 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:47.836256 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:47.837751 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:47.839600 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:47.842731 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:47.842965 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:47.843261 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:47.843456 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:47.911953 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.68:38747
I20260709 12:21:47.912015 31535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.68:38747 every 8 connection(s)
I20260709 12:21:47.916585 29609 auto_leader_rebalancer-test.cc:439] add a tserver: 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:47.930047 31536 heartbeater.cc:344] Connected to a master server at 127.28.234.126:42357
I20260709 12:21:47.930580 31536 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:47.931505 31536 heartbeater.cc:507] Master 127.28.234.126:42357 requested a full tablet report, sending...
I20260709 12:21:47.933694 30679 ts_manager.cc:194] Registered new tserver with Master: 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:21:47.935673 30679 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42312
I20260709 12:21:48.405843 30779 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:48.413393 30935 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.413540 30852 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.416004 31348 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.416923 31354 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.427907 31343 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.429690 30929 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.432518 30852 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
W20260709 12:21:48.438369 30750 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9cf061659071464dadafceeb712b1c5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.447958 30679 catalog_manager.cc:5697] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.466616 30852 consensus_queue.cc:237] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:48.482780 30781 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.484790 31463 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.486091 30929 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.489190 31540 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:48.503029 30826 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec82b6c4e54048a8a16a319c0cb38d23. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.508116 31540 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.511102 30781 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.546031 30934 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.576905 30934 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:48.585179 30680 catalog_manager.cc:5697] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.629166 30855 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.630115 30781 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.630895 31560 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.632334 31344 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:48.638607 30900 consensus_peers.cc:597] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e6c0595eb2284ea9b8da2832d8558f7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.645398 31560 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.647239 30781 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.651347 30855 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.663750 30929 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:48.669551 30682 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.685261 30855 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.687768 31560 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:48.690639 30900 consensus_peers.cc:597] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84dde2d8ff054417a11a7ec410d2ffd2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:48.692209 30779 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:48.693863 31344 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.700146 31353 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.709988 30855 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.726018 30779 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:48.735090 30682 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.938259 31536 heartbeater.cc:499] Master 127.28.234.126:42357 was elected leader, sending a full tablet report...
I20260709 12:21:48.984732 31567 ts_tablet_manager.cc:933] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:48.990660 31567 tablet_copy_client.cc:323] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:21:49.010361 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet e6c0595eb2284ea9b8da2832d8558f7e from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:21:49.011044 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet e6c0595eb2284ea9b8da2832d8558f7e from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-e6c0595eb2284ea9b8da2832d8558f7e
I20260709 12:21:49.020475 31570 ts_tablet_manager.cc:933] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:49.020512 30945 tablet_copy_source_session.cc:215] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:49.025254 31570 tablet_copy_client.cc:323] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.65:46329
I20260709 12:21:49.025399 31567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6c0595eb2284ea9b8da2832d8558f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:49.051550 30795 tablet_copy_service.cc:140] P 5e7509fe1be74f179626fb4fcb4b4e65: Received BeginTabletCopySession request for tablet 9cf061659071464dadafceeb712b1c5d from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:32970)
I20260709 12:21:49.052211 30795 tablet_copy_service.cc:161] P 5e7509fe1be74f179626fb4fcb4b4e65: Beginning new tablet copy session on tablet 9cf061659071464dadafceeb712b1c5d from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:32970: session id = 7857bffc34ce4e1db3617488701b9810-9cf061659071464dadafceeb712b1c5d
I20260709 12:21:49.054301 31567 tablet_copy_client.cc:806] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:49.055002 31567 tablet_copy_client.cc:670] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:49.062217 31567 tablet_copy_client.cc:538] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:49.064201 30795 tablet_copy_source_session.cc:215] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:49.067082 31573 ts_tablet_manager.cc:933] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:49.068116 31570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cf061659071464dadafceeb712b1c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:49.072176 31567 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:49.082629 31573 tablet_copy_client.cc:323] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.66:33903
I20260709 12:21:49.121791 31570 tablet_copy_client.cc:806] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:49.142797 31570 tablet_copy_client.cc:670] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:49.147609 31567 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.150635 31570 tablet_copy_client.cc:538] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:49.152750 31567 tablet_bootstrap.cc:492] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:49.153525 31567 ts_tablet_manager.cc:1403] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.082s	user 0.031s	sys 0.023s
I20260709 12:21:49.156836 31567 raft_consensus.cc:359] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.157744 31567 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:49.158416 31567 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.167377 30870 tablet_copy_service.cc:140] P 764ebfd36ce64b2a86e6d290ae92e276: Received BeginTabletCopySession request for tablet ec82b6c4e54048a8a16a319c0cb38d23 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:41694)
I20260709 12:21:49.168073 30870 tablet_copy_service.cc:161] P 764ebfd36ce64b2a86e6d290ae92e276: Beginning new tablet copy session on tablet ec82b6c4e54048a8a16a319c0cb38d23 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:41694: session id = 7857bffc34ce4e1db3617488701b9810-ec82b6c4e54048a8a16a319c0cb38d23
I20260709 12:21:49.172886 31567 ts_tablet_manager.cc:1434] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 12:21:49.173100 31570 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:49.182446 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-e6c0595eb2284ea9b8da2832d8558f7e received from {username='slave'} at 127.0.0.1:33366
I20260709 12:21:49.182996 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-e6c0595eb2284ea9b8da2832d8558f7e on tablet e6c0595eb2284ea9b8da2832d8558f7e with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:49.188820 31567 ts_tablet_manager.cc:933] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:49.194938 31567 tablet_copy_client.cc:323] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:21:49.192255 30870 tablet_copy_source_session.cc:215] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:49.202425 31573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec82b6c4e54048a8a16a319c0cb38d23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:49.207178 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet 84dde2d8ff054417a11a7ec410d2ffd2 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:21:49.208022 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet 84dde2d8ff054417a11a7ec410d2ffd2 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-84dde2d8ff054417a11a7ec410d2ffd2
I20260709 12:21:49.218185 30945 tablet_copy_source_session.cc:215] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:49.222342 31567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84dde2d8ff054417a11a7ec410d2ffd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:49.226835 31573 tablet_copy_client.cc:806] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:49.227466 31573 tablet_copy_client.cc:670] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:49.235796 31570 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.236985 31570 tablet_bootstrap.cc:492] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:49.237726 31570 ts_tablet_manager.cc:1403] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.012s
I20260709 12:21:49.237735 31573 tablet_copy_client.cc:538] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:49.241161 31567 tablet_copy_client.cc:806] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:49.242024 31567 tablet_copy_client.cc:670] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:49.241849 31570 raft_consensus.cc:359] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.242964 31570 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:49.243790 31570 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.248562 31570 ts_tablet_manager.cc:1434] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:21:49.246899 31567 tablet_copy_client.cc:538] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:49.251346 30795 tablet_copy_service.cc:342] P 5e7509fe1be74f179626fb4fcb4b4e65: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-9cf061659071464dadafceeb712b1c5d received from {username='slave'} at 127.0.0.1:32970
I20260709 12:21:49.251802 30795 tablet_copy_service.cc:434] P 5e7509fe1be74f179626fb4fcb4b4e65: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-9cf061659071464dadafceeb712b1c5d on tablet 9cf061659071464dadafceeb712b1c5d with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:49.267692 31573 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:49.267993 31567 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:49.302878 31573 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.305444 31567 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:49.306592 31567 tablet_bootstrap.cc:492] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:49.305610 31573 tablet_bootstrap.cc:492] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:49.307442 31567 ts_tablet_manager.cc:1403] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.040s	user 0.024s	sys 0.000s
I20260709 12:21:49.308063 31573 ts_tablet_manager.cc:1403] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.015s
I20260709 12:21:49.311283 31567 raft_consensus.cc:359] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.312389 31567 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:49.312103 31573 raft_consensus.cc:359] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.313411 31573 raft_consensus.cc:740] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:49.313882 31567 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.316695 31567 ts_tablet_manager.cc:1434] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:49.323009 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-84dde2d8ff054417a11a7ec410d2ffd2 received from {username='slave'} at 127.0.0.1:33366
I20260709 12:21:49.323503 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-84dde2d8ff054417a11a7ec410d2ffd2 on tablet 84dde2d8ff054417a11a7ec410d2ffd2 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:49.314198 31573 consensus_queue.cc:260] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:49.330809 31573 ts_tablet_manager.cc:1434] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:21:49.332881 30870 tablet_copy_service.cc:342] P 764ebfd36ce64b2a86e6d290ae92e276: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-ec82b6c4e54048a8a16a319c0cb38d23 received from {username='slave'} at 127.0.0.1:41694
I20260709 12:21:49.333420 30870 tablet_copy_service.cc:434] P 764ebfd36ce64b2a86e6d290ae92e276: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-ec82b6c4e54048a8a16a319c0cb38d23 on tablet ec82b6c4e54048a8a16a319c0cb38d23 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:49.509817 31511 raft_consensus.cc:1217] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:49.537479 31511 raft_consensus.cc:1217] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:49.630657 31511 raft_consensus.cc:1217] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:49.700917 31511 raft_consensus.cc:1217] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:49.984985 31329 raft_consensus.cc:1064] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:49.987622 31329 consensus_queue.cc:237] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:49.995589 31511 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:49.997730 30779 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:49.997867 30934 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:49.998441 31463 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.000177 31463 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.003378 31463 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.034328 31329 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.035940 30779 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.042428 30935 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.052528 31511 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.067157 31344 raft_consensus.cc:1064] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:50.069343 30680 catalog_manager.cc:5697] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.069479 31344 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:50.085474 30781 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.085534 31511 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.088347 31560 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.090420 30855 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.095837 31353 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:50.113708 31560 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:50.125674 31589 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.130373 31511 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.140020 30781 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.150897 30852 consensus_queue.cc:237] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:50.151371 30855 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.161922 31510 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.164915 31463 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.169648 31590 raft_consensus.cc:1064] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:50.173707 31590 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:50.177031 31343 raft_consensus.cc:1064] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:50.177735 30781 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.179352 31343 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:50.181180 31463 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.192608 30682 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.195887 30779 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.197418 31589 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.197439 31329 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.199627 31511 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.201627 31510 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.206310 30779 raft_consensus.cc:2955] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.210841 31560 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:50.214735 30855 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.230970 30855 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.232153 31560 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.235718 30935 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.238463 31510 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:50.250586 31600 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:50.252023 31354 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.257958 31354 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:50.274767 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec82b6c4e54048a8a16a319c0cb38d23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:50.286980 30934 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:50.287813 30680 catalog_manager.cc:5697] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.294607 31509 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.296309 31590 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:50.306062 30856 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.311169 31344 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.313113 30916 tablet_service.cc:1558] Processing DeleteTablet for tablet ec82b6c4e54048a8a16a319c0cb38d23 with delete_type TABLET_DATA_TOMBSTONED (TS 47c0d0bc235a443aad3c62643e91b081 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49608
I20260709 12:21:50.312518 31510 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.322330 31589 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.324069 31511 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.326972 31353 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.346199 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e6c0595eb2284ea9b8da2832d8558f7e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:50.350072 30680 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:50.351999 30682 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.352394 30852 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.354918 31609 tablet_replica.cc:333] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:21:50.355634 30855 raft_consensus.cc:2955] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.361002 31609 raft_consensus.cc:2243] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.363539 30769 tablet_service.cc:1558] Processing DeleteTablet for tablet e6c0595eb2284ea9b8da2832d8558f7e with delete_type TABLET_DATA_TOMBSTONED (TS 5e7509fe1be74f179626fb4fcb4b4e65 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54636
I20260709 12:21:50.375802 30778 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.395515 31343 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.423875 31609 raft_consensus.cc:2272] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:50.429184 31609 ts_tablet_manager.cc:1916] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:50.444043 30852 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.455102 31511 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.470891 31611 tablet_replica.cc:333] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:21:50.474500 30680 catalog_manager.cc:5697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.480487 31611 raft_consensus.cc:2243] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.481460 31611 raft_consensus.cc:2272] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:50.480383 30930 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.488742 31611 ts_tablet_manager.cc:1916] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:50.498508 31609 ts_tablet_manager.cc:1929] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:50.499280 31609 log.cc:1199] T ec82b6c4e54048a8a16a319c0cb38d23 P 47c0d0bc235a443aad3c62643e91b081: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/wals/ec82b6c4e54048a8a16a319c0cb38d23
I20260709 12:21:50.501137 30668 catalog_manager.cc:5028] TS 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): tablet ec82b6c4e54048a8a16a319c0cb38d23 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:50.501801 30934 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:50.508136 31511 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.508407 30856 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.509681 31560 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:50.511947 31344 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:50.527638 31610 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.544206 31611 ts_tablet_manager.cc:1929] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:50.544773 31611 log.cc:1199] T e6c0595eb2284ea9b8da2832d8558f7e P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/wals/e6c0595eb2284ea9b8da2832d8558f7e
I20260709 12:21:50.547075 30667 catalog_manager.cc:5028] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): tablet e6c0595eb2284ea9b8da2832d8558f7e (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:50.530151 31511 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.552601 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 84dde2d8ff054417a11a7ec410d2ffd2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:50.572222 30855 raft_consensus.cc:2955] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.577139 30781 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:50.580842 30681 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.589550 31511 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.591325 30930 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:50.596356 31612 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:50.597404 30769 tablet_service.cc:1558] Processing DeleteTablet for tablet 84dde2d8ff054417a11a7ec410d2ffd2 with delete_type TABLET_DATA_TOMBSTONED (TS 5e7509fe1be74f179626fb4fcb4b4e65 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54636
I20260709 12:21:50.598469 31611 tablet_replica.cc:333] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:21:50.599613 31611 raft_consensus.cc:2243] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.600288 31611 raft_consensus.cc:2272] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:50.604336 31611 ts_tablet_manager.cc:1916] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:50.617678 31612 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:50.642204 31611 ts_tablet_manager.cc:1929] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:50.642753 31611 log.cc:1199] T 84dde2d8ff054417a11a7ec410d2ffd2 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/wals/84dde2d8ff054417a11a7ec410d2ffd2
I20260709 12:21:50.644601 30667 catalog_manager.cc:5028] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): tablet 84dde2d8ff054417a11a7ec410d2ffd2 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:50.654654 31348 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.663874 30930 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.668728 30667 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9cf061659071464dadafceeb712b1c5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:50.680886 31511 raft_consensus.cc:2955] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.690659 30681 catalog_manager.cc:5697] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:50.705559 30848 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cf061659071464dadafceeb712b1c5d with delete_type TABLET_DATA_TOMBSTONED (TS 764ebfd36ce64b2a86e6d290ae92e276 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42848
I20260709 12:21:50.707746 31614 tablet_replica.cc:333] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:21:50.708611 31614 raft_consensus.cc:2243] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:50.709249 31614 raft_consensus.cc:2272] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:50.714355 31614 ts_tablet_manager.cc:1916] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:50.727917 31614 ts_tablet_manager.cc:1929] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:50.728394 31614 log.cc:1199] T 9cf061659071464dadafceeb712b1c5d P 764ebfd36ce64b2a86e6d290ae92e276: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/wals/9cf061659071464dadafceeb712b1c5d
I20260709 12:21:50.730280 30668 catalog_manager.cc:5028] TS 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): tablet 9cf061659071464dadafceeb712b1c5d (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:51.775462 30779 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:51.782531 30934 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:51.785259 31600 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:51.788097 30750 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43064b77bf3a4ab5aa00dfd9ad2d31de. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.788630 30855 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:51.789916 31619 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:51.794716 31600 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.796651 30930 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.804272 30855 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.808360 30779 consensus_queue.cc:237] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:51.816383 30682 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.821698 30855 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:51.823184 30930 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:51.827299 31600 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:51.828493 31618 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:51.830008 30750 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3bb0278198af4c1aba82199de860057a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.840515 31618 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.842497 30855 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.844966 30930 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.862869 30930 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:51.872537 30855 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:51.876084 31630 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:51.880888 30900 consensus_peers.cc:597] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49daeb92ae08415eb56869e7df8fc686. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.880371 30680 catalog_manager.cc:5697] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.885077 30779 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:51.886641 31344 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:51.897816 31610 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.905603 30779 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.913479 30855 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.922351 30781 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:51.922657 30680 catalog_manager.cc:5697] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.937708 30935 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:51.940186 30750 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea1fc0f15e994691a2edf5f0c3b096eb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:51.940223 31618 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:51.952033 30855 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:51.953438 31618 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:51.960053 31600 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.966579 30935 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.989899 30855 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:51.992513 30680 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:52.211310 31636 ts_tablet_manager.cc:933] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:52.217373 31636 tablet_copy_client.cc:323] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.65:46329
I20260709 12:21:52.219134 30795 tablet_copy_service.cc:140] P 5e7509fe1be74f179626fb4fcb4b4e65: Received BeginTabletCopySession request for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:32970)
I20260709 12:21:52.219707 30795 tablet_copy_service.cc:161] P 5e7509fe1be74f179626fb4fcb4b4e65: Beginning new tablet copy session on tablet 43064b77bf3a4ab5aa00dfd9ad2d31de from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:32970: session id = 7857bffc34ce4e1db3617488701b9810-43064b77bf3a4ab5aa00dfd9ad2d31de
I20260709 12:21:52.226807 30795 tablet_copy_source_session.cc:215] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:52.229650 31636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:52.244288 31636 tablet_copy_client.cc:806] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:52.244868 31636 tablet_copy_client.cc:670] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:52.248772 31636 tablet_copy_client.cc:538] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:52.258013 31636 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:52.276239 31639 ts_tablet_manager.cc:933] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:52.277729 31636 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.279012 31636 tablet_bootstrap.cc:492] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:52.279981 31636 ts_tablet_manager.cc:1403] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.022s	user 0.023s	sys 0.000s
I20260709 12:21:52.281329 31639 tablet_copy_client.cc:323] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:21:52.283259 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet 49daeb92ae08415eb56869e7df8fc686 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:21:52.283188 31636 raft_consensus.cc:359] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.283986 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet 49daeb92ae08415eb56869e7df8fc686 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-49daeb92ae08415eb56869e7df8fc686
I20260709 12:21:52.284188 31636 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:52.284852 31636 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.288266 31636 ts_tablet_manager.cc:1434] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:21:52.290167 30795 tablet_copy_service.cc:342] P 5e7509fe1be74f179626fb4fcb4b4e65: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-43064b77bf3a4ab5aa00dfd9ad2d31de received from {username='slave'} at 127.0.0.1:32970
I20260709 12:21:52.290597 30795 tablet_copy_service.cc:434] P 5e7509fe1be74f179626fb4fcb4b4e65: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-43064b77bf3a4ab5aa00dfd9ad2d31de on tablet 43064b77bf3a4ab5aa00dfd9ad2d31de with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:52.296447 30945 tablet_copy_source_session.cc:215] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:52.311793 31639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49daeb92ae08415eb56869e7df8fc686. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:52.325402 31639 tablet_copy_client.cc:806] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:52.325970 31639 tablet_copy_client.cc:670] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:52.329778 31639 tablet_copy_client.cc:538] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:52.334302 31636 ts_tablet_manager.cc:933] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:52.336192 31636 tablet_copy_client.cc:323] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.65:46329
I20260709 12:21:52.337062 31639 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:52.338196 30795 tablet_copy_service.cc:140] P 5e7509fe1be74f179626fb4fcb4b4e65: Received BeginTabletCopySession request for tablet 3bb0278198af4c1aba82199de860057a from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:32970)
I20260709 12:21:52.338862 30795 tablet_copy_service.cc:161] P 5e7509fe1be74f179626fb4fcb4b4e65: Beginning new tablet copy session on tablet 3bb0278198af4c1aba82199de860057a from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:32970: session id = 7857bffc34ce4e1db3617488701b9810-3bb0278198af4c1aba82199de860057a
I20260709 12:21:52.348199 30795 tablet_copy_source_session.cc:215] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:52.351809 31636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bb0278198af4c1aba82199de860057a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:52.366274 31639 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.367170 31639 tablet_bootstrap.cc:492] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:52.367937 31639 ts_tablet_manager.cc:1403] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.009s
I20260709 12:21:52.371016 31639 raft_consensus.cc:359] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.371847 31639 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:52.372493 31639 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.381922 31639 ts_tablet_manager.cc:1434] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:21:52.387248 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-49daeb92ae08415eb56869e7df8fc686 received from {username='slave'} at 127.0.0.1:33366
I20260709 12:21:52.387730 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-49daeb92ae08415eb56869e7df8fc686 on tablet 49daeb92ae08415eb56869e7df8fc686 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:52.389158 31636 tablet_copy_client.cc:806] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:52.389807 31636 tablet_copy_client.cc:670] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:52.393738 31636 tablet_copy_client.cc:538] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:52.405229 31636 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:52.422839 31636 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.423830 31636 tablet_bootstrap.cc:492] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:52.424504 31636 ts_tablet_manager.cc:1403] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.005s
I20260709 12:21:52.428520 31636 raft_consensus.cc:359] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.429533 31636 raft_consensus.cc:740] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:52.430297 31636 consensus_queue.cc:260] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.432966 31636 ts_tablet_manager.cc:1434] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:21:52.435636 30795 tablet_copy_service.cc:342] P 5e7509fe1be74f179626fb4fcb4b4e65: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-3bb0278198af4c1aba82199de860057a received from {username='slave'} at 127.0.0.1:32970
I20260709 12:21:52.436081 30795 tablet_copy_service.cc:434] P 5e7509fe1be74f179626fb4fcb4b4e65: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-3bb0278198af4c1aba82199de860057a on tablet 3bb0278198af4c1aba82199de860057a with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:52.522195 31636 ts_tablet_manager.cc:933] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:52.526304 31636 tablet_copy_client.cc:323] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.65:46329
I20260709 12:21:52.528297 30795 tablet_copy_service.cc:140] P 5e7509fe1be74f179626fb4fcb4b4e65: Received BeginTabletCopySession request for tablet ea1fc0f15e994691a2edf5f0c3b096eb from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:32970)
I20260709 12:21:52.528940 30795 tablet_copy_service.cc:161] P 5e7509fe1be74f179626fb4fcb4b4e65: Beginning new tablet copy session on tablet ea1fc0f15e994691a2edf5f0c3b096eb from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:32970: session id = 7857bffc34ce4e1db3617488701b9810-ea1fc0f15e994691a2edf5f0c3b096eb
I20260709 12:21:52.546882 30795 tablet_copy_source_session.cc:215] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:52.550951 31636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea1fc0f15e994691a2edf5f0c3b096eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:52.577781 31636 tablet_copy_client.cc:806] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:52.578440 31636 tablet_copy_client.cc:670] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:52.583163 31636 tablet_copy_client.cc:538] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:52.590627 31636 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:52.610203 31636 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:52.611076 31636 tablet_bootstrap.cc:492] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:52.611698 31636 ts_tablet_manager.cc:1403] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 12:21:52.614178 31636 raft_consensus.cc:359] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.614869 31636 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:52.615468 31636 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:52.618391 31636 ts_tablet_manager.cc:1434] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:21:52.624527 30795 tablet_copy_service.cc:342] P 5e7509fe1be74f179626fb4fcb4b4e65: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-ea1fc0f15e994691a2edf5f0c3b096eb received from {username='slave'} at 127.0.0.1:32970
I20260709 12:21:52.624992 30795 tablet_copy_service.cc:434] P 5e7509fe1be74f179626fb4fcb4b4e65: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-ea1fc0f15e994691a2edf5f0c3b096eb on tablet ea1fc0f15e994691a2edf5f0c3b096eb with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:52.746961 31511 raft_consensus.cc:1217] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:52.774966 31511 raft_consensus.cc:1217] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:52.831779 31511 raft_consensus.cc:1217] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:52.938706 31511 raft_consensus.cc:1217] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:53.258699 31610 raft_consensus.cc:1064] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:53.261034 31610 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.267673 31511 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.269021 31646 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:53.268537 30856 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.271732 31646 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:53.279452 30781 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.280987 31610 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:53.283582 31610 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.293143 30856 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.300668 30781 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.311252 31511 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.323706 30682 catalog_manager.cc:5697] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.331162 31619 raft_consensus.cc:1064] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:53.344165 31619 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.367635 30935 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.373818 31511 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.379477 30930 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.380810 31600 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:53.381798 30855 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.390400 30856 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.391947 31511 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.392021 31610 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:53.393325 31600 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:21:53.394106 31646 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:53.393098 31348 raft_consensus.cc:1064] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:53.396896 31619 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:53.405699 31646 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.415539 31348 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.421451 30855 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.449172 30679 catalog_manager.cc:5697] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.463591 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49daeb92ae08415eb56869e7df8fc686 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:53.471864 30852 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.472620 31510 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.475472 31658 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:53.477025 30934 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.481793 31663 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:53.486486 31658 raft_consensus.cc:1064] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:53.488427 31511 raft_consensus.cc:2955] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.489490 31658 consensus_queue.cc:237] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.494364 30769 tablet_service.cc:1558] Processing DeleteTablet for tablet 49daeb92ae08415eb56869e7df8fc686 with delete_type TABLET_DATA_TOMBSTONED (TS 5e7509fe1be74f179626fb4fcb4b4e65 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54636
I20260709 12:21:53.497153 31663 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:53.512223 31348 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.526885 31666 tablet_replica.cc:333] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:21:53.540568 30856 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.545238 31666 raft_consensus.cc:2243] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:53.560842 31666 raft_consensus.cc:2272] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:53.574061 30930 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.576116 31510 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.577399 31666 ts_tablet_manager.cc:1916] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:53.577623 30856 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:53.582438 30679 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.587057 30934 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.574635 31511 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.595799 31666 ts_tablet_manager.cc:1929] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:53.596304 31666 log.cc:1199] T 49daeb92ae08415eb56869e7df8fc686 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/wals/49daeb92ae08415eb56869e7df8fc686
I20260709 12:21:53.598070 30667 catalog_manager.cc:5028] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): tablet 49daeb92ae08415eb56869e7df8fc686 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:53.610066 31663 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:53.614553 31670 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.624219 30778 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.636628 31348 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:53.643090 31348 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:53.646694 31511 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.648629 30930 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.670982 30681 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:21:53.710345 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 67101.6us
I20260709 12:21:53.712217 30930 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.732339 31510 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.738289 30852 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.741982 31663 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:53.743896 31663 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:53.746971 31658 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.766350 30930 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.766948 30857 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.771107 31510 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.792423 30679 catalog_manager.cc:5697] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.801668 31663 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.809340 30934 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.817339 31510 raft_consensus.cc:2955] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.823763 30667 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:53.836499 30778 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.837874 30779 consensus_queue.cc:237] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:53.845870 31510 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.848258 30679 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.848977 31511 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.849601 30852 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.854206 30929 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:53.854853 31670 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:53.856067 31658 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:53.856333 31672 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:53.856987 31670 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:53.870415 30852 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.873243 31672 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.883316 30848 tablet_service.cc:1558] Processing DeleteTablet for tablet 43064b77bf3a4ab5aa00dfd9ad2d31de with delete_type TABLET_DATA_TOMBSTONED (TS 764ebfd36ce64b2a86e6d290ae92e276 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42848
I20260709 12:21:53.888046 31671 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.890288 31510 raft_consensus.cc:2955] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.897716 30934 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.898749 31511 raft_consensus.cc:2955] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.905722 30667 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea1fc0f15e994691a2edf5f0c3b096eb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:53.914551 30679 catalog_manager.cc:5697] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:53.914790 30681 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:53.917394 31677 tablet_replica.cc:333] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:21:53.919659 30667 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3bb0278198af4c1aba82199de860057a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:53.924968 31677 raft_consensus.cc:2243] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:53.925806 31677 raft_consensus.cc:2272] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:53.929169 30848 tablet_service.cc:1558] Processing DeleteTablet for tablet ea1fc0f15e994691a2edf5f0c3b096eb with delete_type TABLET_DATA_TOMBSTONED (TS 764ebfd36ce64b2a86e6d290ae92e276 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42848
I20260709 12:21:53.934859 31677 ts_tablet_manager.cc:1916] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:53.946712 30916 tablet_service.cc:1558] Processing DeleteTablet for tablet 3bb0278198af4c1aba82199de860057a with delete_type TABLET_DATA_TOMBSTONED (TS 47c0d0bc235a443aad3c62643e91b081 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49608
I20260709 12:21:53.948452 31678 tablet_replica.cc:333] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:21:53.949545 31678 raft_consensus.cc:2243] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:53.951892 31678 raft_consensus.cc:2272] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:53.957551 31678 ts_tablet_manager.cc:1916] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:53.958714 31677 ts_tablet_manager.cc:1929] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:53.959162 31677 log.cc:1199] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 764ebfd36ce64b2a86e6d290ae92e276: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/wals/43064b77bf3a4ab5aa00dfd9ad2d31de
I20260709 12:21:53.961113 30668 catalog_manager.cc:5028] TS 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): tablet 43064b77bf3a4ab5aa00dfd9ad2d31de (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:53.962301 31677 tablet_replica.cc:333] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:21:53.963454 31677 raft_consensus.cc:2243] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:53.964144 31677 raft_consensus.cc:2272] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:53.969695 31677 ts_tablet_manager.cc:1916] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:53.974879 31678 ts_tablet_manager.cc:1929] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:53.975503 31678 log.cc:1199] T 3bb0278198af4c1aba82199de860057a P 47c0d0bc235a443aad3c62643e91b081: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/wals/3bb0278198af4c1aba82199de860057a
I20260709 12:21:53.977695 30668 catalog_manager.cc:5028] TS 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): tablet 3bb0278198af4c1aba82199de860057a (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:53.992703 31677 ts_tablet_manager.cc:1929] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:53.993961 31677 log.cc:1199] T ea1fc0f15e994691a2edf5f0c3b096eb P 764ebfd36ce64b2a86e6d290ae92e276: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/wals/ea1fc0f15e994691a2edf5f0c3b096eb
I20260709 12:21:53.995452 30668 catalog_manager.cc:5028] TS 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): tablet ea1fc0f15e994691a2edf5f0c3b096eb (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:55.025463 30778 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.031323 30934 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:55.032583 30855 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:55.032882 30750 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c86ad2fde72a4917a713ec09d50d16ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:55.032897 31681 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:55.033963 31663 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:55.041265 31663 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.044513 30855 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.057734 30855 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.062717 30680 catalog_manager.cc:5697] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:55.071981 30929 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.077872 30930 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:55.079880 30826 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2323a4fe46444265864acf0869016ef4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:55.080427 31615 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:55.085000 30778 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:55.091452 31679 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:55.092509 31675 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.097721 30929 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.125507 30778 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.140090 30929 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.147799 30682 catalog_manager.cc:5697] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:55.167389 30778 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:55.168293 30852 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:21:55.168648 30900 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 047196043bb744a6b94cb3b634b80771. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:55.169602 31630 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:55.171077 31664 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:55.178822 31630 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.180213 30778 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.181492 30852 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.200484 30678 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.202245 30929 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.210254 30778 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:55.210408 30852 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:55.211609 31630 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:55.213274 31630 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:55.216701 30900 consensus_peers.cc:597] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1459f4eb71440ae996b2745034179c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:55.224881 31692 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.227555 30778 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.255177 30680 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:55.277786 30852 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:55.459136 31707 ts_tablet_manager.cc:933] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:55.474272 31707 tablet_copy_client.cc:323] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.65:46329
I20260709 12:21:55.503443 30795 tablet_copy_service.cc:140] P 5e7509fe1be74f179626fb4fcb4b4e65: Received BeginTabletCopySession request for tablet c86ad2fde72a4917a713ec09d50d16ef from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:32970)
I20260709 12:21:55.504282 30795 tablet_copy_service.cc:161] P 5e7509fe1be74f179626fb4fcb4b4e65: Beginning new tablet copy session on tablet c86ad2fde72a4917a713ec09d50d16ef from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:32970: session id = 7857bffc34ce4e1db3617488701b9810-c86ad2fde72a4917a713ec09d50d16ef
I20260709 12:21:55.528534 30795 tablet_copy_source_session.cc:215] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:55.537400 31707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86ad2fde72a4917a713ec09d50d16ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:55.580210 31707 tablet_copy_client.cc:806] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:55.580824 31707 tablet_copy_client.cc:670] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:55.584863 31707 tablet_copy_client.cc:538] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:55.593725 31707 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:55.617092 31707 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:55.618543 31707 tablet_bootstrap.cc:492] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:55.619443 31707 ts_tablet_manager.cc:1403] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.008s
I20260709 12:21:55.624226 31707 raft_consensus.cc:359] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.626039 31707 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:55.626901 31707 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.632884 31710 ts_tablet_manager.cc:933] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:55.632917 31707 ts_tablet_manager.cc:1434] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 12:21:55.635244 30795 tablet_copy_service.cc:342] P 5e7509fe1be74f179626fb4fcb4b4e65: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-c86ad2fde72a4917a713ec09d50d16ef received from {username='slave'} at 127.0.0.1:32970
I20260709 12:21:55.635764 30795 tablet_copy_service.cc:434] P 5e7509fe1be74f179626fb4fcb4b4e65: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-c86ad2fde72a4917a713ec09d50d16ef on tablet c86ad2fde72a4917a713ec09d50d16ef with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:55.641660 31710 tablet_copy_client.cc:323] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.66:33903
I20260709 12:21:55.643842 30870 tablet_copy_service.cc:140] P 764ebfd36ce64b2a86e6d290ae92e276: Received BeginTabletCopySession request for tablet 2323a4fe46444265864acf0869016ef4 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:41694)
I20260709 12:21:55.644526 30870 tablet_copy_service.cc:161] P 764ebfd36ce64b2a86e6d290ae92e276: Beginning new tablet copy session on tablet 2323a4fe46444265864acf0869016ef4 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:41694: session id = 7857bffc34ce4e1db3617488701b9810-2323a4fe46444265864acf0869016ef4
I20260709 12:21:55.662093 30870 tablet_copy_source_session.cc:215] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:55.669559 31710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2323a4fe46444265864acf0869016ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:55.695431 31710 tablet_copy_client.cc:806] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:55.696112 31710 tablet_copy_client.cc:670] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:55.702888 31710 tablet_copy_client.cc:538] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:55.703588 31707 ts_tablet_manager.cc:933] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:55.705500 31707 tablet_copy_client.cc:323] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:21:55.707852 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet 047196043bb744a6b94cb3b634b80771 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:21:55.708546 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet 047196043bb744a6b94cb3b634b80771 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-047196043bb744a6b94cb3b634b80771
I20260709 12:21:55.714082 31710 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:55.728456 30945 tablet_copy_source_session.cc:215] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:55.732971 31707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 047196043bb744a6b94cb3b634b80771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:55.774868 31710 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:55.775619 31707 tablet_copy_client.cc:806] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:55.776449 31710 tablet_bootstrap.cc:492] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:55.776712 31707 tablet_copy_client.cc:670] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:55.777918 31710 ts_tablet_manager.cc:1403] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.019s
I20260709 12:21:55.781582 31710 raft_consensus.cc:359] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.782709 31710 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:55.784184 31707 tablet_copy_client.cc:538] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:55.786827 31710 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.790254 31710 ts_tablet_manager.cc:1434] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:21:55.793689 30870 tablet_copy_service.cc:342] P 764ebfd36ce64b2a86e6d290ae92e276: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-2323a4fe46444265864acf0869016ef4 received from {username='slave'} at 127.0.0.1:41694
I20260709 12:21:55.794219 30870 tablet_copy_service.cc:434] P 764ebfd36ce64b2a86e6d290ae92e276: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-2323a4fe46444265864acf0869016ef4 on tablet 2323a4fe46444265864acf0869016ef4 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:55.815172 31510 raft_consensus.cc:1217] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:55.816358 31707 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:55.818186 31710 ts_tablet_manager.cc:933] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:55.832211 31710 tablet_copy_client.cc:323] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:21:55.834088 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet d1459f4eb71440ae996b2745034179c9 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:21:55.834681 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet d1459f4eb71440ae996b2745034179c9 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-d1459f4eb71440ae996b2745034179c9
I20260709 12:21:55.858191 30945 tablet_copy_source_session.cc:215] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:55.862480 31710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1459f4eb71440ae996b2745034179c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:55.886436 31710 tablet_copy_client.cc:806] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:55.887320 31710 tablet_copy_client.cc:670] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:55.890012 31707 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:55.891357 31707 tablet_bootstrap.cc:492] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:55.892475 31707 ts_tablet_manager.cc:1403] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.076s	user 0.029s	sys 0.008s
I20260709 12:21:55.892519 31710 tablet_copy_client.cc:538] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:55.896322 31707 raft_consensus.cc:359] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.897274 31707 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:55.898043 31707 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.901510 31707 ts_tablet_manager.cc:1434] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:55.903640 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-047196043bb744a6b94cb3b634b80771 received from {username='slave'} at 127.0.0.1:33366
I20260709 12:21:55.904204 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-047196043bb744a6b94cb3b634b80771 on tablet 047196043bb744a6b94cb3b634b80771 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:55.904865 31710 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:55.933039 31710 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:55.934002 31710 tablet_bootstrap.cc:492] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:55.934614 31710 ts_tablet_manager.cc:1403] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.009s
I20260709 12:21:55.937150 31710 raft_consensus.cc:359] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.937909 31710 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:55.938746 31710 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:55.941911 31710 ts_tablet_manager.cc:1434] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:21:55.944375 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-d1459f4eb71440ae996b2745034179c9 received from {username='slave'} at 127.0.0.1:33366
I20260709 12:21:55.944870 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-d1459f4eb71440ae996b2745034179c9 on tablet d1459f4eb71440ae996b2745034179c9 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:56.012713 31510 raft_consensus.cc:1217] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:56.082845 31510 raft_consensus.cc:1217] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:56.256361 31510 raft_consensus.cc:1217] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:56.373916 31703 raft_consensus.cc:1064] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:56.376097 31703 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:56.389302 31510 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.389338 30929 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.393308 31663 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.395364 31663 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:56.470297 30852 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.474787 31722 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:56.474892 31726 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.477382 31510 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.487685 30852 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.498656 30930 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.500136 30680 catalog_manager.cc:5697] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.542796 31704 raft_consensus.cc:1064] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:56.569252 31704 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:56.581372 31510 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.591264 30929 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.592859 31704 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:56.597550 31733 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.602856 30778 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.620600 31706 raft_consensus.cc:1064] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:56.623682 31706 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:56.639848 31679 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.655998 30857 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.656037 30779 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.656883 31706 raft_consensus.cc:1064] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:21:56.656615 31733 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.658893 31692 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.659158 30930 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.659945 31706 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:56.664678 31692 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.673137 31510 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.680199 31664 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.694888 30679 catalog_manager.cc:5697] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:56.706580 31692 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.711972 31509 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.721269 30777 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.724318 30781 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.699311 31510 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.752997 30682 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.753894 30852 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.768581 30855 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:56.779402 31511 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.781165 31664 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:56.788834 30781 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:56.792829 31679 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:56.800949 31509 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:56.804522 31679 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:56.809501 31679 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.811312 30929 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:56.812726 30852 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.817696 30781 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.828722 31664 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.838762 30777 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:21:56.840947 31718 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:56.842388 30779 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:56.843564 31508 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:56.844580 31664 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:56.846623 31706 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:56.847456 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2323a4fe46444265864acf0869016ef4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:56.852931 31509 raft_consensus.cc:2955] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.858341 31692 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.878338 30777 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.884721 30682 catalog_manager.cc:5697] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.898694 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 047196043bb744a6b94cb3b634b80771 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:56.902493 31692 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.906322 30916 tablet_service.cc:1558] Processing DeleteTablet for tablet 2323a4fe46444265864acf0869016ef4 with delete_type TABLET_DATA_TOMBSTONED (TS 47c0d0bc235a443aad3c62643e91b081 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49608
I20260709 12:21:56.911580 31511 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.918424 31509 raft_consensus.cc:2955] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.918470 31750 tablet_replica.cc:333] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:21:56.922479 30777 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.925215 31750 raft_consensus.cc:2243] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.923381 30852 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.926055 31750 raft_consensus.cc:2272] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.934571 30680 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 3 to 4, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:56.936614 30682 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:56.938678 31750 ts_tablet_manager.cc:1916] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:56.950116 30848 tablet_service.cc:1558] Processing DeleteTablet for tablet 047196043bb744a6b94cb3b634b80771 with delete_type TABLET_DATA_TOMBSTONED (TS 764ebfd36ce64b2a86e6d290ae92e276 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42848
I20260709 12:21:56.958998 31752 tablet_replica.cc:333] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:21:56.960210 31752 raft_consensus.cc:2243] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:56.962255 31752 raft_consensus.cc:2272] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:56.981369 31752 ts_tablet_manager.cc:1916] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:56.996187 31750 ts_tablet_manager.cc:1929] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:56.996980 31750 log.cc:1199] T 2323a4fe46444265864acf0869016ef4 P 47c0d0bc235a443aad3c62643e91b081: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/wals/2323a4fe46444265864acf0869016ef4
I20260709 12:21:57.003973 30668 catalog_manager.cc:5028] TS 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): tablet 2323a4fe46444265864acf0869016ef4 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:57.006560 30930 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:57.008399 31752 ts_tablet_manager.cc:1929] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:57.014946 31752 log.cc:1199] T 047196043bb744a6b94cb3b634b80771 P 764ebfd36ce64b2a86e6d290ae92e276: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/wals/047196043bb744a6b94cb3b634b80771
I20260709 12:21:57.017253 30668 catalog_manager.cc:5028] TS 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): tablet 047196043bb744a6b94cb3b634b80771 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:57.010836 30777 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:21:57.021842 31509 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:57.023761 31744 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:57.027087 31509 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:57.028596 30852 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:57.028705 31703 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:57.032485 31726 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:21:57.037580 30855 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:21:57.045044 31692 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:21:57.048918 31749 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:57.050760 30857 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:57.042048 31703 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:57.063957 31510 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:57.053574 31509 raft_consensus.cc:2955] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:57.084527 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1459f4eb71440ae996b2745034179c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:57.088315 30855 raft_consensus.cc:2955] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:57.090148 30678 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 3 to 4, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:21:57.091282 30682 catalog_manager.cc:5697] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 3 to 4, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:21:57.099376 30667 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c86ad2fde72a4917a713ec09d50d16ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:21:57.114746 30769 tablet_service.cc:1558] Processing DeleteTablet for tablet d1459f4eb71440ae996b2745034179c9 with delete_type TABLET_DATA_TOMBSTONED (TS 5e7509fe1be74f179626fb4fcb4b4e65 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54636
I20260709 12:21:57.121330 31753 tablet_replica.cc:333] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:21:57.122749 31753 raft_consensus.cc:2243] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.123471 31753 raft_consensus.cc:2272] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.132295 31753 ts_tablet_manager.cc:1916] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:57.132683 30916 tablet_service.cc:1558] Processing DeleteTablet for tablet c86ad2fde72a4917a713ec09d50d16ef with delete_type TABLET_DATA_TOMBSTONED (TS 47c0d0bc235a443aad3c62643e91b081 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49608
I20260709 12:21:57.138903 31750 tablet_replica.cc:333] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:21:57.140066 31750 raft_consensus.cc:2243] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.140743 31750 raft_consensus.cc:2272] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.148941 31750 ts_tablet_manager.cc:1916] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:21:57.156076 31753 ts_tablet_manager.cc:1929] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:57.156586 31753 log.cc:1199] T d1459f4eb71440ae996b2745034179c9 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/wals/d1459f4eb71440ae996b2745034179c9
I20260709 12:21:57.158541 30667 catalog_manager.cc:5028] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): tablet d1459f4eb71440ae996b2745034179c9 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:57.163573 31750 ts_tablet_manager.cc:1929] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:21:57.164127 31750 log.cc:1199] T c86ad2fde72a4917a713ec09d50d16ef P 47c0d0bc235a443aad3c62643e91b081: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/wals/c86ad2fde72a4917a713ec09d50d16ef
I20260709 12:21:57.165356 30668 catalog_manager.cc:5028] TS 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): tablet c86ad2fde72a4917a713ec09d50d16ef (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:21:58.193663 30857 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:58.208460 30930 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.208537 30779 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.210371 31733 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:58.211295 31754 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:58.213346 30826 consensus_peers.cc:597] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd65da5a34854820ae636ab77116f737. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:58.219981 31733 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.221894 30779 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.226866 30929 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.238865 30777 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:58.249672 30929 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.249444 30682 catalog_manager.cc:5697] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.255095 31726 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:58.260233 30750 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64f8ac94405742eb87e6d195387d7c6f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:58.268035 30857 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.270092 31755 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:58.275013 30929 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.272945 31755 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.283804 30855 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.292716 30929 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:58.311524 30857 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.308709 30679 catalog_manager.cc:5697] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:58.316277 30779 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.317986 31692 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:58.328908 31749 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:21:58.334712 30900 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b23b41846a694f24a76e3aa05d9e54b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:58.338153 31692 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.341488 30779 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.349143 30857 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.359225 30929 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:58.361733 30682 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:58.378451 30900 consensus_peers.cc:597] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1bb0331e5b641b99a413ba3e4475499. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:58.378975 30779 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.380982 31767 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:58.381819 30857 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:21:58.384272 31767 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:58.394142 31692 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.395928 30857 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.402163 30781 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.413676 30682 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index -1 to 2, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 1 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:21:58.657486 31775 ts_tablet_manager.cc:933] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:21:58.659487 31775 tablet_copy_client.cc:323] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.65:46329
I20260709 12:21:58.661217 30795 tablet_copy_service.cc:140] P 5e7509fe1be74f179626fb4fcb4b4e65: Received BeginTabletCopySession request for tablet 64f8ac94405742eb87e6d195387d7c6f from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:32970)
I20260709 12:21:58.661839 30795 tablet_copy_service.cc:161] P 5e7509fe1be74f179626fb4fcb4b4e65: Beginning new tablet copy session on tablet 64f8ac94405742eb87e6d195387d7c6f from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:32970: session id = 7857bffc34ce4e1db3617488701b9810-64f8ac94405742eb87e6d195387d7c6f
I20260709 12:21:58.668486 30795 tablet_copy_source_session.cc:215] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:58.672186 31775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64f8ac94405742eb87e6d195387d7c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:58.688438 31775 tablet_copy_client.cc:806] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:58.689121 31775 tablet_copy_client.cc:670] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:58.694152 31775 tablet_copy_client.cc:538] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:58.705472 31775 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:21:58.714395 31777 ts_tablet_manager.cc:933] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:21:58.716640 31777 tablet_copy_client.cc:323] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.66:33903
I20260709 12:21:58.718765 30870 tablet_copy_service.cc:140] P 764ebfd36ce64b2a86e6d290ae92e276: Received BeginTabletCopySession request for tablet dd65da5a34854820ae636ab77116f737 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:41694)
I20260709 12:21:58.719384 30870 tablet_copy_service.cc:161] P 764ebfd36ce64b2a86e6d290ae92e276: Beginning new tablet copy session on tablet dd65da5a34854820ae636ab77116f737 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:41694: session id = 7857bffc34ce4e1db3617488701b9810-dd65da5a34854820ae636ab77116f737
I20260709 12:21:58.729782 30870 tablet_copy_source_session.cc:215] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:58.749534 31775 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:58.750960 31775 tablet_bootstrap.cc:492] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:21:58.751894 31775 ts_tablet_manager.cc:1403] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.015s
I20260709 12:21:58.755635 31775 raft_consensus.cc:359] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:58.756616 31775 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:21:58.757411 31775 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:21:58.797449 31777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd65da5a34854820ae636ab77116f737. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:58.808640 31775 ts_tablet_manager.cc:1434] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.020s
I20260709 12:21:58.811147 30795 tablet_copy_service.cc:342] P 5e7509fe1be74f179626fb4fcb4b4e65: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-64f8ac94405742eb87e6d195387d7c6f received from {username='slave'} at 127.0.0.1:32970
I20260709 12:21:58.811730 30795 tablet_copy_service.cc:434] P 5e7509fe1be74f179626fb4fcb4b4e65: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-64f8ac94405742eb87e6d195387d7c6f on tablet 64f8ac94405742eb87e6d195387d7c6f with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:21:58.850600 31775 ts_tablet_manager.cc:933] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:21:58.855352 31775 tablet_copy_client.cc:323] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:21:58.866806 31777 tablet_copy_client.cc:806] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:21:58.867831 31777 tablet_copy_client.cc:670] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:21:58.869817 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet b23b41846a694f24a76e3aa05d9e54b2 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:21:58.870544 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet b23b41846a694f24a76e3aa05d9e54b2 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-b23b41846a694f24a76e3aa05d9e54b2
I20260709 12:21:58.887625 30945 tablet_copy_source_session.cc:215] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:21:58.923202 31775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b23b41846a694f24a76e3aa05d9e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:58.928489 31777 tablet_copy_client.cc:538] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:21:58.988032 31777 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
W20260709 12:21:59.723435 30749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.003s	sys 0.006s
W20260709 12:21:59.748446 30749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.004s	sys 0.006s
W20260709 12:21:59.740495 30825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.008s	sys 0.004s
W20260709 12:21:59.749715 30825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.009s	sys 0.004s
W20260709 12:21:59.758308 30747 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.005s	sys 0.010s
W20260709 12:21:59.758749 30747 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.005s	sys 0.010s
I20260709 12:21:59.758875 31783 ts_tablet_manager.cc:933] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:21:59.798028 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.001s	sys 0.014s
W20260709 12:21:59.880501 30748 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.021s	sys 0.016s
W20260709 12:21:59.880957 30748 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.021s	sys 0.016s
I20260709 12:21:59.885354 31784 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:21:59.887004 31783 tablet_copy_client.cc:323] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
W20260709 12:21:59.893909 30823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.025s	sys 0.113s
W20260709 12:21:59.894315 30823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.025s	sys 0.113s
I20260709 12:21:59.894531 31511 raft_consensus.cc:1217] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:21:59.887351 31784 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:59.900405 31788 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:21:59.948660 31791 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:21:59.949378 31791 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:59.969563 31788 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:21:59.968657 31792 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.005990 31784 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.014865 31804 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.015821 31800 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.015846 31804 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.016929 31800 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.019447 31804 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:00.020359 31800 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.021749 31791 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.022702 31784 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.022786 31800 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.023653 31784 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.023773 31800 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.026095 31791 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.027063 31800 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.027240 31791 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.042085 31798 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.045003 31798 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.000231 31792 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.050846 31798 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.052923 31805 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.048910 31788 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.056675 31805 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.062952 31805 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.076107 31792 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.102262 31784 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.085366 31792 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.083273 31798 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.212255 31794 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.213344 31794 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.110544 31805 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.225283 31800 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.227314 31800 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.228430 31772 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.230177 31804 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.230098 31788 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.235452 31703 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.247648 31703 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.254230 31804 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.254937 31791 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.255596 31791 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.256121 31791 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.257303 31804 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.258384 31794 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:00.258934 31703 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.127796 31792 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.229287 31772 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.137426 31798 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.284852 31801 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.231120 31805 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.291671 31794 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.280187 31784 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.280066 31804 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.297554 31795 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.298019 31775 tablet_copy_client.cc:806] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:00.298705 31775 tablet_copy_client.cc:670] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:00.286326 31800 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:00.277769 31788 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.285553 31801 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.304970 31797 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.307274 31787 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.315169 31792 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.310464 31791 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.298283 31795 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.312151 31798 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:00.312786 31797 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:00.307539 31804 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:00.314983 31510 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 1.337s	user 0.023s	sys 0.010s
W20260709 12:22:00.326113 31510 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.024s	sys 0.010s
I20260709 12:22:00.320350 31772 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.321599 31805 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.300455 31794 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.342823 31794 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.305972 31784 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.345296 31784 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.331466 31804 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.351184 31797 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.352012 31788 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:00.336071 31795 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.340564 31801 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.315595 31787 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.355242 31787 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.356191 31801 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.356937 31801 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.360061 31801 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.390661 31767 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.372745 31703 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.391479 31703 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.402361 31703 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.403049 31703 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.404382 31703 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.389477 31804 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.412921 31703 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.411283 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:00.410081 31801 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.433437 31726 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.434010 31703 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.436558 31703 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.418474 31788 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.444772 31726 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.442848 31703 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.451663 31726 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.453191 31726 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.419931 31804 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.455240 31703 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.441222 31733 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.460834 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:00.461555 31510 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:00.461539 31726 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.462720 31703 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.447290 31791 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.465413 31806 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.465282 31733 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.466084 31806 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.466554 31804 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:00.447009 30881 debug-util.cc:398] Leaking SignalData structure 0x7b080016ae60 after lost signal to thread 29612
I20260709 12:22:00.452559 31800 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.458585 31792 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.404002 31767 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:00.482975 31703 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.468524 31726 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.453879 31788 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.445986 31801 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.482617 31803 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.508006 31796 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.508165 31789 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.497545 31772 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.504745 31805 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:00.512070 30881 debug-util.cc:398] Leaking SignalData structure 0x7b080016c540 after lost signal to thread 30716
I20260709 12:22:00.493266 31800 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.496230 31791 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.498353 31792 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.511245 31768 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.516211 31804 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.527413 31733 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:00.530318 31784 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.522680 31796 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.526980 31772 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.574836 31726 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.528273 31805 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:00.563767 30881 debug-util.cc:398] Leaking SignalData structure 0x7b0800320d60 after lost signal to thread 30809
I20260709 12:22:00.580793 31726 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.566995 31733 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.567565 31767 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.561833 31802 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.588374 31726 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.522089 31803 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:00.589018 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:00.592698 30857 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:00.589828 31808 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.590346 31767 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.552958 31804 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.590862 31809 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.593674 31733 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.594543 31810 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.606618 31807 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.525522 31789 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.607280 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:00.573633 31784 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.554576 31768 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:00.613406 30881 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3780 after lost signal to thread 30884
I20260709 12:22:00.624459 31768 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.628618 31768 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.628365 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:00.630131 31726 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.613232 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.632715 31726 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:00.600133 31767 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.631713 31768 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.616832 31788 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.616132 31801 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.639405 31789 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.608917 31813 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.643900 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.644052 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.644927 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.648694 31703 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.686547 31703 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.687691 31812 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.689144 31703 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.676098 31804 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:00.676098 31768 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.608542 31802 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:00.679528 31801 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:00.640136 31811 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.674281 31790 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.686285 31792 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.744314 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.709548 31817 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.751521 31803 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.619475 31810 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.715665 31768 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.744961 31800 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.707279 31801 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.618408 31808 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
W20260709 12:22:00.713645 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 89187us
I20260709 12:22:00.751770 31817 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.693054 30780 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:00.619638 31809 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.742997 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:00.688410 31812 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:00.769511 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.756482 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.759378 31801 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:00.748144 31814 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.756705 31767 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.776839 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.762027 31772 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.785575 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.679749 31807 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.789361 31817 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.789924 31817 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.790390 31817 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.792351 31817 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.792788 31817 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.793207 31817 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.751521 31790 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.796934 31807 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.799427 31767 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.800371 31785 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.831900 31807 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.832528 31807 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.831907 31733 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.834775 31807 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.836578 31733 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.837164 31733 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.837646 31791 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.838150 31825 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.838758 31726 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.817384 31802 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.758200 31768 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.829787 31808 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.784699 31796 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.780164 31805 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.848150 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.819723 31772 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.854450 30785 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:00.690903 31813 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.835325 31807 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.841704 31784 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.838754 31825 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.827004 31814 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.839928 31767 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.762842 31811 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.922659 31813 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.894332 31807 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.860713 31772 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:00.930968 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:00.931625 31784 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:00.932510 31809 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.933420 31831 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.939245 31767 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.939999 31821 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:00.907438 31808 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.965348 31784 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.854666 31785 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.994500 31785 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:00.967031 31831 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.985584 31805 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:01.012588 31825 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:00.995440 31821 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:00.991737 30851 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:01.020236 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:00.987661 31808 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:00.998693 31767 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:00.894271 31806 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.004179 31768 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.031992 31825 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.032970 31811 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.033274 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.033958 31819 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:01.035043 31808 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:01.025411 31805 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.036448 31784 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.040874 31816 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.041703 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.042032 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.043756 31772 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.055598 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.049240 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.054616 30852 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:01.039543 30680 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 64) took 2070 ms. Trace:
I20260709 12:22:01.062361 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:01.061683 30933 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.042368 31831 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.065245 31829 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.044113 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:01.049461 31810 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:01.055302 31809 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:01.053843 31768 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:01.079185 30682 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 172) took 1151 ms. Trace:
I20260709 12:22:01.057770 31784 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:01.078230 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:01.048756 31767 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.077572 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.059687 31817 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.051422 31819 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.055347 31816 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.068539 31785 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.068753 31808 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.053782 31825 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.101725 31811 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.068190 31829 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.104110 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:01.095326 30881 debug-util.cc:398] Leaking SignalData structure 0x7b08002fe700 after lost signal to thread 30959
I20260709 12:22:01.079602 30682 rpcz_store.cc:276] 0709 12:21:59.928233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:59.928462 (+   229us) service_pool.cc:224] Handling call
0709 12:22:01.079126 (+1150664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":809842,"reported_tablets":1}
I20260709 12:22:01.058463 30680 rpcz_store.cc:276] 0709 12:21:58.959401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.959550 (+   149us) service_pool.cc:224] Handling call
0709 12:21:59.874534 (+914984us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610989090 00007f9610a27f3a 00007f96167dde9c 00007f96168dc04e 00007f9614d9d2a4 00007f9614d9d232 00007f9614d9d161 00007f9614d9d0dc 00007f9614d9c392 00007f960ed5a48c 00007f960ed598c6
0709 12:22:01.030062 (+1155528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1223,"reported_tablets":1,"spinlock_wait_cycles":52659712}
I20260709 12:22:01.113977 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.114705 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.115319 31816 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.095816 31785 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:01.109030 31777 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:22:01.105427 31811 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:01.108458 31821 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.123319 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.124629 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.103742 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.129948 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet d1bb0331e5b641b99a413ba3e4475499 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:22:01.089783 31768 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.127491 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:01.101076 31784 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.088517 31809 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:01.172299 31784 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.172976 31826 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.173547 31826 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:01.176030 31814 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.118804 31785 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.177695 31829 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.109161 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:01.178653 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 77000.4us
I20260709 12:22:01.104444 31808 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.130558 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet d1bb0331e5b641b99a413ba3e4475499 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-d1bb0331e5b641b99a413ba3e4475499
I20260709 12:22:01.121809 31807 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.125321 31811 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.119803 31824 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:01.203387 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.209674 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:01.214095 30881 debug-util.cc:398] Leaking SignalData structure 0x7b080029b380 after lost signal to thread 31535
I20260709 12:22:01.172313 31809 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.193482 31813 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.207192 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.227595 30785 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:01.228232 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.189973 31768 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:01.221108 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 101522us
I20260709 12:22:01.126061 31817 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.223448 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.223747 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.225113 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.125857 31822 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.226619 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.248979 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.130921 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.254222 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.254539 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.254581 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.254949 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.255545 30935 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.255895 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.256356 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.256438 30934 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:01.257334 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.257968 30930 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.258347 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.262871 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.264206 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.267310 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.267438 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.268047 30934 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.268880 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.230975 31813 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:01.273317 31692 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:01.223505 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.273834 31692 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.274365 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.274988 30930 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.275720 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.276124 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.276172 30930 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.279333 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.284582 31692 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:01.254968 30933 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.250627 31817 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.269156 30783 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:01.315558 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.274155 31813 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.258299 31824 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.286026 30945 tablet_copy_source_session.cc:215] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:01.335271 31824 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.281133 31733 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.322072 31767 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:01.329545 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 161989us
I20260709 12:22:01.331236 31817 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.334208 31819 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.258536 31822 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.313294 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:01.283255 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.336615 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.452353 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.450052 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.484403 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.479104 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:01.489998 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.532588 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.460744 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.534125 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.439692 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.482810 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.485788 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.536900 30856 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.464517 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:01.538081 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.479388 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.538412 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.538573 31511 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.458669 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.539578 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.540176 30928 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.540892 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.461414 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:01.313568 31801 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.375317 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.394554 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.337644 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.541283 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.566009 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.542052 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.543499 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.294480 31808 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.329596 31825 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.546895 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.336987 30935 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.546970 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.464939 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.426751 31812 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.552160 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.476800 31805 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.554725 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.547694 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.548123 30932 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.546898 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.463982 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.581470 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.583010 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.584338 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.584740 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.478219 31826 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.574587 31510 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:01.462491 31790 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.451383 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.576192 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.577124 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.566339 31733 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:01.598492 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.549398 31822 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.540894 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.425230 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:01.565521 31794 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.450114 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.595815 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.597131 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.579870 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.616243 30934 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.585731 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.616561 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.605623 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.543524 30927 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.605937 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.612682 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.608552 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.551779 31785 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.614704 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.552649 31813 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.616662 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.590859 30932 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:01.619841 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.619532 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.622434 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.623174 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.623716 30934 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.613435 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.603663 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.614826 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.619262 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.629581 30899 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:01.632030 31801 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.632635 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.640869 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.633262 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.634584 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.616300 31835 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:01.640602 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 53481.7us
I20260709 12:22:01.610498 31733 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.619263 31834 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:01.623061 31794 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:01.643800 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.734954 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.678939 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.716847 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.736191 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.652454 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.752084 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.753134 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.651422 30899 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:01.752910 30859 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.686040 31777 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:01.763185 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.760605 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:01.765812 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 114451us
I20260709 12:22:01.769671 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.646931 31831 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.646360 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.678223 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.772410 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.772555 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.773221 30854 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.774143 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.774231 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.775557 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.775635 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.730403 31813 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.776988 31821 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.777423 31821 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.777849 31821 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.778018 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.778730 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.776211 30854 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:01.777014 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.768196 30857 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:01.773558 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.787272 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.677781 30858 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:01.684326 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.684345 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.801983 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.803650 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:01.683085 31785 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:01.777441 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.790040 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:01.790220 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.773566 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.818789 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:01.791190 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.793403 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:01.822314 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 177258us
I20260709 12:22:01.797127 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.795459 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.757314 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.827095 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:01.805588 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.828293 31510 raft_consensus.cc:2393] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:01.828214 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:01.828583 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.828838 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.829363 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.829785 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.829981 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.830452 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.830828 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.831203 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.831527 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.831800 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.806478 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.832607 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:01.832731 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.832911 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.833611 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.768879 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.815291 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.756855 30853 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:01.798852 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.819734 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:01.827081 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.827732 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.649174 31816 consensus_queue.cc:1059] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 12:22:01.646355 31835 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.833611 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.785694 31831 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.820124 30782 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:01.842056 31510 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:01.800613 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.758736 31811 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.843093 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.813927 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:01.814774 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.745697 31834 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.837502 31828 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.849956 31777 tablet_bootstrap.cc:492] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:22:01.880740 31777 ts_tablet_manager.cc:1403] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 2.903s	user 0.054s	sys 0.025s
I20260709 12:22:01.868088 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.845247 31817 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.879755 31811 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.886960 31777 raft_consensus.cc:359] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:01.887945 31777 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:22:01.867725 30899 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:01.854236 31831 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.888868 31777 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:01.872852 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:01.890408 31510 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:01.846879 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:01.892850 30899 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:01.893838 31775 tablet_copy_client.cc:538] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:01.898100 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.899197 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.900506 31835 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.869571 31824 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.896579 31792 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.902179 31792 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:01.902565 31792 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.895730 30851 raft_consensus.cc:2393] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:01.908257 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 84019.3us
I20260709 12:22:01.889556 31767 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.910998 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.910787 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:01.912200 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.903532 31825 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.914662 31733 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.915804 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.914846 31825 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.918464 31825 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.920233 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.895150 31817 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.921741 31830 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.925349 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:01.926237 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:01.927445 31796 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.927883 31796 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.928261 31796 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.930526 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.933621 30900 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.935139 31795 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:01.935226 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.935683 31795 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.936062 31795 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:01.936867 31768 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.931205 31837 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.942787 31837 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.943193 31837 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.945485 31808 raft_consensus.cc:3055] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:01.945914 31808 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:01.949872 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.958190 31822 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.959192 31831 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:01.929220 31833 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.948056 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:01.968294 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:01.969985 30929 raft_consensus.cc:2393] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:01.976962 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.977981 31836 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:01.979632 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:01.981266 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:01.982156 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 50393.2us
I20260709 12:22:01.978439 31836 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:01.983124 31733 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.983443 31836 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.983491 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:01.947288 31834 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:01.988905 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.969340 31794 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:01.993739 31841 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.964911 31808 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:01.995313 31808 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:01.993343 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:01.924132 31840 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.991427 31810 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.984848 31839 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:01.986621 31822 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.011330 31833 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.012288 30934 raft_consensus.cc:1240] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.014925 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.019354 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.020640 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.022233 31794 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.022665 31794 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.023029 31794 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.020270 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:02.025195 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.031239 31786 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.031787 31786 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.032250 31786 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.032662 31783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bb0331e5b641b99a413ba3e4475499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.021874 30900 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.035729 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.023988 31840 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.023855 31824 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:02.050165 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.050195 31476 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.052356 31834 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.053742 31795 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.056362 31795 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.037576 31816 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.058030 30781 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:02.060557 31777 ts_tablet_manager.cc:1434] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.179s	user 0.009s	sys 0.002s
I20260709 12:22:02.064643 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.067380 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:02.071643 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.083539 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.081409 31775 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:22:02.082270 30870 tablet_copy_service.cc:342] P 764ebfd36ce64b2a86e6d290ae92e276: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-dd65da5a34854820ae636ab77116f737 received from {username='slave'} at 127.0.0.1:41694
I20260709 12:22:02.097455 30870 tablet_copy_service.cc:434] P 764ebfd36ce64b2a86e6d290ae92e276: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-dd65da5a34854820ae636ab77116f737 on tablet dd65da5a34854820ae636ab77116f737 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:02.044085 31790 consensus_queue.cc:1059] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:22:02.102231 31790 raft_consensus.cc:3055] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.102602 31790 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.047025 31831 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.093544 31792 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.092882 31821 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.065591 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.100163 31822 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.103497 31790 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:02.104416 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:02.112223 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.112689 31834 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.110679 31792 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.113199 30929 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.112298 31790 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:02.098292 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 62657.5us
I20260709 12:22:02.122339 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.096987 31837 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.125589 31821 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.063709 31836 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.127692 31836 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.129416 31837 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:02.123248 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 57752.8us
I20260709 12:22:02.130836 31804 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.130997 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.088977 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:02.133420 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.134760 31822 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.140475 31786 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:02.141351 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 111122us
I20260709 12:22:02.114614 31796 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.148444 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.146402 31804 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.150975 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.167618 31825 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.169459 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:02.170040 31825 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.170214 30934 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:02.158337 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.158377 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.161790 31834 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.172178 31834 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:02.172348 31838 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.172659 31834 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.172851 31838 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.173339 31838 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:02.159041 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 107209us
I20260709 12:22:02.174710 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.176522 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.163861 31804 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.163766 30929 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:02.156785 31822 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.164544 30927 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.179061 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:02.165479 31794 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:02.166316 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 84917us
I20260709 12:22:02.165125 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.180251 31822 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.180685 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:02.182511 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.182443 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.187674 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.158969 31824 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.190327 30776 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.187062 31804 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.190737 31831 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:02.206926 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.192625 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.209044 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.190775 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.191325 31839 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.189169 31821 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.189338 31792 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.181293 31808 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.188383 31835 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:02.187376 30825 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.65:46329 timed out after 1.507s (SENT) [suppressed 4 similar messages]
I20260709 12:22:02.196383 31794 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.181804 31825 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.192276 31477 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.216032 31842 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.204708 31786 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.197364 31804 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.211303 31831 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.211795 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.227851 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.229074 30900 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.229923 31808 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.230280 31824 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.230705 31808 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.217984 31792 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.232127 31792 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.214908 31839 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.234006 31839 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.225209 31804 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.223277 31477 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.226171 31835 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.235142 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.240567 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.242746 31796 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.224887 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.236809 31839 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.223480 31842 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.246268 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.246527 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.245234 31822 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.234128 31783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42840 (request call id 103) took 3257 ms. Trace:
I20260709 12:22:02.254666 31821 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.255610 31786 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.256132 31786 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.256528 31786 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.258522 31839 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.251965 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.247707 31831 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.249891 31842 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.253930 31835 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.253746 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.255465 31821 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.250541 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.265007 31831 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.248189 31825 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.259286 31838 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.249409 31796 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.274866 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.278550 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.266274 31821 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.281483 31844 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.281996 31844 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.282380 31844 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.273885 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.281347 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.292330 30852 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:02.272348 31796 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:02.299192 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 111834us
I20260709 12:22:02.285013 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.300535 31795 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.300966 31795 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.301441 31795 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.306461 30682 catalog_manager.cc:5697] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.272748 31835 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.312417 31804 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.294409 31794 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.315065 31794 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.315478 31794 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.318087 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:02.325030 31804 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.326416 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.327134 30927 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.328945 30825 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.344961 30825 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.305310 31796 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.254761 31783 rpcz_store.cc:276] 0709 12:21:58.977095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:21:58.977561 (+   466us) service_pool.cc:224] Handling call
0709 12:21:59.759349 (+781788us) ts_tablet_manager.cc:934] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
0709 12:22:02.028875 (+2269526us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:22:02.172039 (+143164us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:02.172186 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:22:02.233294 (+ 61108us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:22:02.233590 (+   296us) tablet_replica.cc:206] Creating consensus instance
0709 12:22:02.233943 (+   353us) ts_tablet_manager.cc:989] Replica registered.
0709 12:22:02.234029 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":14934,"tablet-copy.queue_time_us":780070,"thread_start_us":1409450,"threads_started":2}
I20260709 12:22:02.350513 31783 tablet_copy_client.cc:806] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:02.351112 31783 tablet_copy_client.cc:670] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:02.344844 31792 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.346992 31790 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.352896 31830 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:02.354141 31830 raft_consensus.cc:3055] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.354506 31830 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.355302 31821 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.355404 31830 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.356869 31830 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.364722 31824 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:02.366139 31692 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.366531 31692 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.366974 30825 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.367343 31692 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.369912 30825 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.357354 31821 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.330857 31837 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.374388 31692 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.360191 31834 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.382490 31838 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.384646 31508 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.387043 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.373721 31792 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.389075 30825 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.390427 30825 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:02.386823 31844 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.392398 31833 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.392987 31792 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.389864 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.397209 31844 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.379297 31837 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.377684 31790 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:02.398548 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 66081.8us
I20260709 12:22:02.399271 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.401044 30825 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:02.406245 31783 tablet_copy_client.cc:538] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:02.409090 31804 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.409533 31804 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:02.409998 31804 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.414304 31816 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.414975 31816 raft_consensus.cc:697] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.416035 31816 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:02.418810 31842 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.403311 31792 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.402812 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.403430 31837 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.421186 31842 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.433252 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.435242 31792 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.436088 30825 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.438364 30825 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.439925 30825 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.394086 31795 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.444875 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.441535 30825 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.440877 31733 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.457072 31822 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.461961 31794 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.462783 31792 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.441890 31810 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.464226 31794 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.470808 31834 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.471410 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.473124 30927 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:02.474898 31831 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.475559 31831 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.442430 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.440701 31812 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.478102 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:02.478961 30825 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.487100 30825 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.494966 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.495344 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.459117 31840 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.455319 31796 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.478494 31824 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:02.504913 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 48400.7us
I20260709 12:22:02.478204 31795 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.497028 31821 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.499460 31810 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.485507 31833 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.499020 31792 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.499293 31733 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.503018 31831 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:02.521874 30934 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.519644 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.503234 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.515167 30825 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.527413 31837 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:02.530189 31821 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.532049 31796 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.532639 31804 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.522854 31833 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.534904 31783 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:22:02.535158 31833 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.536931 31821 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:02.538195 31831 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.507766 31840 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.538578 31831 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.537135 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:02.546247 31508 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:02.547487 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.547912 31840 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.548322 31836 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.549309 31775 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:02.550071 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:02.550453 31775 tablet_bootstrap.cc:492] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:22:02.550853 31836 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.551458 31836 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:02.551604 31775 ts_tablet_manager.cc:1403] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.493s	user 0.037s	sys 0.005s
I20260709 12:22:02.511039 31830 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.575322 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.575465 31830 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.577281 31837 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.545120 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:02.578094 31830 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.578437 30854 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:02.512974 31824 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.539499 31831 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.581141 31824 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.583964 31831 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.584128 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.586630 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.554951 31804 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.551975 31836 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.552443 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.589550 31792 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.557439 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.535931 31786 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.590672 31792 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.592600 31786 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.570344 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:02.567358 31851 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.072s	user 0.004s	sys 0.000s
W20260709 12:22:02.594627 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.595410 31786 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.558703 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.596556 30851 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:02.597975 31834 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.563699 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.560163 30680 catalog_manager.cc:5697] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:02.599196 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 84113.1us
I20260709 12:22:02.600320 31810 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.599927 30825 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:02.601503 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 45742.1us
I20260709 12:22:02.602116 31790 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:02.602420 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:02.602504 30825 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.603858 30825 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.604322 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:02.605007 30854 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:02.605939 31733 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.606571 31733 consensus_queue.cc:1059] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.606848 30825 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.607493 31733 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.608117 31733 raft_consensus.cc:3055] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.608428 31733 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.608989 30825 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.609952 31812 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.610199 31839 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.611835 30825 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.613099 30825 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.599268 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.614625 31786 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.609216 31733 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.614960 31836 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.621348 30825 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:02.622787 31836 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:02.616569 31812 consensus_queue.cc:1175] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:22:02.618484 31824 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.628880 31824 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.629261 31824 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.630843 31853 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.632437 30825 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.633340 31792 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.635039 30825 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.616518 31733 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.636165 31792 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.637676 30825 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.638576 31792 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.619535 31810 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.644165 30825 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.619774 31790 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.620074 31775 raft_consensus.cc:359] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:02.645265 31810 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.646600 31775 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
W20260709 12:22:02.619481 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 55928.8us
I20260709 12:22:02.647644 31775 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:02.621366 30776 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.650815 31810 consensus_queue.cc:1059] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.652364 31790 raft_consensus.cc:3055] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:02.652740 31790 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.653134 31840 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.653620 31790 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.654314 31840 raft_consensus.cc:3055] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.654975 31840 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.655824 31840 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.616155 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.657183 31840 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.658166 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.658799 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.659303 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:02.660122 31837 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.660086 31830 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.660835 31830 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.661269 31836 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.661475 31830 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.656327 31775 ts_tablet_manager.cc:1434] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.003s
I20260709 12:22:02.661747 31836 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:02.662600 31836 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.663820 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-b23b41846a694f24a76e3aa05d9e54b2 received from {username='slave'} at 127.0.0.1:33366
I20260709 12:22:02.664285 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-b23b41846a694f24a76e3aa05d9e54b2 on tablet b23b41846a694f24a76e3aa05d9e54b2 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:02.666390 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:02.666556 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.668367 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.668473 30750 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.660900 31837 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.669077 31821 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.669821 31790 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.670125 31786 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.670533 31786 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:02.670940 31786 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.670147 31821 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.673842 31792 consensus_queue.cc:1059] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:02.674486 31821 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.675098 31792 raft_consensus.cc:3055] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.675542 31792 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.676409 31792 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.676827 31824 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.677727 31792 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.678300 30776 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.684795 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:02.686421 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.686738 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:02.687430 30851 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:02.687515 31794 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.687973 31794 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:02.688364 31794 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.688419 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:02.687991 30782 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.686591 31837 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.689272 30854 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:02.694393 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.696761 31831 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.681226 31830 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.700469 31836 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:02.704066 31794 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.707682 31821 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.702153 31831 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.708864 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:02.710959 31824 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:02.711040 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.711829 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.713418 31830 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.719625 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.720501 30783 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.721135 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.722241 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.723853 30854 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.714200 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.717139 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:02.697146 31786 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.700477 31837 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.727766 31692 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.730577 31692 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.730974 31692 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.731448 30934 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.728330 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.728863 30929 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.709259 31831 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.735623 31833 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.736011 31833 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.736357 30782 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.730793 31508 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.743535 30783 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.743743 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:02.746102 30929 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.746206 31692 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.747776 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.749047 30935 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.749570 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:02.749802 31692 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.750677 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.752295 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.758194 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.761711 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.762375 30851 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.736388 31833 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.775243 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.776024 30929 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.776418 30825 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.778023 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.765180 31836 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.779662 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.771456 31821 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:02.772635 31839 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.764966 31794 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.768304 31790 consensus_queue.cc:1059] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:22:02.785936 31785 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.783633 30782 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.778518 31804 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:22:02.786280 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.806505 31507 raft_consensus.cc:1217] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:02.810189 31812 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.811800 30679 catalog_manager.cc:5697] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.789618 30854 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:02.819285 31804 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.819742 31804 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.820848 31804 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.816311 31812 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.824697 31812 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.827281 31812 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.844960 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.846679 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.855502 30851 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:02.816569 30860 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.852278 31804 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.865846 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.869019 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.872687 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.874974 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.878479 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.880254 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.880918 30782 raft_consensus.cc:1240] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:02.898247 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 121911us
I20260709 12:22:02.899628 30825 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.904134 30929 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:02.907173 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:02.908427 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 106703us
I20260709 12:22:02.909845 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.911387 31692 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.911875 31692 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.912385 30929 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.911875 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:02.912673 31692 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.913684 31821 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:02.914258 31821 raft_consensus.cc:697] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.916208 30750 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:02.919745 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.920270 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.919590 30783 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.921566 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.923481 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.924517 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.926510 30782 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.926613 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.926839 30776 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.917065 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:02.928390 31808 consensus_queue.cc:1059] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:02.928838 30778 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.929843 31808 raft_consensus.cc:3055] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.926862 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.930294 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.930347 31808 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:02.932017 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:02.931803 31808 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:02.933806 31808 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.935494 30854 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:02.937999 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:02.938700 30851 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:02.939641 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.940888 31837 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:02.942677 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.943874 31852 raft_consensus.cc:1064] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:22:02.945405 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.915019 31785 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:22:02.946470 31852 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.947583 31785 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.908501 31786 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:02.908666 31853 consensus_queue.cc:1059] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:22:02.922041 31792 consensus_queue.cc:1059] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:22:02.957670 31792 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.958068 31792 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:02.959002 31792 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:02.959821 30931 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:02.960361 31792 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.962503 31794 raft_consensus.cc:2804] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:02.962922 31794 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:02.963310 31794 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:02.966609 31783 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:02.966830 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.967664 31783 tablet_bootstrap.cc:492] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:22:02.968482 31783 ts_tablet_manager.cc:1403] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.434s	user 0.022s	sys 0.016s
I20260709 12:22:02.968585 31834 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:02.969198 31834 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:02.970791 30781 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:02.971167 30781 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:02.955029 30777 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:02.954186 31859 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:22:02.924470 31819 consensus_queue.cc:1059] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:22:02.891163 31508 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:02.906101 31843 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.009387 30855 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:02.918188 31796 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.022815 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:02.947983 31785 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.029673 31858 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.030191 31858 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.031131 31858 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.031821 30682 catalog_manager.cc:5697] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.034380 31785 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.036026 31785 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:03.037986 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 125472us
I20260709 12:22:03.032696 31858 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.051501 31507 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Advancing to term 2
I20260709 12:22:03.054847 31862 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:03.055474 31862 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.060369 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:03.070221 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.071662 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.073205 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.078920 31848 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.080132 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.080642 31848 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.080698 31810 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.081159 31848 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.014762 30860 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:02.956633 31833 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.100432 31794 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.101939 30778 raft_consensus.cc:1240] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.102430 30931 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.103703 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:03.052019 31783 raft_consensus.cc:359] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:03.105926 30860 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.106676 31733 consensus_queue.cc:1059] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.106777 31848 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.107906 31804 raft_consensus.cc:3055] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.108271 31804 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.028761 31795 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:22:03.109122 31804 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.110807 31796 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.111253 31796 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.111742 31859 consensus_queue.cc:1059] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.112169 31796 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.112777 31859 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.113361 31837 consensus_queue.cc:1059] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.016908 31786 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:22:03.086596 30776 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:03.070704 31862 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:03.113720 31796 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:03.125964 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.113953 31853 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:22:03.114094 31843 raft_consensus.cc:3055] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.127779 31843 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.129107 31843 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.130578 31843 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.131984 31833 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:03.132668 31804 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.119462 30858 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.114495 31810 raft_consensus.cc:3055] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.135747 31810 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.136498 30858 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.014233 31821 consensus_queue.cc:237] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.120678 30778 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.122031 30852 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:03.088116 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:03.077333 31834 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:03.052596 31842 consensus_queue.cc:1059] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:03.093051 31816 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.170521 31816 raft_consensus.cc:697] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:03.170706 31842 raft_consensus.cc:3055] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.171200 31842 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.171655 31816 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.093940 31790 raft_consensus.cc:3055] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.172040 31842 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.172794 31790 raft_consensus.cc:740] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.173286 31842 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.173864 31790 consensus_queue.cc:260] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.175041 31790 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.093860 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:03.094322 30857 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.096284 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:03.097270 30854 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.098023 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:03.098249 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.098799 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:03.099202 31808 raft_consensus.cc:3055] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.180670 31808 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:03.180905 31794 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:03.181684 31808 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.182915 31808 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.100046 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:03.105990 31783 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:22:03.108460 31848 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.114593 31837 raft_consensus.cc:3055] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.087344 30853 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:03.196904 31837 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.139206 30784 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.189568 31783 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:03.084352 31864 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:03.136834 31810 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.200407 31783 ts_tablet_manager.cc:1434] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.232s	user 0.006s	sys 0.002s
I20260709 12:22:03.200304 31864 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.200889 31810 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.136688 30781 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.117308 30776 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.132669 31833 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:22:03.108505 30860 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.118017 31859 consensus_queue.cc:1059] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:22:03.083441 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:03.203539 31692 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:03.204581 30784 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.208179 30855 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:03.216728 30929 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:03.217197 30859 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:03.246171 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-d1bb0331e5b641b99a413ba3e4475499 received from {username='slave'} at 127.0.0.1:33366
I20260709 12:22:03.248118 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-d1bb0331e5b641b99a413ba3e4475499 on tablet d1bb0331e5b641b99a413ba3e4475499 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:03.248970 30781 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:03.251338 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.201798 31837 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.258395 31837 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.262288 31790 raft_consensus.cc:3055] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.262817 31790 raft_consensus.cc:740] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.263824 31790 consensus_queue.cc:260] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.264846 31859 consensus_queue.cc:1059] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:03.265363 31790 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.265937 31859 raft_consensus.cc:3055] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.253171 31692 raft_consensus.cc:3055] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.267709 30783 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:03.268507 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.275085 30781 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.275130 31692 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:03.270264 31859 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.279147 31859 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:03.280117 31786 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:22:03.280349 31859 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.279392 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:03.282523 31864 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:03.284574 31834 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.285488 31476 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.287575 31834 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.292502 30851 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:03.283978 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:03.277568 31692 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:03.270220 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:03.294952 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 216350us
W20260709 12:22:03.295444 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 185095us
I20260709 12:22:03.281390 31507 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:22:03.301222 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:03.301520 31692 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.297307 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:03.303244 31864 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.307431 31792 consensus_queue.cc:1059] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.308544 31792 raft_consensus.cc:3055] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.307874 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:03.308885 31792 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.313898 31840 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.313177 31792 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.315037 31841 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:03.315467 31792 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.327500 31733 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.327997 31733 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:03.328893 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.329555 30855 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.336601 30855 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:03.347808 30781 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.361164 30781 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.366581 31871 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.367890 31871 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:03.368418 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:03.340504 31852 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.379846 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:03.380002 31795 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.381517 31795 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.381682 31786 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.382093 31795 raft_consensus.cc:697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.369575 31871 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.386214 31871 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:03.309649 31853 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:22:03.382150 31786 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.398528 30859 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:03.400532 30929 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.402994 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.413369 30929 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.415982 30859 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:03.387989 31831 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.328912 31733 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.370258 31865 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:22:03.441888 31852 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.399644 31833 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:22:03.446622 31852 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.427698 30682 catalog_manager.cc:5697] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.448869 31831 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:03.435029 31871 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.456053 30682 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.452723 31733 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.387982 31866 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:22:03.455567 30860 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.453017 31792 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:22:03.490978 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.493675 31869 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:22:03.498154 31511 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:03.488602 31831 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.486253 30927 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:03.527750 31692 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.528584 31692 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:03.530441 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.531795 31692 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:03.502902 31840 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:03.475435 31795 consensus_queue.cc:237] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.513845 31865 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:03.534068 31508 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:22:03.542693 31870 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:22:03.550239 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:03.555598 31840 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.553928 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:03.558488 31510 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:03.549167 31865 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.565650 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:03.566023 31865 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:03.549638 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:03.571439 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:03.576453 30930 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:03.578024 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:03.578626 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:03.579205 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.579062 31790 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:03.579665 31790 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:03.580086 31790 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.580116 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.587847 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:03.588685 31511 raft_consensus.cc:2393] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:03.589875 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.593658 31794 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.595634 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.567206 31865 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.598338 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.600143 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.601593 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.595846 31824 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:03.598232 31866 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.604741 31794 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.622669 31852 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:03.625973 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.602824 31796 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.631817 31875 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:03.616250 31824 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.633788 31875 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.637805 31824 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:03.639662 31875 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:03.644806 31876 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.645236 31876 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.600234 31865 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.659178 31865 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:03.661559 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:03.663808 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:03.664614 31511 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:03.666710 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:03.661782 30860 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:03.663193 31882 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.689458 31786 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:03.702803 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 101300us
I20260709 12:22:03.703622 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:03.704766 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:03.709551 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.712853 31794 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.705502 31893 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:03.685592 31865 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:03.718537 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.721987 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:03.725036 30783 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.727604 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:03.716223 31842 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:03.735737 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.708326 31816 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:03.739925 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 150242us
I20260709 12:22:03.748188 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:03.726455 31871 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.752557 30856 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:03.754103 31880 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:22:03.697467 31876 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.760152 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.770349 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.774206 31508 raft_consensus.cc:1217] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:03.776062 31836 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.739679 31842 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:03.776161 31865 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.757279 31824 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.730558 31882 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.782799 31842 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:03.786638 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.740439 31826 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:22:03.785457 31875 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:03.782740 31795 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.794183 31842 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.796299 31842 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:03.766791 31816 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.798864 31816 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:03.772080 31831 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.778944 31893 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.799928 31790 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.800890 31893 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.783834 31865 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:03.802862 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:03.780503 31876 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.814308 30930 raft_consensus.cc:2393] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:03.820189 31790 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:03.821350 31865 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.823485 31865 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:03.827948 31824 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:03.783124 31836 raft_consensus.cc:697] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.845427 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:03.851475 30781 raft_consensus.cc:3055] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.852090 30781 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.855412 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:03.856886 30781 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:03.877063 30781 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:03.877460 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 60495.5us
I20260709 12:22:03.879843 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:03.891985 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:03.886722 31507 raft_consensus.cc:2393] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:03.893575 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:03.896993 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:03.887214 31795 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:03.892884 31866 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.888897 30776 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:03.892180 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:03.910953 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:03.912335 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 142590us
I20260709 12:22:03.914371 30781 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:03.917852 30855 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.921244 30859 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:03.908097 31842 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.893456 31837 consensus_queue.cc:1059] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:22:03.910633 31786 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.924538 31508 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:03.908399 31890 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.911478 30776 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.919134 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:03.923090 31796 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:03.959713 30750 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:03.979414 31890 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.980614 31890 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:03.985138 31882 raft_consensus.cc:2804] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:22:03.993289 31895 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 12:22:03.997119 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.947137 31853 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:04.000600 31824 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:04.017300 31887 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:04.019047 30776 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.020298 30776 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:03.953363 31842 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.957338 31865 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:03.985675 31882 raft_consensus.cc:697] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.989727 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:03.958774 31795 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:22:03.998469 31796 raft_consensus.cc:697] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:03.923403 31836 consensus_queue.cc:237] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.038102 30851 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:04.039309 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:04.034121 31875 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:22:04.022204 31853 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.037804 31865 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.058640 30853 raft_consensus.cc:2393] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:04.072142 31865 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.071926 31882 consensus_queue.cc:237] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.075181 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.090369 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:04.079299 31853 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:04.063144 31852 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:22:04.080729 31508 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:04.081841 31510 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:04.099745 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:04.123009 30930 raft_consensus.cc:2393] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:04.127305 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 59923.9us
I20260709 12:22:04.112320 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:04.130498 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.081591 31842 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:04.128834 31821 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.140365 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.141275 30931 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:04.144385 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:04.145220 31510 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:04.144498 30933 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:04.153499 31796 consensus_queue.cc:237] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.159981 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:04.121273 30929 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:04.168107 30682 catalog_manager.cc:5697] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.224964 30682 catalog_manager.cc:5697] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.227305 30682 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.172111 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:04.175608 30854 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
W20260709 12:22:04.189248 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 61108.3us
W20260709 12:22:04.191337 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.209282 30779 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.213960 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:04.214771 31840 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:04.187196 31810 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:04.187345 31853 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.239077 30929 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:04.217350 30776 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:04.245343 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 73356.8us
I20260709 12:22:04.253175 30930 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:04.231868 31875 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.254510 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:04.267948 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 54113us
I20260709 12:22:04.158228 31821 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:04.234797 31898 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.231964 31830 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.273377 31841 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.273794 31875 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.274101 31839 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.274461 31887 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.274642 31816 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.275110 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:04.247924 31864 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.250432 31792 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:04.272843 31837 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:22:04.253918 31810 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:04.295830 30854 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.271940 31808 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:04.271879 31871 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.249874 31873 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:22:04.254889 31853 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.289937 31821 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.292835 31833 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.272418 31900 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.289686 31792 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:04.290248 31865 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.314603 31692 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.316037 31692 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.280864 31830 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.283514 31841 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.279451 31898 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.313570 31821 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.280337 31794 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:22:04.328744 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:04.290617 31816 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.294121 31864 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.334728 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.335529 30783 raft_consensus.cc:2393] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:04.330850 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 100673us
I20260709 12:22:04.315593 31792 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.339036 31692 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.339215 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:04.340858 31692 raft_consensus.cc:1064] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:22:04.343124 31692 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.339800 30854 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:04.319893 31840 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.291320 31887 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:04.353080 30929 raft_consensus.cc:2393] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:04.306550 31871 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.321273 31865 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:04.335788 31866 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:04.314198 31833 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.320269 31808 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:22:04.360857 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:04.324347 31899 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:22:04.360873 30860 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.323645 31900 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.367069 31866 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.412599 30934 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.415989 31692 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.454427 31692 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.423070 31898 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.425891 31887 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.359131 31840 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.429399 31875 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.430106 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.430413 30926 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:04.430651 31841 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.431375 31821 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.431792 31864 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.433246 31816 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:04.434892 31871 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.436607 31833 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.437321 30776 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:04.439810 31865 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.442770 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.486001 31864 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.486508 31864 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.486799 31792 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.487995 31900 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:04.490118 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:04.452874 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 92092.6us
I20260709 12:22:04.358963 31810 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.478243 31692 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:04.479158 31786 consensus_meta.cc:287] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:22:04.509634 30781 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.481209 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.511394 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.481213 31840 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:04.481422 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.514689 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.488713 31864 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.515746 30785 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
W20260709 12:22:04.503750 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.515731 31853 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.506959 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.517159 30776 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:04.479460 31830 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.518055 31853 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.515997 31864 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.521734 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.474615 31852 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:22:04.533810 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.518811 31853 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.542160 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.537608 31852 raft_consensus.cc:697] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:04.542227 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.543835 31852 consensus_queue.cc:237] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.488713 31792 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:04.550693 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.551819 30781 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:04.546317 31839 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:04.527117 31864 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.557417 31864 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.564967 31853 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:04.567181 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.591265 30935 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:04.592470 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.597530 31853 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.598865 31853 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.599589 31841 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.600165 31841 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:04.601280 31853 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:04.601955 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 53055.6us
W20260709 12:22:04.603466 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 319305us
I20260709 12:22:04.603801 31841 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.604378 31841 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:04.607131 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.607232 30899 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:04.609138 31511 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.002s	sys 0.029s
I20260709 12:22:04.608165 30781 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
W20260709 12:22:04.609519 31511 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.002s	sys 0.029s
I20260709 12:22:04.616269 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.621449 30781 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:04.628501 31733 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.629211 31733 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.616482 31819 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.632893 31819 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:04.616334 31890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.012s	sys 0.020s
I20260709 12:22:04.612999 31824 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:04.633476 31733 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:04.616892 30777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.009s	sys 0.024s
I20260709 12:22:04.626394 30899 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:04.650274 30854 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.616173 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.655800 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.658473 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.659972 30784 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:04.663909 30854 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:04.635397 31890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.013s	sys 0.020s
I20260709 12:22:04.636796 31853 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.613916 31831 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:22:04.670817 30856 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.626101 31790 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.674250 31692 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.640640 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.679032 31692 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.640425 31824 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.635645 31839 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:04.666234 30777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.009s	sys 0.026s
W20260709 12:22:04.690361 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 93671.9us
I20260709 12:22:04.676133 31733 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.667560 31830 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:04.679428 31893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.000s	sys 0.023s
I20260709 12:22:04.753485 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.747566 31733 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.749856 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:04.766630 31692 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:04.771549 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 92890.7us
I20260709 12:22:04.744068 31824 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.729797 31931 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.780200 31733 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.780885 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.713362 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.749189 31819 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:04.773301 31893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.001s	sys 0.023s
I20260709 12:22:04.750424 31833 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.753455 31830 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.751633 30776 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:04.745273 31790 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.777695 31792 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:04.741611 31853 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:04.803838 30682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.008s
I20260709 12:22:04.754053 31890 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:22:04.752887 31839 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:04.746752 31918 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.810943 31931 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.844621 31733 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.845197 31733 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:04.832809 30682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.009s
I20260709 12:22:04.833788 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:04.823259 30782 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.036s
I20260709 12:22:04.794744 31865 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.837675 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.851640 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:04.852020 30929 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:04.838726 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.834414 31792 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.833315 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.835386 31819 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.821264 31830 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:04.854701 30782 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.037s
I20260709 12:22:04.855088 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.856897 31733 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.852955 30934 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:04.856832 30935 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:04.858155 31865 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.870635 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 834) took 1056 ms. Trace:
W20260709 12:22:04.866084 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:04.869413 31733 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:04.870047 30781 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:04.821264 31833 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.859472 31792 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.854938 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.871115 30782 rpcz_store.cc:276] 0709 12:22:03.808142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:03.808324 (+   182us) service_pool.cc:224] Handling call
0709 12:22:03.808728 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:03.808960 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:04.249876 (+440916us) log.cc:844] Serialized 14 byte log entry
0709 12:22:04.864372 (+614496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:04.864438 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:04.864491 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.864567 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:04.864736 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":352205,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2484,"raft.queue_time_us":74050,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3956,"thread_start_us":1053485,"threads_started":2}
I20260709 12:22:04.873799 31733 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
W20260709 12:22:04.880955 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 100504us
I20260709 12:22:04.856098 31810 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.886917 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:04.889376 31511 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:04.860965 31840 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.863979 31917 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.897926 31833 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.896247 31733 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.903148 31733 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:04.905016 30900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.020s	sys 0.020s
W20260709 12:22:04.906464 30900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.020s	sys 0.020s
I20260709 12:22:04.918251 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.919126 30782 raft_consensus.cc:2393] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:04.920060 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.920689 30782 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:04.850013 31918 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.889559 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:04.930378 30899 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:04.929571 30931 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:04.870888 31819 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
W20260709 12:22:04.937361 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 56445.9us
I20260709 12:22:04.938090 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:04.938418 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:04.939579 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:04.951719 31921 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:04.952005 30857 raft_consensus.cc:2393] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:04.940645 31733 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:04.952250 31921 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.952786 31733 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.942078 31925 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:04.956560 31692 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.905128 31810 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.905076 31840 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.961110 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:04.948153 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 96609.3us
I20260709 12:22:04.937520 31864 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:04.950793 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.946079 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.972026 30779 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:04.973222 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:04.957083 31692 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.966095 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.990434 31733 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.974017 30779 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:04.958669 31875 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.943668 31931 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:04.911211 31917 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:04.996264 31733 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:05.166435 31938 log.cc:927] Time spent T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:22:05.174089 31875 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.176446 31922 raft_consensus.cc:1064] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:22:05.177235 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:04.971117 31864 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.054615 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:05.173454 31733 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.180112 31692 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:04.957058 31900 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:04.959020 31925 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:05.062155 31911 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 12:22:05.179396 31933 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.321s	user 0.002s	sys 0.000s
I20260709 12:22:04.989622 31790 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.184629 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:05.191845 31733 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:05.192489 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 95335.9us
I20260709 12:22:04.959892 30851 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:05.146428 31831 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.211503 31943 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.211688 31831 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.212064 31943 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.214309 31819 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.215162 31921 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.215776 31921 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.216269 31921 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.217900 31942 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.218456 31942 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:04.990439 31841 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:05.230734 31841 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.066591 31920 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.154310 31853 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.039639 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.176599 31875 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.196023 31692 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.246824 31692 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:05.210587 30857 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:05.247833 31692 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.210858 31511 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:05.183516 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:05.183737 31864 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.223080 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.250247 30854 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:05.223470 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.223754 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.251319 30858 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:05.224435 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.252233 30859 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:05.224567 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.217468 31830 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:05.228425 31831 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.229650 31942 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.071130 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:05.254383 30932 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:05.194186 31865 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.210326 31931 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.255580 31931 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.257342 30852 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:05.075889 31507 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:05.070649 31839 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.244351 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:05.076906 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59730.1us
I20260709 12:22:05.190749 31925 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.190564 31900 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.234582 31921 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.281385 30935 raft_consensus.cc:2368] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:05.324095 31943 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.233407 31841 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.326056 31943 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.326556 31943 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.234071 31810 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.327805 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.325125 31733 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.328644 30858 raft_consensus.cc:2393] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:05.231307 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.328816 31792 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.280510 31920 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.281915 31477 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:05.284554 31824 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:05.329015 31733 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.233582 31790 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.298152 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.331115 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.331461 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.450104 31946 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:05.686897 30931 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:05.234193 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.819972 31946 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.820725 30853 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:05.441843 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:05.280989 31830 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.337024 31692 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.822244 30927 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
W20260709 12:22:05.349895 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 105645us
I20260709 12:22:05.303305 31840 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.460011 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:05.823814 31692 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.284540 31947 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.824765 31790 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:05.414053 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 229258us
I20260709 12:22:05.604008 31865 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:05.331115 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.842578 30858 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:05.441102 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:05.369521 31839 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:05.396062 30934 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:05.663229 30932 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:22:05.438519 31927 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.605s	user 0.006s	sys 0.000s
I20260709 12:22:05.838209 30856 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:05.332154 31917 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:05.413012 31935 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.089s	user 0.004s	sys 0.000s
I20260709 12:22:05.864660 31733 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.857261 30933 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:05.451622 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.455499 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:05.919746 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 95797.4us
I20260709 12:22:05.919931 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 751) took 1392 ms. Trace:
I20260709 12:22:05.461720 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:05.866348 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 605899us
I20260709 12:22:05.950167 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.942986 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.944216 30776 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:05.952216 31826 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:05.945225 30778 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:05.953652 31826 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.955458 31794 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.955621 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.956580 30778 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:05.956472 31794 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.958768 31826 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.332881 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.923374 30781 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:05.858371 31865 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:05.964025 31958 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:05.404917 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.333241 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.919960 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 740) took 1554 ms. Trace:
I20260709 12:22:05.953399 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.329334 30851 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:05.933104 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:05.933943 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 103347us
I20260709 12:22:05.456717 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:05.860790 31819 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:05.593981 31810 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.438954 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.854440 31839 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:05.754801 31864 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:05.960052 31796 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:05.867244 31853 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.037871 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.038614 31853 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.665294 31918 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.529685 31920 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.510825 31921 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:05.281256 31922 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:05.883944 31925 consensus_meta.cc:287] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 12:22:05.866771 31917 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:05.732470 31926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.001s	sys 0.016s
I20260709 12:22:05.881119 31931 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.607800 31942 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:05.872968 31943 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.075387 31942 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:06.077028 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 620254us
I20260709 12:22:05.876307 31946 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.825795 31947 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:05.287949 31948 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.079161 31948 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.080699 31947 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:22:05.502554 31951 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.081663 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:06.082456 31794 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.082641 30779 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.082420 31951 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:05.503026 31953 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:05.879117 31960 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.086244 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:05.946149 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 844) took 1112 ms. Trace:
I20260709 12:22:06.087702 31951 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:05.396893 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:05.987547 31952 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.106272 31952 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.109087 31952 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:05.988117 31865 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.110343 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.111825 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.112627 30782 raft_consensus.cc:2393] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:05.969501 30776 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:06.114840 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.116379 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:06.117228 30776 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:05.990676 31810 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.119911 31810 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:05.995260 30777 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:06.121501 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.123281 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.124487 30777 raft_consensus.cc:2393] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:05.948001 30785 rpcz_store.cc:276] 0709 12:22:04.527312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.527554 (+   242us) service_pool.cc:224] Handling call
0709 12:22:04.540191 (+ 12637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:04.540600 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:04.540631 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:04.549163 (+  8532us) log.cc:844] Serialized 26 byte log entry
0709 12:22:04.830308 (+281145us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:04.830349 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.830419 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:05.919327 (+1088908us) raft_consensus.cc:1685] finished
0709 12:22:05.919379 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.919686 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":2325,"thread_start_us":268060,"threads_started":1,"wal-append.queue_time_us":617530}
I20260709 12:22:06.126768 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:06.127424 30785 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.001951 30852 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:05.968489 31958 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.132326 31962 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:05.879664 31900 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.013522 30855 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:06.024518 30784 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:06.028934 31790 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.029280 31874 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:06.030007 31819 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.031014 31824 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:06.030793 31963 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:06.032971 31830 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.142774 31874 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.143882 31830 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.145300 31874 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:05.965898 30783 rpcz_store.cc:276] 0709 12:22:04.365136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.365351 (+   215us) service_pool.cc:224] Handling call
0709 12:22:04.365709 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:04.372587 (+  6878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:04.372621 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:04.394236 (+ 21615us) log.cc:844] Serialized 26 byte log entry
0709 12:22:04.683199 (+288963us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:04.683263 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:04.683365 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:05.293453 (+610088us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:05.919091 (+625638us) raft_consensus.cc:1685] finished
0709 12:22:05.919185 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:05.919747 (+   562us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6447,"raft.queue_time_us":63162,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":21989632,"thread_start_us":241537,"threads_started":1,"wal-append.queue_time_us":353233}
W20260709 12:22:06.036098 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 87706.9us
I20260709 12:22:06.041612 31853 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.065966 31796 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.070600 31921 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.071009 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:06.073529 31926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.003s	sys 0.016s
I20260709 12:22:06.081579 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:05.869515 31959 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.086011 31953 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:05.981024 31871 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.081743 31948 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.087924 30933 rpcz_store.cc:276] 0709 12:22:04.833053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.835499 (+  2446us) service_pool.cc:224] Handling call
0709 12:22:05.459824 (+624325us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:05.945821 (+485997us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7768448}
I20260709 12:22:06.072188 31917 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.082666 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.092381 30926 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:06.094609 31925 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.125488 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.015292 31839 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.113514 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:06.136619 31893 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.137029 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.137240 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.196954 31790 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.143208 31962 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.222481 31790 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:06.146041 30860 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:06.146281 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:06.146507 31810 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:05.873843 31792 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.158254 31794 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.105597 31942 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.193811 30779 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:06.196995 30785 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:06.197451 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.199898 31830 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.201941 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.202446 31796 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.204957 31921 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.205957 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:06.206887 31853 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.242101 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 794) took 1015 ms. Trace:
I20260709 12:22:06.242504 31853 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.207763 30859 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:06.208201 31970 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.208523 31865 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.193838 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:06.034578 31864 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.223342 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.222555 30784 raft_consensus.cc:2393] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:06.223126 31962 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.227068 30782 raft_consensus.cc:2393] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:06.233465 30930 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:06.207249 31951 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:06.243716 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 105528us
I20260709 12:22:06.248951 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:06.254724 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 49050.7us
I20260709 12:22:06.258898 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:06.233515 30926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 841) took 1401 ms (client timeout 1643 ms). Trace:
W20260709 12:22:06.226562 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 154134us
I20260709 12:22:06.218595 31947 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.242789 30860 rpcz_store.cc:276] 0709 12:22:05.227087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.288973 (+ 61886us) service_pool.cc:224] Handling call
0709 12:22:06.237372 (+948399us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:06.262246 30926 rpcz_store.cc:269] 0709 12:22:04.831955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.835294 (+  3339us) service_pool.cc:224] Handling call
0709 12:22:05.440932 (+605638us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faeee 000000000036eb39 00007f961596e1e0 00007f9615a370c4 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:06.233420 (+792488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6456192}
W20260709 12:22:06.265843 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 158465us
I20260709 12:22:06.267522 31917 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.268330 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.268299 31931 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.268477 31963 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:06.268015 31970 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.268877 31951 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.267963 31958 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.256222 31794 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.266151 31864 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.254439 31948 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.267436 31925 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.254098 31810 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.290652 31931 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.269733 31865 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.324165 31864 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.248392 31893 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.335500 30781 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:06.345849 31917 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.346410 31917 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.346820 31917 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.333725 31947 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.352478 31947 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:06.350052 31978 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.352627 31969 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:06.364977 31973 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:06.365922 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 103108us
I20260709 12:22:06.366675 31810 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.366004 31973 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.367448 31810 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.368079 31810 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.334009 31931 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:06.365234 31979 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.053s	user 0.002s	sys 0.000s
I20260709 12:22:06.369365 30826 leader_election.cc:400] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
W20260709 12:22:06.328578 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 311564us
I20260709 12:22:06.376031 30826 leader_election.cc:403] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:06.342952 31864 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.342515 31958 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.384349 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:06.385311 30853 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:06.391366 31963 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:06.392068 31794 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.337941 31819 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.368180 31790 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.326036 31871 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.372623 31830 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:06.380643 31965 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:06.407007 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 103780us
I20260709 12:22:06.345604 31959 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.409838 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 786) took 1150 ms. Trace:
I20260709 12:22:06.411769 30860 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:06.412274 31960 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:06.412977 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:06.408428 31477 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:06.418485 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 49255.8us
I20260709 12:22:06.428442 31810 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.382476 31948 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.448048 31893 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:06.448865 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 47173.5us
I20260709 12:22:06.449098 31982 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:06.392236 31963 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.457626 31973 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:06.459450 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 46639us
I20260709 12:22:06.459794 31790 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:06.464136 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:06.470007 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 94018.3us
I20260709 12:22:06.420083 31947 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.470794 31830 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.415541 31965 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.415957 31958 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.449750 31982 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.381093 31978 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.414939 30854 rpcz_store.cc:276] 0709 12:22:05.224771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.854369 (+629598us) service_pool.cc:224] Handling call
0709 12:22:05.854871 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:06.075347 (+220476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:06.075401 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:06.076111 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:22:06.225342 (+149231us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:06.225382 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:06.228523 (+  3141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:06.369365 (+140842us) raft_consensus.cc:1685] finished
0709 12:22:06.369386 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:06.375610 (+  6224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23846,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":363,"spinlock_wait_cycles":46976,"thread_start_us":317137,"threads_started":2,"wal-append.queue_time_us":189276}
W20260709 12:22:06.507424 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 56917.6us
I20260709 12:22:06.466195 31842 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.506429 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:06.608098 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 117174us
I20260709 12:22:06.462055 31951 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.599866 31790 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.563546 31853 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.528306 31953 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.599099 31965 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.622473 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.528210 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:06.618494 31790 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.421178 31794 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.198s
I20260709 12:22:06.597628 31842 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.612509 31966 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:22:06.635102 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 785) took 1409 ms. Trace:
I20260709 12:22:06.635592 30859 rpcz_store.cc:276] 0709 12:22:05.224503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.330791 (+106288us) service_pool.cc:224] Handling call
0709 12:22:06.633657 (+1302866us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000c6cd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:06.633939 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872733312}
I20260709 12:22:06.643136 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.632170 31871 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:06.637817 31865 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:06.674355 31980 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:22:06.637692 31981 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:06.692011 30934 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.813840 31893 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.814553 31893 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.817281 31893 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.692035 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.818341 30825 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:06.702307 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:06.651070 31970 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:06.834672 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 82121.2us
I20260709 12:22:06.752349 31948 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:06.837548 31962 consensus_meta.cc:287] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.003s
I20260709 12:22:06.778944 31830 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.693543 31981 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:06.838135 31962 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.838701 31981 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.840771 31962 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.841614 31865 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.841959 30930 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:06.842167 31865 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.842669 31865 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.843479 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.846517 30899 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:06.854106 30934 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:06.820302 31963 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.855974 30678 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:06.858355 30776 consensus_meta.cc:287] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.722s	user 0.014s	sys 0.005s
I20260709 12:22:06.860460 30929 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.860910 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:06.867712 31511 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:06.869158 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.870529 31982 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.870824 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.871659 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.872045 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:06.872476 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.874037 31874 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:06.874387 31969 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:06.874747 31893 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:06.876631 31824 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.903395 31824 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.907001 31959 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.908502 30782 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:06.877876 30682 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 201) took 2768 ms. Trace:
I20260709 12:22:06.910157 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.886336 30776 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:06.912442 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.913054 30785 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:06.877876 30927 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:06.915879 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.916699 30928 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:06.878424 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.917924 31874 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.918984 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.920362 31874 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.920370 31987 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:06.922338 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:06.922525 31987 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.923440 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:06.861745 31965 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.882038 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.924856 30931 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:06.925129 30932 raft_consensus.cc:2368] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3.
I20260709 12:22:06.833074 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.878738 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:06.883315 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:06.701153 31796 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:06.883597 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.900106 30678 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:06.922768 30679 catalog_manager.cc:5697] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:06.924172 30780 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.882858 31842 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.880517 30825 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:06.925436 31987 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.884749 31958 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.953158 31506 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:06.952633 30678 catalog_manager.cc:5697] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:06.909714 30682 rpcz_store.cc:276] 0709 12:22:04.080523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:04.082032 (+  1509us) service_pool.cc:224] Handling call
0709 12:22:06.848514 (+2766482us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:04.938602 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:04.939230 (+   628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:04.939269 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:22:04.939289 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:04.939888 (+   599us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:04.939957 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:04.939988 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:22:04.940353 (+   365us) tablet.cc:701] Row locks acquired
0709 12:22:04.940377 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:22:04.940524 (+   147us) write_op.cc:270] Start()
0709 12:22:04.940664 (+   140us) write_op.cc:276] Timestamp: P: 1783599724940475 usec, L: 0
0709 12:22:04.940691 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:22:04.941465 (+   774us) log.cc:844] Serialized 1311 byte log entry
0709 12:22:05.504516 (+563051us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f960d9150ac 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b
0709 12:22:06.202834 (+698318us) op_driver.cc:464] REPLICATION: finished
0709 12:22:06.379441 (+176607us) write_op.cc:301] APPLY: starting
0709 12:22:06.379629 (+   188us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:06.379861 (+   232us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:06.379913 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:06.383591 (+  3678us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:06.383951 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:22:06.384027 (+    76us) write_op.cc:312] APPLY: finished
0709 12:22:06.384506 (+   479us) log.cc:844] Serialized 34 byte log entry
0709 12:22:06.384752 (+   246us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:06.384905 (+   153us) write_op.cc:454] Released schema lock
0709 12:22:06.384990 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:06.418361 (+ 33371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:06.420426 (+  2065us) write_op.cc:454] Released schema lock
0709 12:22:06.447638 (+ 27212us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1c32a 00007f96109a1f14 00007f96109a1ec3 00007f96109a1e38 00007f96109a1df3 00007f96109a10dc 00007f96109cae16 00007f96109b2cbb 00007f961099d39d 00007f96109a0d75
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":128533,"apply.run_cpu_time_us":3897,"apply.run_wall_time_us":34419,"num_ops":3,"prepare.queue_time_us":632558,"prepare.run_cpu_time_us":23258,"prepare.run_wall_time_us":1278031,"raft.queue_time_us":258134,"raft.run_cpu_time_us":16535,"raft.run_wall_time_us":306436,"replication_time_us":1261912,"spinlock_wait_cycles":148836992,"thread_start_us":2091816,"threads_started":4,"wal-append.queue_time_us":935854}]]}
I20260709 12:22:06.955267 31790 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.952672 30929 raft_consensus.cc:1275] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:06.918497 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:06.960248 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 79890.3us
W20260709 12:22:06.960773 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 88114.5us
W20260709 12:22:06.952106 31839 consensus_meta.cc:287] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.000s
W20260709 12:22:06.966732 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 141957us
I20260709 12:22:06.968588 31948 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.969053 31948 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.969410 31948 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.969982 31981 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.972533 31981 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:06.948036 31978 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:06.926044 30933 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:06.975620 30825 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:06.960613 31969 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:06.978021 30934 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.961054 31947 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:06.961537 31790 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:06.958369 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 69971.7us
I20260709 12:22:06.985390 30899 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:06.977067 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.976572 31824 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:06.994316 30899 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:06.994689 31952 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:06.994200 31865 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.995208 31952 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:06.995945 31830 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.996366 31830 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:06.996624 31810 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:06.996789 31830 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.997035 31810 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:06.997677 31810 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:06.996369 31952 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:07.000108 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:06.995313 31931 consensus_meta.cc:287] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.004s
W20260709 12:22:07.002593 31917 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.655s	user 0.002s	sys 0.010s
I20260709 12:22:07.002275 31931 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.003041 31917 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:07.004542 31931 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.005312 31917 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.002305 31833 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.008098 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.009567 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:07.010905 31864 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.006s
I20260709 12:22:07.011081 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.011374 31864 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:07.012384 31819 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:07.014084 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.014612 30934 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:07.014267 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.016199 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:06.996980 31865 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.016800 30935 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.018049 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.018659 30934 raft_consensus.cc:2368] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:07.018741 30931 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:07.019088 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.020017 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.020752 30930 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.020804 31969 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:06.994724 30825 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:07.022630 31865 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.023031 30825 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:07.023674 31508 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:07.023873 31931 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:07.024345 31931 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.010479 30780 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:07.024258 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:07.030925 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:07.031716 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:06.964628 31796 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:06.964233 31925 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:22:07.047138 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:07.048048 30858 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.028770 31864 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.034895 31931 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.050657 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.055332 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.023038 31865 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.052956 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.040532 31963 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:06.976356 31839 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.056445 30784 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:07.059569 30825 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:07.061568 30778 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:07.056152 31506 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:07.060634 31790 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:07.070389 31810 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.077433 31796 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.077839 31947 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.078337 31947 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.071332 31839 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.078774 31947 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.072072 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.078584 31810 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.060473 31874 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:07.081275 31874 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:07.057716 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.082442 30926 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:07.083830 31874 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:07.042002 31476 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:07.084754 30783 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:07.060818 31865 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.085577 31864 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:07.075883 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:07.086526 30856 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.076483 31506 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:07.080564 30927 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.069693 31790 raft_consensus.cc:697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:07.072731 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:07.084995 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 52812.4us
I20260709 12:22:07.074571 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:07.111760 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.111900 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.115592 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.116328 30930 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.116065 31790 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.117642 30931 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:07.108183 31874 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.129525 30856 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:07.118759 30928 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:07.135450 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:07.136217 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 81678us
I20260709 12:22:07.137691 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:07.064242 31833 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:22:07.153995 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.155329 30855 raft_consensus.cc:1275] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.160028 31865 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.161206 30852 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.134582 31819 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:07.151746 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.162238 30854 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:07.163686 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:07.164489 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 90074.4us
I20260709 12:22:07.149474 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.170621 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.145358 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.154632 31893 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.183693 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.174817 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.180918 30859 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:07.173782 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.132275 31874 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.186463 30784 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:07.187533 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.191632 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.177003 31819 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.193245 31819 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:07.193574 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:07.194332 30933 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.195842 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:07.148509 31476 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:07.197271 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:07.198133 30851 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:07.199206 31864 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:07.199694 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.213s (SENT) [suppressed 10 similar messages]
I20260709 12:22:07.200414 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:07.200521 31871 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.201108 31871 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.154655 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:07.197280 30926 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:07.202205 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 60210us
I20260709 12:22:07.198025 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.204937 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.209547 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.186322 31893 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.201558 31871 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:07.197396 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 65900.7us
W20260709 12:22:07.220494 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.178242 31948 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.214905 30785 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.224140 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.224737 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.225481 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.225898 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.226111 30930 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:07.226251 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.227296 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.229422 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.231403 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:07.219787 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.214181 30780 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.192838 30931 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.210412 31864 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:07.253911 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.254704 30899 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:07.255357 31965 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:07.213651 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.189867 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:07.259217 31997 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:22:07.193270 31992 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:22:07.262840 31931 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.231537 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.219218 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.442657 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.412743 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.572790 31925 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.599857 31925 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:07.290606 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 151260us
I20260709 12:22:07.604185 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:07.321437 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.605156 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:07.373409 30858 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:07.216867 31893 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.414808 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.384599 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.456234 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.301697 30933 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:07.608999 32003 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.229285 31874 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.405441 30785 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:07.609157 31477 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:07.622974 30851 raft_consensus.cc:2368] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3.
I20260709 12:22:07.593741 31819 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.618855 30860 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:07.623462 30781 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.624145 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:07.624388 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:07.542394 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.610085 30859 raft_consensus.cc:1240] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:07.269801 31948 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.627184 31963 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:07.627812 31963 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:07.628943 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:07.628885 31963 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.629942 30929 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.630715 30857 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
W20260709 12:22:07.621798 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 367169us
I20260709 12:22:07.435201 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:07.606760 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.632228 30899 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:07.632668 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 197576us
I20260709 12:22:07.622043 30852 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:07.621421 32003 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.269906 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.652063 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.661517 30856 raft_consensus.cc:2368] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:07.654096 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.433583 31865 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.444234 31810 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.659283 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.659581 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.662897 30858 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:07.663295 30855 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:07.664355 30857 raft_consensus.cc:2368] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:07.660447 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.664453 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.665329 30779 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.387333 31962 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:07.339577 31947 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.651583 30926 raft_consensus.cc:2410] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:07.666556 30750 leader_election.cc:400] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3.
I20260709 12:22:07.633257 31824 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:07.674391 31824 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.674867 31824 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:07.675038 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.664068 31999 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:07.676937 31999 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:07.679332 31999 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.682145 31922 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.682338 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.682765 31922 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.683492 30852 raft_consensus.cc:2368] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:07.684937 31922 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:07.227341 30927 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:07.651734 31952 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.670018 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.670462 30750 leader_election.cc:403] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:07.673251 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.218516 31830 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.673270 30825 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:07.638595 31796 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.652056 30860 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.642899 31819 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:07.690975 30855 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:07.660036 32003 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:07.697086 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 52442.7us
I20260709 12:22:07.701452 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:07.693856 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.696408 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.693609 30859 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:07.652112 31842 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:07.699672 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.704972 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.706558 30929 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.653563 31871 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.710719 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.705660 30858 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:07.670675 31810 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:07.697813 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.690145 31952 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:07.694607 31796 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:07.726127 31796 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.727758 31925 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:07.728531 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.729282 30934 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.724524 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.724779 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.706350 31999 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:07.714926 32005 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:22:07.726016 31476 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:07.720229 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.750177 30853 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:07.732069 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.729557 31952 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:07.721553 32011 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:22:07.757175 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.758457 30825 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:07.759512 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.798974 30857 raft_consensus.cc:2368] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:07.760604 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:07.761340 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.766921 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.767710 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.721428 31947 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.767599 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:07.758036 31999 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:07.696282 31962 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.715693 31864 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:07.800872 30852 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
W20260709 12:22:07.805400 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 53992us
I20260709 12:22:07.756764 30776 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.799122 30858 raft_consensus.cc:2376] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
I20260709 12:22:07.775442 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.844920 30783 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.835567 30933 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:07.776885 31925 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.768064 30927 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:07.886194 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.887276 30854 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:07.888304 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.889276 30854 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:07.900365 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:07.800580 32013 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:07.905313 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.921676 30857 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:07.910898 31922 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.911548 31965 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.915257 31833 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.918817 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:07.846153 31999 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:07.941107 30781 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:07.926643 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.808727 32010 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:07.938310 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.946411 30858 raft_consensus.cc:2368] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:07.836306 30928 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
W20260709 12:22:07.935223 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 316544us
I20260709 12:22:07.895155 31925 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:07.954084 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:07.955462 31925 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:07.960053 32003 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.961630 31922 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.964975 31893 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.966406 31830 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:07.966233 31864 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:07.914180 31819 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:07.967929 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:07.968590 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.969890 31947 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.971117 31826 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:07.971342 31810 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:07.972754 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 46518.7us
I20260709 12:22:08.278702 31826 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.972411 31833 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:07.973613 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:07.973862 32010 raft_consensus.cc:697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:08.282189 30858 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:08.282698 32010 consensus_queue.cc:237] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.284584 31833 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:07.926656 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0153959100002794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
I20260709 12:22:07.936005 32014 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:07.976315 31962 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.978214 31931 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:07.952419 31965 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:07.981096 31871 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:07.969391 30780 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:07.981995 31987 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:07.995110 30679 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 76) took 1094 ms. Trace:
I20260709 12:22:07.878086 30931 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
W20260709 12:22:08.318928 31952 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.008s
I20260709 12:22:08.319116 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.995883 30784 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:08.320574 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 882) took 1149 ms. Trace:
I20260709 12:22:07.997819 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:08.322165 30781 raft_consensus.cc:2368] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:08.000358 30779 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:07.985983 32013 raft_consensus.cc:697] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:07.917424 31966 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:08.100391 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 131472us
W20260709 12:22:08.224066 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 498133us
I20260709 12:22:07.995133 31824 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.269848 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:08.286872 32005 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:08.267412 30857 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:08.303848 32027 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.336007 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:08.336385 32005 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.338514 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:08.327593 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 886) took 1148 ms. Trace:
W20260709 12:22:08.339720 31956 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.382s	user 0.008s	sys 0.005s
I20260709 12:22:08.266446 31893 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:08.274887 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:08.007990 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 289617us
W20260709 12:22:08.098624 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 144608us
I20260709 12:22:08.269032 30783 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:08.339957 30780 rpcz_store.cc:276] 0709 12:22:07.172574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.197672 (+ 25098us) service_pool.cc:224] Handling call
0709 12:22:08.321022 (+1123350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:08.359877 31833 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:08.360769 30780 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:08.360534 31833 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.362455 30783 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:08.309487 30679 rpcz_store.cc:276] 0709 12:22:06.900500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.900741 (+   241us) service_pool.cc:224] Handling call
0709 12:22:07.994994 (+1094253us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:07.167974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:07.193615 (+ 25641us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:07.193668 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:22:07.193688 (+    20us) tablet.cc:662] Decoding operations
0709 12:22:07.194182 (+   494us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:07.194306 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:07.194345 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:22:07.194699 (+   354us) tablet.cc:701] Row locks acquired
0709 12:22:07.194763 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:22:07.194966 (+   203us) write_op.cc:270] Start()
0709 12:22:07.195228 (+   262us) write_op.cc:276] Timestamp: P: 1783599727194895 usec, L: 0
0709 12:22:07.195273 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:22:07.256763 (+ 61490us) log.cc:844] Serialized 535 byte log entry
0709 12:22:07.608618 (+351855us) op_driver.cc:464] REPLICATION: finished
0709 12:22:07.609740 (+  1122us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1ae28 00007f9614455581 00007f9614454d58 00007f96144599f1 00007f96144599a9 00007f9614459939 00007f9614459901 00007f9614458b2d 0000000000388634 0000000000388479
0709 12:22:07.807361 (+197621us) write_op.cc:301] APPLY: starting
0709 12:22:07.837225 (+ 29864us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:07.883232 (+ 46007us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:07.895754 (+ 12522us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:07.976954 (+ 81200us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:07.977184 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:22:07.977261 (+    77us) write_op.cc:312] APPLY: finished
0709 12:22:07.977569 (+   308us) log.cc:844] Serialized 22 byte log entry
0709 12:22:07.977827 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:07.977946 (+   119us) write_op.cc:454] Released schema lock
0709 12:22:07.978015 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:07.978453 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:07.978480 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":134867,"apply.run_cpu_time_us":2372,"apply.run_wall_time_us":178927,"num_ops":1,"prepare.queue_time_us":157244,"prepare.run_cpu_time_us":26817,"prepare.run_wall_time_us":476925,"replication_time_us":410101,"spinlock_wait_cycles":18272512,"thread_start_us":172890,"threads_started":2}]]}
I20260709 12:22:08.363509 31965 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:08.320771 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.376098 30928 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.376437 30776 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:08.372534 31477 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:08.379258 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:08.380056 31824 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:08.292339 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:07.996389 30825 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:08.296411 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:08.296682 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.505887 30927 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:08.506284 30926 raft_consensus.cc:2368] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:08.507320 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:08.507838 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.297276 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.509091 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.509398 30934 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.297547 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.297940 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.298240 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.514181 30932 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.514572 30930 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.281510 31826 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:08.269871 31922 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:08.288080 32014 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:08.286142 31947 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.266481 31992 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:08.318182 31987 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.321048 30784 rpcz_store.cc:276] 0709 12:22:07.171264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.212397 (+ 41133us) service_pool.cc:224] Handling call
0709 12:22:08.320463 (+1108066us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:08.329794 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 43718.3us
I20260709 12:22:08.569622 30934 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:08.356730 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:08.327844 30860 consensus_meta.cc:287] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.027s
I20260709 12:22:08.319587 31952 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:08.265357 31796 consensus_meta.cc:287] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.009s
I20260709 12:22:08.270677 30852 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:22:08.305248 30851 consensus_meta.cc:287] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.680s	user 0.026s	sys 0.000s
W20260709 12:22:08.364049 32017 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:22:08.372751 31510 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:08.374392 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:08.374935 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:08.267340 31999 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.387537 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:08.380628 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:08.395030 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.580817 30931 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.581106 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:08.581429 32023 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260709 12:22:08.582077 30934 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:08.568344 32014 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.585548 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:08.568187 30927 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.395834 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:08.361330 32013 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.589152 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:08.585583 31507 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:08.398336 32005 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:08.328392 31874 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3.
I20260709 12:22:08.381917 32024 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:08.406764 32027 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.592865 32024 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:08.409168 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:08.593959 32024 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.595098 30929 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:08.411296 30928 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:08.596552 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:08.424322 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 132485us
I20260709 12:22:08.439438 32034 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:08.439370 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 60212us
I20260709 12:22:08.447180 32003 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:08.426538 31969 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:22:08.430142 31824 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:22:08.453143 32018 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:08.438464 31833 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:08.463690 32026 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:22:08.672519 30929 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:08.493002 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 52464.8us
W20260709 12:22:08.497001 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 500680us
I20260709 12:22:08.498279 31931 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:08.505069 32022 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.132s	user 0.001s	sys 0.002s
I20260709 12:22:08.514181 30935 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.569969 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:08.572208 30932 raft_consensus.cc:2410] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:08.688271 30825 leader_election.cc:400] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:08.567965 30926 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.576900 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:08.577358 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:08.578452 30780 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.575234 31796 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.578639 31962 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:08.575418 30851 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:08.579033 31839 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:08.580072 31952 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:08.404009 32020 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:08.599035 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:08.671139 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:08.599380 31999 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:08.671701 32018 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.573477 30860 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:08.689296 30825 leader_election.cc:403] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:22:08.703462 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:08.798590 30930 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:08.747713 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 817) took 1146 ms. Trace:
W20260709 12:22:08.747252 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 148392us
I20260709 12:22:08.804069 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:08.807529 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 230694us
I20260709 12:22:08.808930 30826 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:08.798424 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:08.803766 30852 rpcz_store.cc:276] 0709 12:22:07.600968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.997174 (+396206us) service_pool.cc:224] Handling call
0709 12:22:08.270364 (+273190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:08.573715 (+303351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.747626 (+173911us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:08.861963 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 47983.9us
I20260709 12:22:08.880986 30750 leader_election.cc:400] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3.
I20260709 12:22:08.862964 30779 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:08.863396 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 58645.4us
I20260709 12:22:08.792196 31508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 143) took 1149 ms. Trace:
I20260709 12:22:08.703349 31931 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:08.873131 30930 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.874894 30785 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:08.875275 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 813) took 1263 ms. Trace:
I20260709 12:22:08.803403 31790 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:08.804168 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:08.888088 30859 rpcz_store.cc:276] 0709 12:22:07.599842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.739531 (+139689us) service_pool.cc:224] Handling call
0709 12:22:07.755083 (+ 15552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:07.954953 (+199870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.954992 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:07.955555 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:22:08.274109 (+318554us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:08.274147 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.274213 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:08.504108 (+229895us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:08.809254 (+305146us) raft_consensus.cc:1685] finished
0709 12:22:08.809277 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:08.863099 (+ 53822us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22215,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":62185728,"thread_start_us":152662,"threads_started":1,"wal-append.queue_time_us":417237}
I20260709 12:22:08.809255 30931 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:08.670349 31992 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.809504 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 807) took 1208 ms. Trace:
I20260709 12:22:08.896063 30929 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:08.893581 30900 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:08.803403 31874 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:22:08.875705 31864 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:08.870843 32010 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.721654 32040 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 12:22:08.916471 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:08.893929 30928 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.864348 32039 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:22:08.938305 31864 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:08.939289 31864 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.872628 32036 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:22:08.881197 31962 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:08.945698 32010 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:08.946133 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:08.897082 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 298185us
I20260709 12:22:08.805585 32020 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.900969 32005 consensus_queue.cc:1059] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:22:08.924559 30927 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:08.893254 31893 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:22:08.925618 30929 raft_consensus.cc:1240] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:08.925933 32016 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.926258 32014 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.957295 30927 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:08.927453 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:08.958724 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:08.959918 30900 leader_election.cc:400] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:08.960193 30900 leader_election.cc:403] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:08.961150 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:08.961956 31952 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:08.962352 31952 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:08.962531 32005 raft_consensus.cc:3055] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:08.962693 31810 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:08.963043 32005 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:08.963188 31810 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:08.963559 31922 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:08.963949 32005 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.964104 31810 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:08.965377 31810 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:08.930233 31931 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:08.931141 31947 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:08.934988 30928 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:08.899947 30781 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:08.981462 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:08.982025 30930 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:08.979786 30900 leader_election.cc:400] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:08.986344 30900 leader_election.cc:403] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:08.965477 32005 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.900342 30851 rpcz_store.cc:276] 0709 12:22:07.598323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.623798 (+ 25475us) service_pool.cc:224] Handling call
0709 12:22:08.806940 (+1183142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:08.948779 31987 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:08.962754 31952 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:08.965549 32014 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:09.006028 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 197187us
I20260709 12:22:08.986155 31826 raft_consensus.cc:2764] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:09.007825 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:09.012754 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 326211us
I20260709 12:22:09.016008 30825 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:09.000993 32016 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:09.026960 31922 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:09.031116 31922 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.031495 31922 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.005818 31963 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.042053 30826 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.045621 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 816) took 1026 ms. Trace:
I20260709 12:22:09.046056 30783 rpcz_store.cc:276] 0709 12:22:08.019236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.363282 (+344046us) service_pool.cc:224] Handling call
0709 12:22:08.363602 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:08.634535 (+270933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.634567 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:08.634613 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:08.634652 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.045369 (+410717us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003cdcd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:09.045427 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.045561 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622553856}
I20260709 12:22:09.047592 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 892) took 1171 ms. Trace:
I20260709 12:22:09.047957 30785 rpcz_store.cc:276] 0709 12:22:07.875826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.895016 (+ 19190us) service_pool.cc:224] Handling call
0709 12:22:09.047373 (+1152357us) spinlock_profiling.cc:243] Waited 951 ms on lock 0x7b54003db654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:09.047530 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188096256}
I20260709 12:22:09.042266 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:09.055081 30825 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:08.886168 31508 rpcz_store.cc:276] 0709 12:22:07.668893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.677094 (+  8201us) service_pool.cc:224] Handling call
0709 12:22:07.678011 (+   917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:07.678672 (+   661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:07.678722 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:07.680578 (+  1856us) log.cc:844] Serialized 564 byte log entry
0709 12:22:07.934802 (+254224us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:07.949785 (+ 14983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:07.953031 (+  3246us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:08.363372 (+410341us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:08.766936 (+403564us) raft_consensus.cc:1685] finished
0709 12:22:08.771658 (+  4722us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:08.792088 (+ 20430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116942080,"thread_start_us":122161,"threads_started":1,"wal-append.queue_time_us":586031}
I20260709 12:22:09.060665 31839 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:09.061305 31839 raft_consensus.cc:697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:09.062047 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.062604 31839 consensus_queue.cc:237] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.060214 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:08.999457 31477 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.027401 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 831) took 1299 ms. Trace:
I20260709 12:22:09.080927 30935 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:09.044039 32051 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:09.088220 32010 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:09.106346 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 89667.5us
I20260709 12:22:09.110176 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.098587 31966 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.097426 31833 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
I20260709 12:22:09.104447 32034 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.114818 32016 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:09.144518 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:09.144433 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 145866us
I20260709 12:22:09.114924 32050 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:09.118165 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 131040us
W20260709 12:22:09.174729 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 112780us
I20260709 12:22:09.175849 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.156916 31839 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:09.152684 32051 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:09.152318 31947 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.153484 31992 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.170053 32010 raft_consensus.cc:697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:09.173312 32016 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:09.231904 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 56183.6us
I20260709 12:22:09.184262 32059 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.159276 31966 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.237620 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.171640 32050 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.244235 31966 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.244467 32050 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:09.245298 32056 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:22:09.244258 30826 leader_election.cc:400] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:09.256724 31952 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.259473 31952 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:09.217751 30780 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:09.252650 32059 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:09.217916 32020 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:09.220345 31839 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:09.261946 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.231940 31842 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.235396 32016 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:09.269676 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 89928.9us
I20260709 12:22:09.235071 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:09.235872 31992 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:09.272076 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 49700.2us
I20260709 12:22:09.096145 30853 rpcz_store.cc:276] 0709 12:22:07.728190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.272681 (+544491us) service_pool.cc:224] Handling call
0709 12:22:08.287558 (+ 14877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:08.394255 (+106697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:08.394296 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:08.395619 (+  1323us) log.cc:844] Serialized 564 byte log entry
0709 12:22:08.505260 (+109641us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f960d9150ac 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b
0709 12:22:08.687686 (+182426us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:08.703663 (+ 15977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:08.743236 (+ 39573us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:08.980040 (+236804us) raft_consensus.cc:1685] finished
0709 12:22:08.983633 (+  3593us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.020210 (+ 36577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20537600,"thread_start_us":274772,"threads_started":1,"wal-append.queue_time_us":551068}
I20260709 12:22:09.245971 32055 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.223929 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.289309 31947 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:09.297673 30900 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.506s (SENT)
I20260709 12:22:09.299866 31947 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:09.298709 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.300093 31510 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:09.300390 31947 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.300438 30926 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:09.300935 32038 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:09.301108 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 897) took 1002 ms. Trace:
I20260709 12:22:09.301540 30926 rpcz_store.cc:276] 0709 12:22:08.299174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.507441 (+208267us) service_pool.cc:224] Handling call
0709 12:22:09.301040 (+793599us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:09.302233 32054 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:22:09.302399 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.298911 31506 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 1 LEARNER]: Advancing to term 3
W20260709 12:22:09.299461 32061 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:22:09.298890 32064 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.252452 31922 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:09.290421 31507 consensus_meta.cc:287] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.698s	user 0.014s	sys 0.000s
W20260709 12:22:09.304610 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 244448us
W20260709 12:22:09.305970 30900 leader_election.cc:336] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.585s (SENT)
W20260709 12:22:09.310102 32053 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:22:09.311134 32059 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:09.313592 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.306844 32020 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.314363 32064 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.315706 31839 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.277735 31842 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.317967 31922 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:09.227288 32051 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.307337 32010 consensus_queue.cc:237] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.307003 32055 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.330920 32055 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.331322 31796 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.331367 32055 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.292423 31992 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.335724 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:09.320046 31931 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:22:09.336419 31510 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.328599 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.328522 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.329669 30851 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:09.330156 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.340176 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.301498 32038 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:09.340543 31992 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.357323 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.356719 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:09.365129 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59187.5us
W20260709 12:22:09.319403 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 100093us
I20260709 12:22:09.363039 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:09.362680 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 60353.1us
W20260709 12:22:09.366855 30900 leader_election.cc:336] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.674s (SENT)
I20260709 12:22:09.367349 30900 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.361311 31794 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:09.368427 30900 leader_election.cc:336] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.736s (SENT)
I20260709 12:22:09.368417 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.368966 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.369319 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.374464 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.375365 30854 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:09.374508 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.376111 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:09.386708 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:09.387444 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:09.387521 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.340847 32018 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.368211 31794 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:09.390128 32069 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.390784 31842 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.391076 31506 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:09.357272 30853 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:09.394554 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.379804 32064 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.326960 32050 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.398748 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:09.402062 30933 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:09.403477 32072 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.403771 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1050) took 1025 ms. Trace:
I20260709 12:22:09.403939 32066 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:09.404768 30900 leader_election.cc:336] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.807s (SENT)
I20260709 12:22:09.408644 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:09.414763 31963 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.355542 32059 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.426200 30856 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.427435 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:09.427829 31510 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:09.448899 31963 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.452373 32020 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:09.430086 30826 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.443550 30934 rpcz_store.cc:276] 0709 12:22:08.378734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.877897 (+499163us) service_pool.cc:224] Handling call
0709 12:22:09.151384 (+273487us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:09.151613 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.151870 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.151906 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:09.157503 (+  5597us) log.cc:844] Serialized 26 byte log entry
0709 12:22:09.295221 (+137718us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:09.295285 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.295449 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.403466 (+108017us) raft_consensus.cc:1685] finished
0709 12:22:09.403487 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.403710 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11714304,"thread_start_us":74823,"threads_started":1,"wal-append.queue_time_us":198954}
I20260709 12:22:09.447182 30859 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:09.449132 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.457185 30826 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.445590 31507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42836 (request call id 130) took 1039 ms. Trace:
I20260709 12:22:09.429052 31952 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:22:09.440512 32076 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:09.464735 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 60024us
W20260709 12:22:09.468026 30900 leader_election.cc:336] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.896s (SENT)
I20260709 12:22:09.468528 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.470801 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:09.472896 30900 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.925s (SENT)
I20260709 12:22:09.473385 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:09.474498 30900 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.926s (SENT)
I20260709 12:22:09.474889 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.475622 32038 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:09.475920 31969 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.476565 32066 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.476729 31969 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.462268 31931 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:09.478096 30900 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.940s (SENT)
I20260709 12:22:09.478762 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.479071 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:09.480093 30858 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
W20260709 12:22:09.482402 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 53200.6us
I20260709 12:22:09.447873 31947 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.486482 30899 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:09.484553 30826 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.464428 32051 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.463894 31507 rpcz_store.cc:276] 0709 12:22:08.408978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.422448 (+ 13470us) service_pool.cc:224] Handling call
0709 12:22:08.584999 (+162551us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b5800023498. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faeee 000000000036eb39 00007f961596e1e0 00007f9615a370c4 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:08.585182 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:08.585450 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:09.318535 (+733085us) log.cc:844] Serialized 14 byte log entry
0709 12:22:09.392946 (+ 74411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:09.396721 (+  3775us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:09.421358 (+ 24637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.429897 (+  8539us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.443710 (+ 13813us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1507,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"spinlock_wait_cycles":10102144,"thread_start_us":59100,"threads_started":1,"wal-append.queue_time_us":130025}
I20260709 12:22:09.468174 31819 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.507543 30852 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.486508 31824 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.488986 32072 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.496237 32059 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:09.522722 30856 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:09.489995 32050 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.522125 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.494246 32051 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.509439 32076 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.537106 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.534050 31505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42836 (request call id 133) took 1080 ms. Trace:
I20260709 12:22:09.545192 31794 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:09.541154 32059 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:09.545729 32016 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.547103 32059 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.543445 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.572011 30852 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:09.535197 32051 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:09.618376 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 75047.7us
I20260709 12:22:09.619367 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.620558 30785 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:09.541338 32072 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.543359 31824 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.623282 31794 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:09.678517 31794 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.681259 31794 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.659294 30783 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:09.660004 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:09.660413 30785 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:09.662312 31931 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:09.687554 30900 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.213s (SENT)
I20260709 12:22:09.688114 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.676208 32055 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:09.699504 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 80275.2us
I20260709 12:22:09.700460 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.711159 30826 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.715427 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.716568 31810 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:09.718379 30854 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:09.727005 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:09.689324 32072 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.725726 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.678438 31824 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.731988 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.733392 32050 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.733737 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.734879 32064 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.735461 32064 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.736037 32064 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.745081 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.723181 31931 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.756208 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:09.725629 31962 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:09.725095 32084 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.731235 32076 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.731666 31810 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.731245 32072 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.767944 31962 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.544214 31505 rpcz_store.cc:276] 0709 12:22:08.410428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:08.429950 (+ 19522us) service_pool.cc:224] Handling call
0709 12:22:08.447639 (+ 17689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:08.999742 (+552103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.002622 (+  2880us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:09.030140 (+ 27518us) log.cc:844] Serialized 26 byte log entry
0709 12:22:09.171264 (+141124us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:09.174302 (+  3038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:09.490301 (+315999us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54005212d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:09.490364 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:09.490414 (+    50us) raft_consensus.cc:1685] finished
0709 12:22:09.490435 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:09.490695 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233192320,"thread_start_us":126464,"threads_started":1,"wal-append.queue_time_us":232167}
I20260709 12:22:09.765600 32085 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.781517 31810 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.828042 31931 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:22:09.829360 32081 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:22:09.827025 30860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 815) took 2174 ms (client timeout 1818 ms). Trace:
W20260709 12:22:09.835093 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 89765.2us
I20260709 12:22:09.847664 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.849099 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.834479 31962 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.831358 31947 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:09.782675 31952 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:22:09.835913 31790 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:09.858444 30826 leader_election.cc:400] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:09.859951 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.861282 31790 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:09.840178 31931 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.849285 32076 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:09.846403 32010 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:09.874307 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.880884 30857 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:09.877517 31931 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.879554 32020 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:22:09.872977 31947 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:09.892081 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.914872 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.924279 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:09.877851 32076 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:09.898159 32078 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
I20260709 12:22:09.935350 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:09.931841 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.965378 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:09.965943 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 208381us
I20260709 12:22:09.967234 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:09.941975 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:09.847210 30860 rpcz_store.cc:269] 0709 12:22:07.600338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:07.624102 (+ 23764us) service_pool.cc:224] Handling call
0709 12:22:09.767576 (+2143474us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54003a98d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:09.774545 (+  6969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31709568}
I20260709 12:22:09.882272 32092 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:09.946841 32087 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:22:09.947361 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:09.975306 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 94352.8us
I20260709 12:22:09.938422 32076 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:09.950301 31839 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:09.975742 30857 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:09.926712 32055 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:09.953989 31963 consensus_meta.cc:287] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.006s
I20260709 12:22:09.959669 32064 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:09.917997 31947 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:09.946118 30782 raft_consensus.cc:2368] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:09.971606 30933 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:09.943662 32038 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.976265 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:09.986320 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:09.951417 31824 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:09.990187 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:10.003235 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.004263 30855 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:10.004935 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.005716 30857 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:09.970413 31794 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.973245 32040 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:09.972365 31999 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:09.931663 32095 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:22:10.001442 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:09.975907 32027 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:10.028429 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 52295.4us
W20260709 12:22:09.998880 32086 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:22:10.034325 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.048404 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.036051 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.049258 30929 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.037278 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.001502 31947 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.050774 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:09.985617 32059 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:22:10.065362 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.066289 30935 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:10.067368 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.068447 30932 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:10.071892 30927 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:10.072882 31839 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:10.073323 31839 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:10.074128 32089 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:22:10.074349 31839 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.052913 31922 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.034953 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:09.995697 31963 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.059846 30930 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:10.062093 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.063138 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.063679 32072 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:22:10.094138 32090 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:22:10.095191 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.095853 32072 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:22:10.064133 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.023444 32066 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:10.098881 32066 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:10.099177 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.099917 32066 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:10.100929 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.102046 30855 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:10.097246 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.092432 30929 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:10.093156 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.106985 32064 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.047690 31874 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.111779 30860 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:10.112322 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:10.114238 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 132703us
I20260709 12:22:10.115429 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:10.075691 31839 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.118460 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:10.119194 31505 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:10.119831 31962 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.124859 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:10.043061 32020 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:22:10.130638 30750 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:10.129341 31794 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.129490 32003 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.134869 30860 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:10.136179 32096 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:22:10.149088 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:10.150243 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.145517 31794 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.153059 31505 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:10.155540 32102 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:10.157879 31963 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:10.159776 32051 consensus_meta.cc:287] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.003s
I20260709 12:22:10.115592 32092 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:10.113385 32103 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.128628 32072 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:10.163780 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:10.145799 32050 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:10.149291 31893 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.110045 31931 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.058282 32027 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:10.165778 31794 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.170110 30935 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:22:10.170687 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.180390 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.166008 32040 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:10.432303 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:10.359926 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 181097us
I20260709 12:22:10.433938 32100 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.176971 32051 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.214365 32010 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.178892 32050 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.155573 31790 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.270030 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.174891 32092 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:10.241916 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.257135 31810 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.084268 30853 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:10.276378 32112 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:22:10.181360 32003 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:10.164105 31874 consensus_queue.cc:1059] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:22:10.177111 32102 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:10.431511 31962 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:10.438902 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 259397us
I20260709 12:22:10.432160 32027 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.429423 31947 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.431645 31931 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.448387 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:10.449841 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 838) took 1030 ms. Trace:
I20260709 12:22:10.438536 32072 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:10.437512 32076 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.468763 30857 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:10.447281 32040 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.481171 30784 rpcz_store.cc:276] 0709 12:22:09.419892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.420122 (+   230us) service_pool.cc:224] Handling call
0709 12:22:10.180241 (+760119us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:10.449745 (+269504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16134016}
I20260709 12:22:10.447170 32055 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:22:10.485507 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.488826 30929 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:10.475158 32018 raft_consensus.cc:3055] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:10.492252 30856 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.494045 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.496284 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.487144 30931 raft_consensus.cc:2393] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:10.486538 30926 raft_consensus.cc:2368] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:10.477871 32003 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:10.473829 31826 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:10.501859 30858 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:10.488248 30851 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.509588 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.489944 32040 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.501197 32113 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.514484 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:10.516490 32016 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:10.494709 32108 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:10.489881 32018 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:10.476354 32010 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.557621 32010 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.521584 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 44) took 1040 ms. Trace:
I20260709 12:22:10.524063 31839 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:10.526182 32110 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:22:10.526886 32003 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.521245 31826 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.530061 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.532675 30678 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48042 (request call id 175) took 5515 ms. Trace:
I20260709 12:22:10.534868 31810 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.538690 31790 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.539778 32051 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.542163 32116 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.543409 32072 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.470284 32100 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.551028 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.553835 31794 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:10.550868 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.558815 30934 rpcz_store.cc:276] 0709 12:22:09.480853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.481185 (+   332us) service_pool.cc:224] Handling call
0709 12:22:09.498005 (+ 16820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.536666 (+ 38661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:09.536696 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:09.541123 (+  4427us) log.cc:844] Serialized 26 byte log entry
0709 12:22:10.118478 (+577355us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b18002726e0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf0d1 00007f96109daa0f
0709 12:22:10.174701 (+ 56223us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:10.175071 (+   370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.175132 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:10.506481 (+331349us) raft_consensus.cc:1685] finished
0709 12:22:10.506501 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.521483 (+ 14982us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36376,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4823,"spinlock_wait_cycles":19061632,"thread_start_us":94014,"threads_started":2,"wal-append.queue_time_us":633976}
I20260709 12:22:10.550711 32108 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:10.650597 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 67885.6us
I20260709 12:22:10.651894 30860 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:10.653048 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.654310 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.655416 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.548277 32113 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.664126 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.668071 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.650790 32064 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.714679 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:10.675956 32111 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.078s	user 0.003s	sys 0.000s
I20260709 12:22:10.681421 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.654985 32108 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.651309 32038 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:22:10.507774 32092 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.662616 31874 consensus_queue.cc:1059] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:22:10.655524 32018 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.658831 31790 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.572253 31839 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:10.569377 30678 rpcz_store.cc:276] 0709 12:22:05.017020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:05.017653 (+   633us) service_pool.cc:224] Handling call
0709 12:22:06.213255 (+1195602us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610989090 00007f9610a27f3a 00007f96167dde9c 00007f96168dc04e 00007f9614d9d2a4 00007f9614d9d232 00007f9614d9d161 00007f9614d9d0dc 00007f9614d9c392 00007f960ed5a48c 00007f960ed598c6
0709 12:22:10.532578 (+4319323us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:07.670928 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:07.680329 (+  9401us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:07.680366 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:22:07.680385 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:07.680930 (+   545us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:07.680978 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:07.681004 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:22:07.681332 (+   328us) tablet.cc:701] Row locks acquired
0709 12:22:07.681348 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:22:07.681483 (+   135us) write_op.cc:270] Start()
0709 12:22:07.681588 (+   105us) write_op.cc:276] Timestamp: P: 1783599727681440 usec, L: 0
0709 12:22:07.681609 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:22:07.896267 (+214658us) log.cc:844] Serialized 1306 byte log entry
0709 12:22:08.484252 (+587985us) op_driver.cc:464] REPLICATION: finished
0709 12:22:08.500799 (+ 16547us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1ae28 00007f9614455581 00007f9614454d58 00007f96144599f1 00007f96144599a9 00007f9614459939 00007f9614459901 00007f9614458b2d 0000000000388634 0000000000388479
0709 12:22:08.866511 (+365712us) write_op.cc:301] APPLY: starting
0709 12:22:08.866641 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:08.866831 (+   190us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:08.866865 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:08.867703 (+   838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:08.867942 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:22:08.868013 (+    71us) write_op.cc:312] APPLY: finished
0709 12:22:08.868325 (+   312us) log.cc:844] Serialized 34 byte log entry
0709 12:22:08.892163 (+ 23838us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:08.900423 (+  8260us) write_op.cc:454] Released schema lock
0709 12:22:08.906032 (+  5609us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:08.993698 (+ 87666us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:08.996319 (+  2621us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":220051,"reported_tablets":6,"spinlock_wait_cycles":2717904128,"child_traces":[["op",{"apply.queue_time_us":381950,"apply.run_cpu_time_us":2968,"apply.run_wall_time_us":108813,"num_ops":3,"prepare.queue_time_us":616334,"prepare.run_cpu_time_us":20927,"prepare.run_wall_time_us":836969,"replication_time_us":802470,"spinlock_wait_cycles":60366080,"thread_start_us":394155,"threads_started":1}]]}
I20260709 12:22:10.661172 32051 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.586187 32116 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.742646 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.749056 30851 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:10.742163 31947 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.737586 32005 consensus_queue.cc:1059] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:22:10.781235 30859 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:10.752568 32076 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.745414 32051 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:10.786725 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 116543us
I20260709 12:22:10.783996 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.744168 31790 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.792366 31790 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.721182 32064 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:10.794667 30859 raft_consensus.cc:2368] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 4.
I20260709 12:22:10.797698 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1029) took 1247 ms. Trace:
I20260709 12:22:10.798409 30858 rpcz_store.cc:276] 0709 12:22:09.550315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.081545 (+531230us) service_pool.cc:224] Handling call
0709 12:22:10.111434 (+ 29889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.505371 (+393937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.797269 (+291898us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54003273d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:10.797516 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897244928}
I20260709 12:22:10.804095 30825 leader_election.cc:400] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:10.804486 30825 leader_election.cc:403] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:22:10.805564 30860 raft_consensus.cc:2410] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:10.796774 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:10.808346 31987 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.797448 32113 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.810555 31794 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:10.817638 32003 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:10.837391 31947 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:10.838202 32003 raft_consensus.cc:697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:10.838315 31947 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.839395 32003 consensus_queue.cc:237] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.813427 32072 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:10.797449 32100 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.805491 31826 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:10.801429 32038 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:22:10.814976 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.817858 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1020) took 1453 ms. Trace:
I20260709 12:22:10.855135 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.857787 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.862064 31947 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.862327 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.864787 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.865464 31826 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:10.866080 31826 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.870529 30933 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.870548 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.821817 31987 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.872910 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.873522 30933 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.873646 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.876430 31987 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.880007 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.882016 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.880076 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.880982 30934 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.882901 30935 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:10.883069 30929 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.883858 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.885031 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.885574 32116 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.886219 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.886332 30926 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.886941 30932 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:10.875772 31833 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:10.887501 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:10.854964 32102 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.889097 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:10.889783 30780 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:10.891268 30930 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.892506 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.893342 30928 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:10.894238 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:10.895023 30931 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:10.881067 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.881356 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1028) took 1380 ms. Trace:
I20260709 12:22:10.885588 30934 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:10.899169 30935 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:10.901283 30929 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:10.898150 30855 rpcz_store.cc:276] 0709 12:22:09.500888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.026307 (+525419us) service_pool.cc:224] Handling call
0709 12:22:10.030993 (+  4686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.102503 (+ 71510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.881089 (+778586us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b5400075b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:10.881297 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162724736}
W20260709 12:22:10.904192 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 85502.8us
I20260709 12:22:10.905965 30784 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.909081 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.910202 30783 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.915068 30784 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.913352 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.876452 31826 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:10.941748 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:10.941985 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.942644 30784 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:10.918095 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:10.950403 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:10.939013 30680 catalog_manager.cc:5697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.941447 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:10.933411 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:10.945675 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:10.947475 30825 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:10.918390 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1033) took 1086 ms. Trace:
I20260709 12:22:10.950749 30783 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:10.952447 30680 catalog_manager.cc:5697] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.954397 30856 rpcz_store.cc:276] 0709 12:22:09.831650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.098110 (+266460us) service_pool.cc:224] Handling call
0709 12:22:10.098421 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.492818 (+394397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.918097 (+425279us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54003a89d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:10.918307 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905136896}
I20260709 12:22:10.908128 31839 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.939404 32051 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:10.953543 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.960441 31477 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:10.852401 30853 rpcz_store.cc:276] 0709 12:22:09.364429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.450517 (+ 86088us) service_pool.cc:224] Handling call
0709 12:22:10.073136 (+622619us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:10.073364 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:10.073600 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:10.675378 (+601778us) log.cc:844] Serialized 14 byte log entry
0709 12:22:10.794691 (+119313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:10.795679 (+   988us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:10.797919 (+  2240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:10.804592 (+  6673us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:10.814345 (+  9753us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":596,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":9866,"spinlock_wait_cycles":3160960,"thread_start_us":110039,"threads_started":1,"wal-append.queue_time_us":123503}
I20260709 12:22:10.961093 32040 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:10.961943 31477 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:10.962191 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.962828 30853 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:10.963241 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:10.960498 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.956125 30933 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:10.956563 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:10.960392 30680 catalog_manager.cc:5697] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.956418 30934 raft_consensus.cc:2410] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:10.966145 30825 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:10.966219 30680 catalog_manager.cc:5697] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.967728 30680 catalog_manager.cc:5697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.967818 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.969712 30856 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:10.970763 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.970634 30680 catalog_manager.cc:5697] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 2 to 3, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 3 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:10.972831 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:10.972924 30680 catalog_manager.cc:5697] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:10.975811 30855 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:10.970686 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:10.963701 32040 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:10.981139 30855 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:10.963752 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:10.979468 30825 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:10.964282 32072 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.957309 32038 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:10.951517 32134 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:10.985302 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:10.981905 31790 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:10.977216 32102 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.968860 32100 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:22:10.982967 32130 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.989120 30855 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:10.981693 32121 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:10.968704 31947 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:22:10.984143 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:10.982043 32064 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:10.978009 32132 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:10.986505 32072 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.042963 32072 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:10.990798 31826 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:10.969607 32050 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.000190 30783 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:10.984586 32051 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:11.000342 30855 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:11.049292 30855 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:10.978397 31839 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:22:10.992210 32104 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:10.991042 32038 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.000425 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:10.997941 31790 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.002678 32040 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.059352 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1018) took 1695 ms. Trace:
I20260709 12:22:11.062460 30854 rpcz_store.cc:276] 0709 12:22:09.364050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.442792 (+ 78742us) service_pool.cc:224] Handling call
0709 12:22:09.443117 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:09.727518 (+284401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.059074 (+1331556us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540015c554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:11.059288 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632234240}
I20260709 12:22:11.067703 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:11.069012 30785 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:11.070215 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:11.070978 30859 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:11.072091 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:10.994587 32134 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:11.058120 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 57774.1us
I20260709 12:22:11.078372 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:11.083837 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:11.055809 32104 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.090384 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:11.091395 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.082366 32120 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:11.092244 32120 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:11.094205 30853 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:11.084625 32143 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:11.095459 32143 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:11.095845 32143 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:11.052067 31826 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.098935 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1027) took 1608 ms. Trace:
I20260709 12:22:11.088394 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:11.062120 31790 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:11.061074 32038 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:11.089336 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 87568.3us
W20260709 12:22:11.100569 32136 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 12:22:11.084057 32126 log.cc:927] Time spent T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:22:11.051403 32064 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:22:11.099387 30857 rpcz_store.cc:276] 0709 12:22:09.490673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.030442 (+539769us) service_pool.cc:224] Handling call
0709 12:22:10.065368 (+ 34926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.486123 (+420755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.098669 (+612546us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540012f554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:11.098874 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926931712}
I20260709 12:22:11.128764 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:11.099798 32104 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.144843 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:11.074961 32051 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.147311 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:11.149920 32101 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.141108 32113 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:11.149446 32080 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:11.134781 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 170592us
W20260709 12:22:11.151587 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 48110.3us
I20260709 12:22:11.154721 32072 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:11.155601 32138 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:22:11.157228 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:11.141364 32069 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:22:11.160792 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:11.152446 32113 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.173554 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:11.162263 32137 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:22:11.162170 32125 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:22:11.177866 30856 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.170810 32027 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:11.161381 32142 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:11.178190 32003 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.168143 31874 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:11.183000 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.183905 32120 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:11.168474 32121 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:11.186902 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:11.173219 32080 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:11.177317 32113 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:11.186275 32003 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.196079 32003 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.200325 32080 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.205739 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:11.206949 32080 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:11.207633 32080 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:11.208266 32080 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:11.189280 32121 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.217226 32134 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.220446 32131 consensus_queue.cc:1059] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:22:11.220557 32108 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.221879 30778 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:11.221989 32131 raft_consensus.cc:3055] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.222496 32131 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:11.223740 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:11.213312 32101 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:11.214305 30780 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:11.214268 32121 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.258203 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:11.214659 32143 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.359051 32143 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.262493 31790 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.252038 32003 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.362991 31790 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.363530 32003 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.217262 32150 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:22:11.230726 32134 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 12:22:11.389389 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 212012us
I20260709 12:22:11.364838 32051 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.392784 32108 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.406594 32129 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:11.408468 32129 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.409013 32129 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:11.335953 32131 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.412534 32080 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:11.412339 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:11.234768 32101 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.404968 32072 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.410161 32129 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:11.428052 32151 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.282s	user 0.006s	sys 0.000s
I20260709 12:22:11.424258 31987 consensus_queue.cc:1059] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:22:11.261605 32038 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.435956 32123 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:22:11.436069 32157 consensus_queue.cc:1059] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:11.439575 32157 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.436779 31987 consensus_queue.cc:1059] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:22:11.443670 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:11.445911 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:11.448859 30777 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:11.448683 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:11.435020 32108 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:11.449244 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:11.450244 30935 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:11.440582 32157 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:11.454452 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:11.454514 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:11.452137 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:11.456051 30935 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:11.456472 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:11.457226 30933 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:11.458796 30933 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:11.453572 31509 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.466689 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:11.439900 32129 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.445200 32132 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:11.464318 30933 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:11.453795 32108 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:11.477291 30935 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:11.467751 32072 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.449870 32123 consensus_queue.cc:1059] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:22:11.485163 30928 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:11.487493 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:11.472682 32150 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.472663 32132 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:11.469123 32003 consensus_queue.cc:1059] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:22:11.527190 30781 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:11.519630 32150 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:11.537853 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:11.538127 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:11.550513 31893 raft_consensus.cc:3055] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:11.551152 31893 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:11.552282 31893 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.554559 31509 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:11.519375 32157 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.558748 32157 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:11.530654 32101 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:11.493109 32072 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:11.538853 30776 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:11.570322 32132 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:11.581409 32132 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:11.588083 30859 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:11.561383 32108 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.788590 32051 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.822880 32051 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.827378 31931 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.867280 31931 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.804687 32038 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.827194 32100 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:11.827004 31790 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:11.826535 32051 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.904145 31931 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.903895 32100 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.904897 31790 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:11.906404 32100 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.907245 31790 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:11.888154 32108 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:11.983443 32016 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:12.003718 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.016s	sys 0.094s
W20260709 12:22:12.004256 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.016s	sys 0.094s
W20260709 12:22:12.004962 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:11.984771 32104 consensus_meta.cc:287] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.833s	user 0.013s	sys 0.001s
I20260709 12:22:11.998369 32016 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.049474 32095 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:12.050361 32095 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:12.054382 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.050395 32158 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:22:12.031560 32104 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.054237 32072 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:12.058624 32121 consensus_meta.cc:287] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.805s	user 0.012s	sys 0.001s
I20260709 12:22:12.078248 32092 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:12.056813 30749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.014s
W20260709 12:22:12.079926 30749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.014s
I20260709 12:22:12.053535 32095 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:12.095680 30932 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.017s	sys 0.048s
W20260709 12:22:12.136406 30932 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.018s	sys 0.048s
W20260709 12:22:12.094420 30856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.020s
W20260709 12:22:12.137055 30856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.007s	sys 0.020s
W20260709 12:22:12.165823 30930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.030s
W20260709 12:22:12.166318 30930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.008s	sys 0.030s
W20260709 12:22:12.168568 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 198994us
I20260709 12:22:12.137853 32162 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:12.171509 30747 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.043s
W20260709 12:22:12.139449 32003 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.008s	sys 0.025s
I20260709 12:22:12.082789 32121 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:12.143543 30853 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.013s	sys 0.017s
W20260709 12:22:12.175518 30747 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.000s	sys 0.043s
W20260709 12:22:12.175391 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.175717 30900 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.719s (SENT)
W20260709 12:22:12.195431 30899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.007s	sys 0.046s
I20260709 12:22:12.202150 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:12.202551 30899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.007s	sys 0.046s
W20260709 12:22:12.206086 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 675718us
W20260709 12:22:12.195851 32003 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.009s	sys 0.026s
W20260709 12:22:12.212216 30900 leader_election.cc:336] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.721s (SENT)
I20260709 12:22:12.212857 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:12.173671 32123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.012s	sys 0.039s
W20260709 12:22:12.202493 30853 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.014s	sys 0.017s
W20260709 12:22:12.228451 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.753s (SENT) [suppressed 12 similar messages]
W20260709 12:22:12.235018 30860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 859) took 1562 ms (client timeout 1588 ms). Trace:
W20260709 12:22:12.235642 30860 rpcz_store.cc:269] 0709 12:22:10.672508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.732294 (+ 59786us) service_pool.cc:224] Handling call
0709 12:22:12.234638 (+1502344us) spinlock_profiling.cc:243] Waited 61.8 ms on lock 0x7b5400436cd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:12.234924 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142056832}
I20260709 12:22:12.236618 30855 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:22:12.237181 30855 pending_rounds.cc:85] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 4
I20260709 12:22:12.237538 30855 pending_rounds.cc:107] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:22:12.238052 30855 raft_consensus.cc:2889] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:12.240496 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 914) took 1362 ms. Trace:
I20260709 12:22:12.243507 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 849) took 1176 ms. Trace:
I20260709 12:22:12.241119 30781 rpcz_store.cc:276] 0709 12:22:10.878100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.878244 (+   144us) service_pool.cc:224] Handling call
0709 12:22:10.886492 (+  8248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:11.527775 (+641283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.240117 (+712342us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54003b42d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:12.240399 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472900992}
I20260709 12:22:12.245311 30777 rpcz_store.cc:276] 0709 12:22:11.066980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.067464 (+   484us) service_pool.cc:224] Handling call
0709 12:22:12.243201 (+1175737us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400296654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:12.243415 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856836480}
W20260709 12:22:12.233234 32123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.013s	sys 0.039s
I20260709 12:22:12.204413 32162 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.250177 32171 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.269306 32153 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.284925 32169 consensus_queue.cc:1059] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:22:12.286010 32145 log.cc:927] Time spent T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.145s	user 0.022s	sys 0.010s
I20260709 12:22:12.308547 32142 raft_consensus.cc:3055] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:22:12.309042 32157 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.750s	user 0.005s	sys 0.009s
W20260709 12:22:12.342063 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.289201 32016 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:12.328533 32142 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:12.358044 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.351090 32113 consensus_meta.cc:287] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.147s	user 0.013s	sys 0.002s
I20260709 12:22:12.349152 32104 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.336438 32177 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:12.362387 32113 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.372987 32113 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.363221 32072 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.374214 32142 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.382784 32121 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:12.383590 32146 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.219s	user 0.024s	sys 0.031s
W20260709 12:22:12.384398 32129 consensus_meta.cc:287] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.912s	user 0.010s	sys 0.004s
I20260709 12:22:12.386422 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:12.387300 30858 raft_consensus.cc:2376] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
W20260709 12:22:12.387965 30858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 858) took 1715 ms (client timeout 1818 ms). Trace:
I20260709 12:22:12.391469 32104 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:12.392292 32104 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.395416 32104 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:12.388433 30858 rpcz_store.cc:269] 0709 12:22:10.672226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.800308 (+128082us) service_pool.cc:224] Handling call
0709 12:22:12.386207 (+1585899us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:12.387890 (+  1683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4801280}
I20260709 12:22:12.401912 32162 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:12.402082 32120 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:12.402719 32120 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.403275 32179 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:12.406046 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:12.406948 30854 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.416786 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:12.417487 30860 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.421588 31826 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:12.424523 32038 raft_consensus.cc:3055] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:12.425244 32038 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:12.428844 32120 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:12.429965 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.437323 30860 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:12.460297 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:12.461367 30860 raft_consensus.cc:2393] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:12.437613 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 33) took 1684 ms. Trace:
I20260709 12:22:12.462424 30855 rpcz_store.cc:276] 0709 12:22:10.756911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.052600 (+295689us) service_pool.cc:224] Handling call
0709 12:22:12.234862 (+1182262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.238633 (+  3771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.437290 (+198657us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400436cd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:12.437519 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2718239488}
I20260709 12:22:12.443188 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:12.466965 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:12.468125 30782 raft_consensus.cc:2393] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:12.468780 30782 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32970 (request call id 41) took 1524 ms (client timeout 2003 ms). Trace:
W20260709 12:22:12.469376 30782 rpcz_store.cc:269] 0709 12:22:10.944630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.945318 (+   688us) service_pool.cc:224] Handling call
0709 12:22:12.442976 (+1497658us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fae9c 00007f960d8faa5b 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:12.468697 (+ 25721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10582272}
I20260709 12:22:12.471836 30858 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:12.464236 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:12.476055 30855 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.451815 32016 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:12.368233 32177 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:12.480389 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:12.478086 32016 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:12.432299 32148 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.269s	user 0.006s	sys 0.028s
I20260709 12:22:12.483938 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:12.450521 32165 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.453948 32171 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.448804 32131 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.487710 32016 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:12.489598 32144 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 1.327s	user 0.016s	sys 0.066s
I20260709 12:22:12.494829 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:12.500602 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:12.502197 32064 consensus_queue.cc:1059] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:12.444200 32018 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.398129 32072 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.429737 32050 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.526290 30859 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:12.525002 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:12.534575 30858 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.511771 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:12.535971 30860 raft_consensus.cc:2393] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:12.543182 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 36) took 1098 ms. Trace:
I20260709 12:22:12.544227 30856 rpcz_store.cc:276] 0709 12:22:11.444565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.446084 (+  1519us) service_pool.cc:224] Handling call
0709 12:22:11.446456 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.446945 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.446988 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:11.454821 (+  7833us) log.cc:844] Serialized 26 byte log entry
0709 12:22:12.137526 (+682705us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:12.531813 (+394287us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.542690 (+ 10877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.542811 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.542872 (+    61us) raft_consensus.cc:1685] finished
0709 12:22:12.542893 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.543095 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10461,"raft.queue_time_us":1643,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":98,"thread_start_us":1047860,"threads_started":2,"wal-append.queue_time_us":858767}
I20260709 12:22:12.574975 31510 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.403838 32179 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.576228 32050 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:12.578231 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 77704us
W20260709 12:22:12.586202 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 334942us
I20260709 12:22:12.588472 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:12.576524 31510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 157) took 1769 ms. Trace:
I20260709 12:22:12.539063 32016 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.582409 31477 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:12.537971 32120 raft_consensus.cc:3055] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:12.592571 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:12.573872 31475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.020s	sys 0.020s
I20260709 12:22:12.550004 32064 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.589555 31510 rpcz_store.cc:276] 0709 12:22:10.807546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.808438 (+   892us) service_pool.cc:224] Handling call
0709 12:22:12.574645 (+1766207us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800023498. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8faf8c 00007f960d8faef6 000000000036eb39 00007f961596e1e0 00007f9615a370c4 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:12.574780 (+   135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.575542 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.576438 (+   896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2486656}
W20260709 12:22:12.581215 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 379640us
I20260709 12:22:12.525174 32165 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:12.607919 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 340264us
I20260709 12:22:12.575845 30860 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:12.595378 31475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.021s	sys 0.020s
I20260709 12:22:12.590405 32180 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:12.621031 31790 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.592320 32120 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:12.533870 32038 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.631345 32186 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:12.592898 32050 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.637347 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:12.594851 32016 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:22:12.650079 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 67759.6us
W20260709 12:22:12.651669 31987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.209s	user 0.015s	sys 0.012s
W20260709 12:22:12.652844 31987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.015s	sys 0.013s
I20260709 12:22:12.653869 31969 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:12.655184 31969 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:12.654872 31826 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:12.655717 31969 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:12.656854 31969 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:12.657548 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:12.659639 30900 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.818s (SENT)
I20260709 12:22:12.674903 30777 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:12.675388 30900 connection.cc:256] RPC call timeout handler was delayed by -1.257288645999779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 12:22:12.661180 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 37) took 1187 ms. Trace:
I20260709 12:22:12.659044 31969 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.660528 30858 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:12.605984 32064 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.629837 32177 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.629724 32130 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.677917 30777 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:12.677857 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:12.679437 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:12.678932 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:12.640049 31963 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.547933 32171 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.640321 31507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 158) took 1826 ms. Trace:
I20260709 12:22:12.687992 30779 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:12.643411 32038 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.688374 30783 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
W20260709 12:22:12.691895 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.695883 30935 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:12.696725 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.663842 32104 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.632042 32186 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.699841 30785 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:12.631927 32120 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.694072 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:12.694195 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:12.681077 32157 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.704226 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:12.718583 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:12.718840 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:12.684090 31987 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:12.721491 30785 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:12.701932 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:12.714674 30933 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:12.681612 32143 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.670574 32165 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:12.706763 30899 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:12.690542 32040 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:12.686544 32114 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:12.755303 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.690397 31874 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:12.695551 32085 consensus_queue.cc:1059] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:22:12.790979 30899 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:12.805615 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 213016us
I20260709 12:22:12.686355 32187 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:12.798625 30854 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:12.664404 32180 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.802398 32072 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.807260 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:12.816074 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:12.699287 31963 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.823016 30826 leader_election.cc:400] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:12.724735 32204 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:12.831890 30826 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:12.714501 32188 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 12:22:12.829314 32189 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:12.830436 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 110903us
I20260709 12:22:12.710568 32130 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:12.843063 30900 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.504s (SENT)
W20260709 12:22:12.841049 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 109628us
I20260709 12:22:12.850211 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:12.846609 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:12.854732 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.819700 32120 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:12.803455 32050 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.727697 31987 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.831779 32095 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.796487 32040 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.858695 32192 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.783946 32143 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.837147 32072 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:12.840433 32157 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:12.845381 32076 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.838842 32129 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:12.809135 31874 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.867440 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:12.883535 30781 raft_consensus.cc:2410] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:12.856163 32123 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:12.832965 32187 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.908704 32187 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.866539 32121 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.912268 30782 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:12.914740 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:12.924145 30855 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:12.830533 32114 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.940860 32114 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:12.941864 30927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "047196043bb744a6b94cb3b634b80771"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "7857bffc34ce4e1db3617488701b9810"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:12.942971 32040 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.943192 30927 raft_consensus.cc:606] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Received request to transfer leadership to TS 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:12.945374 30927 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:12.872344 32050 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:22:12.856643 32204 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:12.959506 32064 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.959685 32173 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:12.990269 32173 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:12.971079 32092 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.892s	user 0.007s	sys 0.007s
I20260709 12:22:12.886824 32129 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.961091 31987 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.912068 32095 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:12.886811 32189 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:22:12.933267 32165 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:12.877976 32157 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.957557 32101 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:12.927834 31790 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:12.929945 32179 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:12.992666 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:12.969746 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:12.956472 32114 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:22:12.947702 32121 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.890976 32192 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:12.962492 32164 consensus_queue.cc:1059] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 12:22:12.926604 32123 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:13.181866 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.208190 30779 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:13.130838 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.003262 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.218593 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:12.697829 31507 rpcz_store.cc:276] 0709 12:22:10.807886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.808965 (+  1079us) service_pool.cc:224] Handling call
0709 12:22:10.809330 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.856964 (+ 47634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.857003 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.968222 (+111219us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.143659 (+175437us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:11.146200 (+  2541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.151031 (+  4831us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.488807 (+1337776us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:12.605185 (+116378us) raft_consensus.cc:1685] finished
0709 12:22:12.610076 (+  4891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.634584 (+ 24508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1340,"raft.queue_time_us":65696,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":32943360,"thread_start_us":152312,"threads_started":2,"wal-append.queue_time_us":179272}
I20260709 12:22:13.218641 30933 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:13.224288 30852 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:13.227550 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:13.228220 30859 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:13.228456 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.072908 32183 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 12:22:13.072973 32191 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 12:22:13.135874 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 292826us
I20260709 12:22:13.063545 30926 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:13.243569 30855 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:13.206646 31999 raft_consensus.cc:3055] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:13.010154 31874 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:13.016844 32159 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:13.104045 32171 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:13.019731 32132 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:13.249481 32149 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 2.100s	user 0.022s	sys 0.042s
I20260709 12:22:12.683123 30853 rpcz_store.cc:276] 0709 12:22:11.473444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.474049 (+   605us) service_pool.cc:224] Handling call
0709 12:22:11.485378 (+ 11329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.485869 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.485912 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:11.540582 (+ 54670us) log.cc:844] Serialized 26 byte log entry
0709 12:22:12.250250 (+709668us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:12.658289 (+408039us) log.cc:844] Serialized 14 byte log entry
0709 12:22:12.660679 (+  2390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:12.660784 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:12.660856 (+    72us) raft_consensus.cc:1685] finished
0709 12:22:12.660877 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:12.661087 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":461171,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":576,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":31093,"thread_start_us":992502,"threads_started":2,"wal-append.queue_time_us":695607}
I20260709 12:22:13.115674 32180 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:13.251855 30900 leader_election.cc:336] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.524s (SENT)
W20260709 12:22:13.284219 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.284476 30900 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:13.001863 32190 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.015681 32095 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:13.255394 30934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.006s	sys 0.010s
I20260709 12:22:13.029191 30785 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
W20260709 12:22:13.300733 30934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.010s	sys 0.010s
I20260709 12:22:13.257299 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.214425 32165 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.264081 30854 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:13.214989 32005 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.309651 32005 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.311750 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.113858 32204 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.225044 31962 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.279050 30859 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:13.190357 32211 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.215251 32101 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:13.330230 32101 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:13.286504 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.287147 30900 leader_election.cc:336] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.567s (SENT)
I20260709 12:22:13.332710 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:13.237067 31969 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:13.302237 30855 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:13.130293 32196 consensus_queue.cc:1059] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.120s
W20260709 12:22:13.265242 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.263772 31999 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.285648 32171 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.063877 32130 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.279415 32143 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.282392 32040 raft_consensus.cc:3055] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:13.320914 32121 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.328141 30825 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:13.281414 32132 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.329525 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.293941 31963 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:13.331116 32123 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:13.341857 30777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.016s
I20260709 12:22:13.273409 31810 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:22:13.292871 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:13.353435 30927 raft_consensus.cc:1240] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:13.347517 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 60427.1us
I20260709 12:22:13.352016 32085 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:13.352535 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 456145us
I20260709 12:22:13.397112 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:13.395042 31999 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:13.398720 32212 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:22:13.399016 31999 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:13.333461 32131 consensus_meta.cc:287] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.805s	user 0.013s	sys 0.000s
I20260709 12:22:13.403671 32108 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.404209 32108 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.364670 30779 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:13.345675 31969 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.405956 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:13.406085 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.406535 30779 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.292373 32186 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:13.136200 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 339345us
I20260709 12:22:13.407874 31969 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:13.408929 31505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 156) took 2601 ms. Trace:
I20260709 12:22:13.283536 32159 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.304382 32188 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:13.372493 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 44439.6us
I20260709 12:22:13.346810 32211 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:13.366051 32040 raft_consensus.cc:740] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.379372 32129 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.336653 31962 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.383397 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:13.385578 30777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.007s	sys 0.016s
I20260709 12:22:13.279057 32055 consensus_queue.cc:1059] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 12:22:13.392943 30900 leader_election.cc:336] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.591s (SENT)
I20260709 12:22:13.402130 30851 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.402873 32182 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.402912 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.408818 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:13.378186 32215 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:13.379892 32104 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.014400 32173 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.396912 32123 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:13.438309 30825 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:13.412883 31506 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:13.316715 32190 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:13.425048 30900 leader_election.cc:336] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.966s (SENT)
I20260709 12:22:13.436133 32215 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.427321 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.446326 30785 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:13.428195 32095 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.448511 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.430352 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:13.435202 31509 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:13.435371 32157 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.313920 32165 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.463908 30779 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:13.412664 32040 consensus_queue.cc:260] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.443089 32055 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:13.415035 32188 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.412549 32159 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.431978 32192 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.456418 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.499395 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.500285 30779 raft_consensus.cc:2410] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:13.500437 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.482683 30825 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:13.440796 32104 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:13.439569 32211 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:13.505559 30926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "7857bffc34ce4e1db3617488701b9810"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:13.505847 32150 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.506304 30926 raft_consensus.cc:606] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Received request to transfer leadership to TS 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:13.509981 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.510717 30859 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:13.511049 30785 raft_consensus.cc:2393] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:13.511343 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.511940 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.516064 30855 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:13.503612 32055 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:13.518872 32055 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.519855 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1087) took 2076 ms. Trace:
I20260709 12:22:13.520249 30934 rpcz_store.cc:276] 0709 12:22:11.443892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:11.444044 (+   152us) service_pool.cc:224] Handling call
0709 12:22:11.444368 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:11.447550 (+  3182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:11.447580 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:11.448036 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:22:12.502767 (+1054731us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18002ab920. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf0d1 00007f96109daa0f
0709 12:22:13.301391 (+798624us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:13.301453 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.301580 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.519541 (+217961us) raft_consensus.cc:1685] finished
0709 12:22:13.519562 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.519769 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4737,"spinlock_wait_cycles":5769472,"thread_start_us":798416,"threads_started":1,"wal-append.queue_time_us":1976736}
I20260709 12:22:13.522778 32095 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.525790 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.524595 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.527348 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.528332 30933 raft_consensus.cc:2393] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:13.524536 32168 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:22:13.530157 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.531862 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.532790 30933 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:13.533185 31476 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:13.524869 32095 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:13.477696 32113 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:22:13.536795 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.544052 32190 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:13.547449 32142 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.444805 32123 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.538385 30859 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:13.542893 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.553047 30858 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:13.555410 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.554834 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.563768 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:13.551115 32120 consensus_meta.cc:287] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.003s
I20260709 12:22:13.570538 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.573355 30855 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:13.575151 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.577484 30859 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:13.577883 30860 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:13.582979 30785 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:13.583559 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.584553 30933 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:13.557608 32159 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:13.586465 30826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.026s	sys 0.081s
I20260709 12:22:13.559827 32157 raft_consensus.cc:3055] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:13.601584 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.561283 32190 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:13.630414 30826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.026s	sys 0.081s
W20260709 12:22:13.634012 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 800477us
I20260709 12:22:13.562531 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:13.632016 32038 consensus_meta.cc:287] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.002s
I20260709 12:22:13.453964 32121 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:13.588342 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.674170 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.635903 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:13.739754 30858 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
W20260709 12:22:13.740304 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 104450us
I20260709 12:22:13.739956 30933 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
W20260709 12:22:13.737620 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.738360 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:13.688578 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:13.683154 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.742494 30779 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:13.743007 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 940) took 1023 ms. Trace:
I20260709 12:22:13.743253 30779 rpcz_store.cc:276] 0709 12:22:12.719192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.625918 (+906726us) service_pool.cc:224] Handling call
0709 12:22:13.742962 (+117044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:13.743678 32123 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:13.746061 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:13.746745 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:13.744320 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.772055 30779 raft_consensus.cc:2410] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:13.772217 32211 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:13.587407 32104 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.705171 32120 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:22:13.703873 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.773701 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.774084 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:13.638564 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:13.775744 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.587909 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 74580.2us
I20260709 12:22:13.771001 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 49) took 1290 ms. Trace:
I20260709 12:22:13.633015 32157 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.778882 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:13.673220 31477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.059s	sys 0.092s
I20260709 12:22:13.640578 32190 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:13.773129 31810 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:13.785187 30934 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:13.789866 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:13.795938 30934 raft_consensus.cc:606] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Received request to transfer leadership to TS 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:13.675634 31947 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 12:22:13.794754 32211 raft_consensus.cc:993] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: : Instructing follower 7857bffc34ce4e1db3617488701b9810 to start an election
I20260709 12:22:13.745049 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 867) took 1063 ms. Trace:
I20260709 12:22:13.776922 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:13.772622 32095 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.784699 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:13.789605 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:13.814868 31510 raft_consensus.cc:2393] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 2: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:13.790594 32114 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:13.796754 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:13.789374 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:13.790738 32177 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:13.791254 32157 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.740549 32064 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:13.792904 31477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.062s	sys 0.099s
I20260709 12:22:13.808772 30851 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:13.785136 32213 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:13.786041 30931 rpcz_store.cc:276] 0709 12:22:12.454991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.467643 (+ 12652us) service_pool.cc:224] Handling call
0709 12:22:12.540130 (+ 72487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.580082 (+ 39952us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:12.615581 (+ 35499us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.311506 (+695925us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b18001aad60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf23a 00007f9610a29a2a
0709 12:22:13.626409 (+314903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:13.633733 (+  7324us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:13.637631 (+  3898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.703415 (+ 65784us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.744957 (+ 41542us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21282,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":109,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":99451,"spinlock_wait_cycles":11059584,"thread_start_us":269893,"threads_started":1}
I20260709 12:22:13.795322 32190 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.786572 32150 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:13.784410 32217 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:13.843901 32215 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:13.817162 31833 raft_consensus.cc:1081] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Signalling peer 7857bffc34ce4e1db3617488701b9810 to start an election
I20260709 12:22:13.783926 32121 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.792706 31507 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
W20260709 12:22:13.847263 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.786568 32092 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.409469 31505 rpcz_store.cc:276] 0709 12:22:10.807131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.809108 (+  1977us) service_pool.cc:224] Handling call
0709 12:22:10.809491 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:10.936541 (+127050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:10.936595 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:10.985806 (+ 49211us) log.cc:844] Serialized 26 byte log entry
0709 12:22:11.134471 (+148665us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:11.134527 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:11.134611 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.207311 (+2072700us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:13.396194 (+188883us) raft_consensus.cc:1685] finished
0709 12:22:13.400751 (+  4557us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.408813 (+  8062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1208,"raft.queue_time_us":65696,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"spinlock_wait_cycles":15338880,"thread_start_us":196899,"threads_started":2,"wal-append.queue_time_us":95884}
I20260709 12:22:13.847730 32211 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:22:13.817514 32186 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:13.878329 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 62561.2us
I20260709 12:22:13.903009 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:13.904490 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:13.824653 32171 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:13.882964 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 928) took 1184 ms. Trace:
W20260709 12:22:13.883389 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:13.912930 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:13.884349 32217 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:13.886232 32101 consensus_meta.cc:287] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.005s
I20260709 12:22:13.884271 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:13.783806 32208 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 12:22:13.890667 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 871) took 1210 ms. Trace:
I20260709 12:22:13.890833 32092 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:13.806568 30780 rpcz_store.cc:276] 0709 12:22:12.677112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.681510 (+  4398us) service_pool.cc:224] Handling call
0709 12:22:12.721708 (+ 40198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.798865 (+ 77157us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:13.190175 (+391310us) log.cc:844] Serialized 14 byte log entry
0709 12:22:13.586571 (+396396us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:13.629312 (+ 42741us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:13.633038 (+  3726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.674883 (+ 41845us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.737801 (+ 62918us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62518,"prepare.queue_time_us":636471,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":6444,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6463,"thread_start_us":675792,"threads_started":2}
I20260709 12:22:13.899304 32121 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.934887 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.935767 30780 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:13.901268 32215 raft_consensus.cc:1064] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:22:13.901721 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.939862 30785 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:13.940558 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 939) took 1229 ms. Trace:
I20260709 12:22:13.918087 32217 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:13.848248 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 1.04681e+06us
I20260709 12:22:13.855355 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.945611 30779 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:13.854374 32120 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.911083 30777 rpcz_store.cc:276] 0709 12:22:12.698333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.700852 (+  2519us) service_pool.cc:224] Handling call
0709 12:22:12.701180 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.718518 (+ 17338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.718564 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.726204 (+  7640us) log.cc:844] Serialized 26 byte log entry
0709 12:22:13.419724 (+693520us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:13.419769 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.419834 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.882658 (+462824us) raft_consensus.cc:1685] finished
0709 12:22:13.882686 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.882850 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47060,"raft.queue_time_us":21896,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":60232,"thread_start_us":580252,"threads_started":1,"wal-append.queue_time_us":746400}
I20260709 12:22:13.949268 30777 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:13.877938 32150 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:13.920398 30784 rpcz_store.cc:276] 0709 12:22:12.680188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.680395 (+   207us) service_pool.cc:224] Handling call
0709 12:22:12.680866 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:12.699732 (+ 18866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:12.699766 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:12.714514 (+ 14748us) log.cc:844] Serialized 26 byte log entry
0709 12:22:13.312505 (+597991us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b1800146e60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf0d1 00007f96109daa0f
0709 12:22:13.386140 (+ 73635us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:13.386201 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.386302 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:13.889285 (+502983us) raft_consensus.cc:1685] finished
0709 12:22:13.889304 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.890597 (+  1293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88833,"raft.queue_time_us":32147,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":6466,"spinlock_wait_cycles":11199232,"thread_start_us":63381,"threads_started":1,"wal-append.queue_time_us":1162834}
I20260709 12:22:13.914893 31999 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.924612 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:13.917512 32143 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:13.910383 32171 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:13.956153 32171 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:13.940999 30785 rpcz_store.cc:276] 0709 12:22:12.710958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.901437 (+1190479us) service_pool.cc:224] Handling call
0709 12:22:13.940468 (+ 39031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:13.884984 31947 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:13.937029 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:13.952848 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 935) took 1243 ms. Trace:
I20260709 12:22:13.922535 32101 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.955456 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 944) took 1149 ms. Trace:
I20260709 12:22:13.882251 32213 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:13.938541 32186 raft_consensus.cc:697] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.954449 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:13.958374 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:13.941828 30776 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.018s	sys 0.026s
I20260709 12:22:13.958715 30777 rpcz_store.cc:276] 0709 12:22:12.709736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.948415 (+1238679us) service_pool.cc:224] Handling call
0709 12:22:13.948826 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.949725 (+   899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.952760 (+  3035us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:13.971503 31839 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.008s	sys 0.025s
W20260709 12:22:13.971901 31839 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.008s	sys 0.025s
I20260709 12:22:13.971974 30777 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:13.958985 30784 rpcz_store.cc:276] 0709 12:22:12.805676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.954518 (+1148842us) service_pool.cc:224] Handling call
0709 12:22:13.954849 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.955102 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:13.955129 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:13.955184 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:13.955215 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:13.955268 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:13.955404 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:13.932075 32177 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:22:13.974713 32177 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:13.974743 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:13.979030 32173 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:14.003159 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:14.003047 32092 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.003436 32186 consensus_queue.cc:237] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.004113 30930 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:13.966826 32159 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.006181 32159 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:14.006621 32159 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:13.962563 32114 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:14.007257 32114 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:14.008201 32114 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.009902 32177 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:13.966468 30776 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.019s	sys 0.026s
I20260709 12:22:13.958199 31999 raft_consensus.cc:697] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.959321 32143 raft_consensus.cc:697] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:13.956470 32215 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:14.021852 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:14.022631 31503 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686"
dest_uuid: "7857bffc34ce4e1db3617488701b9810"
 from {username='slave'} at 127.0.0.1:42840
I20260709 12:22:14.022946 32132 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:14.023492 31503 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:14.024104 31503 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.013484 32055 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.012821 32173 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:14.010448 32177 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:14.027285 32055 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:14.033380 31810 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:14.039252 32173 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.066483 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:14.068229 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.046396 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:14.098670 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 301975us
I20260709 12:22:14.099454 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:14.097612 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.119957 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.119875 30826 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:14.120466 30779 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:14.053467 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.091140 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 866) took 1390 ms. Trace:
I20260709 12:22:14.107152 32104 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:14.156332 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:14.157699 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:14.157804 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 149662us
I20260709 12:22:14.163349 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:14.166396 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:14.168815 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:14.117877 30926 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:14.169696 30930 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.181463 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.149402 32235 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:14.188364 30933 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:14.192986 32245 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:14.193791 32245 raft_consensus.cc:697] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:14.194869 32150 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:14.194756 32245 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.197265 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:14.197938 30858 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:14.188869 30851 raft_consensus.cc:2410] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:14.177110 32104 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:14.179879 32213 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:14.178963 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:14.231277 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 68026.1us
I20260709 12:22:14.106755 32143 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.124758 31999 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:14.236701 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:14.239077 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.154680 31810 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.247639 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.254136 30856 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:14.257701 32213 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:14.258888 32248 consensus_queue.cc:1059] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:14.244496 32121 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:14.275758 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.280040 30856 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
W20260709 12:22:14.281201 30900 leader_election.cc:336] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.588s (SENT)
I20260709 12:22:14.281745 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:14.244338 30853 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:14.235721 32217 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.291859 30858 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:14.292922 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.293589 30858 raft_consensus.cc:2393] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:14.296612 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:14.297555 30778 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 931) took 1589 ms (client timeout 1913 ms). Trace:
I20260709 12:22:14.286563 32256 raft_consensus.cc:3055] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:14.297899 30778 rpcz_store.cc:269] 0709 12:22:12.708606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.711448 (+  2842us) service_pool.cc:224] Handling call
0709 12:22:14.296418 (+1584970us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:14.297505 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7295360}
I20260709 12:22:14.269863 32177 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:14.284889 32230 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 12:22:14.301352 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.302237 32247 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:14.275287 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:14.283661 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:14.314545 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:14.318591 30858 raft_consensus.cc:2393] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:14.298985 32248 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:14.302242 32256 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:14.330202 30851 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:14.304111 32055 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:14.282172 32186 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:22:14.303200 32104 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:14.334157 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:14.146136 30776 rpcz_store.cc:276] 0709 12:22:12.676784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.683077 (+  6293us) service_pool.cc:224] Handling call
0709 12:22:12.797638 (+114561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.827477 (+ 29839us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:13.369781 (+542304us) log.cc:844] Serialized 14 byte log entry
0709 12:22:14.036800 (+667019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:14.040447 (+  3647us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:14.042207 (+  1760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.046568 (+  4361us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:14.066879 (+ 20311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3709,"prepare.queue_time_us":636876,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":9387,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":3050,"thread_start_us":1144615,"threads_started":2,"wal-append.queue_time_us":680875}
I20260709 12:22:14.335497 30930 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:14.335793 32170 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:14.373657 32170 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:14.374796 32142 consensus_meta.cc:287] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.827s	user 0.009s	sys 0.004s
W20260709 12:22:13.502955 32166 consensus_queue.cc:1175] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47c0d0bc235a443aad3c62643e91b081" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:22:14.335374 32240 log.cc:927] Time spent T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:22:14.381942 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:14.383045 31508 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
W20260709 12:22:14.388924 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.316521 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:14.350284 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:14.325356 32165 consensus_meta.cc:287] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.003s
I20260709 12:22:14.363478 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 862) took 1690 ms. Trace:
I20260709 12:22:14.365412 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.366503 31962 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:14.351135 32217 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:14.350582 31509 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.374848 32170 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.321190 32247 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:14.363510 32005 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:14.351029 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:14.376873 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.423282 30858 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:14.404845 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:14.406365 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:14.409446 30782 rpcz_store.cc:276] 0709 12:22:12.672967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.674215 (+  1248us) service_pool.cc:224] Handling call
0709 12:22:12.682072 (+  7857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:12.912660 (+230588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.354288 (+1441628us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003b42d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:14.363389 (+  9101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528557952}
I20260709 12:22:14.375980 32244 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:14.414494 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 171047us
I20260709 12:22:14.431478 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:14.433435 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:14.426645 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.412271 32234 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:14.420769 32190 consensus_meta.cc:287] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.538s	user 0.001s	sys 0.013s
I20260709 12:22:14.427542 30778 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:14.459051 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:14.442088 30782 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.461503 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:14.447353 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:14.448622 32170 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.429171 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.467836 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:14.414737 32165 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.464394 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:14.457099 30851 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:14.458014 32235 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.468199 30858 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:14.457737 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:14.466614 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:14.470935 30778 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.458362 32217 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:14.458937 32211 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.475242 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.475361 30784 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:14.418715 31476 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:14.478981 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:14.461148 32152 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.461337 32186 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:14.468989 30776 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.462483 32005 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.482858 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:14.470297 32177 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:14.518504 30777 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:14.460444 32234 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:14.474224 32121 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:14.461210 32190 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:14.528048 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:14.517017 32005 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:14.459910 32244 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.536517 32121 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:14.554719 32121 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:14.555446 32254 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:22:14.418044 32256 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.567946 32121 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.525800 32186 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.547153 32005 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:14.572072 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1118) took 1865 ms. Trace:
I20260709 12:22:14.573326 32247 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:14.575114 31503 consensus_meta.cc:287] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.007s
I20260709 12:22:14.576313 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:14.483968 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:14.506621 32152 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.479977 32235 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:14.507762 32211 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:14.688259 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:14.479445 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 159917us
I20260709 12:22:15.343809 30784 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:15.229987 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.014s	sys 0.028s
W20260709 12:22:15.347539 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.021s	sys 0.034s
I20260709 12:22:14.524470 32177 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.344276 32256 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:15.355350 31999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.029s	sys 0.110s
I20260709 12:22:14.710215 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.357820 30855 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:15.359364 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.355654 32258 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.356487 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 883038us
W20260709 12:22:14.520989 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 109673us
W20260709 12:22:14.797369 30826 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.28.234.126:42357, user_credentials={real_user=slave}} blocked reactor thread for 108972us
I20260709 12:22:15.355482 32177 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:15.324369 32261 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:22:14.829629 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.332019 32190 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:15.272265 32260 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
W20260709 12:22:15.369563 30778 consensus_meta.cc:287] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.889s	user 0.007s	sys 0.000s
I20260709 12:22:15.365636 32258 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:15.368425 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3147543420000147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:22:15.330709 32171 consensus_meta.cc:287] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.374s	user 0.015s	sys 0.000s
I20260709 12:22:15.372083 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:15.389310 30784 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:15.251288 32263 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 12:22:15.373063 30778 raft_consensus.cc:2410] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:14.688539 32159 consensus_meta.cc:287] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.681s	user 0.013s	sys 0.002s
I20260709 12:22:15.378908 30855 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:15.378671 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.348564 32165 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.399583 32269 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.399048 32159 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:15.400068 32269 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.401707 32159 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:14.706911 32259 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.402962 32259 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.403535 32259 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:15.355896 31999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.030s	sys 0.110s
I20260709 12:22:15.398983 30858 raft_consensus.cc:2393] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:15.350723 30851 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:15.402343 30780 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:15.417599 30782 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:15.405361 30853 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:15.420138 30781 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 863) took 2746 ms (client timeout 2830 ms). Trace:
I20260709 12:22:15.420760 32121 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:15.420711 30781 rpcz_store.cc:269] 0709 12:22:12.673337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:12.674300 (+   963us) service_pool.cc:224] Handling call
0709 12:22:15.413473 (+2739173us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540008c5d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:15.419987 (+  6514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386193152}
I20260709 12:22:15.417874 30784 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
W20260709 12:22:15.404822 32245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.024s	sys 0.039s
I20260709 12:22:15.348613 31503 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.425858 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.428184 30855 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:15.428699 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 895) took 1023 ms. Trace:
I20260709 12:22:15.428897 30855 rpcz_store.cc:276] 0709 12:22:14.405719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.412577 (+1006858us) service_pool.cc:224] Handling call
0709 12:22:15.428645 (+ 16068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.394665 31477 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:15.418650 32186 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:15.424793 32245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.025s	sys 0.040s
I20260709 12:22:15.396116 32171 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.433748 32258 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.434880 32108 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:15.430891 32173 consensus_meta.cc:287] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.330s	user 0.015s	sys 0.000s
W20260709 12:22:15.435467 32217 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.954s	user 0.010s	sys 0.000s
I20260709 12:22:15.436823 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.444792 30854 raft_consensus.cc:2393] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:15.437879 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.439244 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.352900 30927 rpcz_store.cc:276] 0709 12:22:12.706528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.191664 (+485136us) service_pool.cc:224] Handling call
0709 12:22:13.228433 (+ 36769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:13.401099 (+172666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:14.571577 (+1170478us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003309d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:14.571950 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237345664}
I20260709 12:22:15.446449 30855 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:15.446741 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.447060 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.452085 30854 raft_consensus.cc:2376] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
I20260709 12:22:15.452782 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 888) took 1084 ms. Trace:
I20260709 12:22:15.453081 30854 rpcz_store.cc:276] 0709 12:22:14.368462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.446782 (+1078320us) service_pool.cc:224] Handling call
0709 12:22:15.452734 (+  5952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.453811 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 878) took 1253 ms. Trace:
I20260709 12:22:15.454182 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.454398 30855 rpcz_store.cc:276] 0709 12:22:14.200749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.430535 (+1229786us) service_pool.cc:224] Handling call
0709 12:22:15.453723 (+ 23188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.452839 30851 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:15.436867 32235 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.446218 32173 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:15.460843 30852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 853) took 4794 ms (client timeout 1753 ms). Trace:
W20260709 12:22:15.465627 30852 rpcz_store.cc:269] 0709 12:22:10.666584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:10.667822 (+  1238us) service_pool.cc:224] Handling call
0709 12:22:15.460607 (+4792785us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b540003e3d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:15.460736 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5408937344}
I20260709 12:22:15.451469 30853 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:15.466791 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:15.467298 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.467545 30852 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:15.467799 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.462711 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1134) took 1464 ms. Trace:
I20260709 12:22:15.472198 30934 rpcz_store.cc:276] 0709 12:22:13.998624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.998774 (+   150us) service_pool.cc:224] Handling call
0709 12:22:13.999093 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.013696 (+ 14603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:14.013726 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:14.013795 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:14.013828 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.462487 (+1448659us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540027cc54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:15.462537 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.462654 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33057536}
I20260709 12:22:15.455459 30854 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:15.463963 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:15.456434 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 896) took 1039 ms. Trace:
I20260709 12:22:15.478012 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 907) took 1016 ms. Trace:
I20260709 12:22:15.479530 30854 rpcz_store.cc:276] 0709 12:22:14.461869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.453833 (+991964us) service_pool.cc:224] Handling call
0709 12:22:15.477929 (+ 24096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.481233 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.482640 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.483170 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.483511 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 882) took 1247 ms. Trace:
I20260709 12:22:15.477594 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 904) took 1027 ms. Trace:
I20260709 12:22:15.455950 30928 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:15.484229 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 903) took 1034 ms. Trace:
I20260709 12:22:15.484515 30852 rpcz_store.cc:276] 0709 12:22:14.450359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.466526 (+1016167us) service_pool.cc:224] Handling call
0709 12:22:15.477522 (+ 10996us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.484760 30855 rpcz_store.cc:276] 0709 12:22:14.450002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.455330 (+1005328us) service_pool.cc:224] Handling call
0709 12:22:15.484153 (+ 28823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.486030 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.486780 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.487455 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 899) took 1061 ms. Trace:
I20260709 12:22:15.487984 30852 rpcz_store.cc:276] 0709 12:22:14.426032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.485680 (+1059648us) service_pool.cc:224] Handling call
0709 12:22:15.487381 (+  1701us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.489204 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.452082 32217 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.484050 30854 rpcz_store.cc:276] 0709 12:22:14.236070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.482343 (+1246273us) service_pool.cc:224] Handling call
0709 12:22:15.483445 (+  1102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.447659 32005 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.501055 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.463737 32171 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:15.506628 30852 raft_consensus.cc:2410] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:22:15.506994 30785 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:15.507400 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 897) took 1088 ms. Trace:
I20260709 12:22:15.489022 32271 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.498473 32267 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:22:15.524402 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.524701 31963 raft_consensus.cc:993] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: : Instructing follower 7857bffc34ce4e1db3617488701b9810 to start an election
I20260709 12:22:15.525277 31963 raft_consensus.cc:1081] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Signalling peer 7857bffc34ce4e1db3617488701b9810 to start an election
I20260709 12:22:15.527302 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.527980 30856 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
W20260709 12:22:15.528427 30856 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 884) took 1262 ms (client timeout 1588 ms). Trace:
W20260709 12:22:15.528800 30856 rpcz_store.cc:269] 0709 12:22:14.266334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.280962 (+ 14628us) service_pool.cc:224] Handling call
0709 12:22:15.527134 (+1246172us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:15.528369 (+  1235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5753088}
I20260709 12:22:15.529241 32038 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:15.531355 32258 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:15.531904 32258 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:15.532459 30900 connection.cc:256] RPC call timeout handler was delayed by -1.1994553389999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
I20260709 12:22:15.509032 30854 rpcz_store.cc:276] 0709 12:22:14.419279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.500691 (+1081412us) service_pool.cc:224] Handling call
0709 12:22:15.507338 (+  6647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.533924 32264 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.534298 32258 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.534469 32264 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.534829 32258 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.534864 31503 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.535246 32187 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:15.535571 31503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42840 (request call id 169) took 1567 ms. Trace:
I20260709 12:22:15.535391 32258 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.491868 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 908) took 1008 ms. Trace:
I20260709 12:22:15.488073 32129 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.492425 32245 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.518558 32266 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:15.519178 32005 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.507335 32152 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.522440 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.513643 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 905) took 1063 ms. Trace:
I20260709 12:22:15.549888 30852 rpcz_store.cc:276] 0709 12:22:14.450709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.488920 (+1038211us) service_pool.cc:224] Handling call
0709 12:22:15.513550 (+ 24630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.537879 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.535815 32187 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.550979 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 885) took 1263 ms. Trace:
I20260709 12:22:15.546515 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.547847 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:15.479413 30851 rpcz_store.cc:276] 0709 12:22:14.416916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.429948 (+1013032us) service_pool.cc:224] Handling call
0709 12:22:15.456360 (+ 26412us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:15.542328 30900 leader_election.cc:336] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.753s (SENT)
I20260709 12:22:15.536886 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.554322 30855 rpcz_store.cc:276] 0709 12:22:14.287157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.489118 (+1201961us) service_pool.cc:224] Handling call
0709 12:22:15.550919 (+ 61801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.548525 32129 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.544800 32038 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.584584 32278 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:15.585060 32278 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:15.584824 30851 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:15.595971 30900 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:15.597204 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 54909.1us
I20260709 12:22:15.598008 30781 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.598938 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 894) took 1193 ms. Trace:
I20260709 12:22:15.599383 30856 rpcz_store.cc:276] 0709 12:22:14.405261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.529708 (+1124447us) service_pool.cc:224] Handling call
0709 12:22:15.598874 (+ 69166us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:15.601230 30900 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.826s (SENT)
I20260709 12:22:15.601797 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.600224 32256 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.612649 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 879) took 1411 ms. Trace:
W20260709 12:22:15.613122 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.613092 30859 rpcz_store.cc:276] 0709 12:22:14.201277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.611790 (+1410513us) service_pool.cc:224] Handling call
0709 12:22:15.612133 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.612310 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:15.612339 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.612380 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:15.612410 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.612460 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.612584 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.539199 30853 rpcz_store.cc:276] 0709 12:22:14.480970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.438751 (+957781us) service_pool.cc:224] Handling call
0709 12:22:15.488865 (+ 50114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.536000 31503 rpcz_store.cc:276] 0709 12:22:14.018256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.022460 (+  4204us) service_pool.cc:224] Handling call
0709 12:22:15.535467 (+1513007us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":53868}
I20260709 12:22:15.615900 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.616432 30859 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:15.618214 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 880) took 1386 ms. Trace:
I20260709 12:22:15.619187 30859 rpcz_store.cc:276] 0709 12:22:14.232081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.614624 (+1382543us) service_pool.cc:224] Handling call
0709 12:22:15.615838 (+  1214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.617961 (+  2123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.618157 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.587001 32038 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:15.609545 32187 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.613812 32256 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:15.631634 32170 consensus_meta.cc:287] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 1.162s	user 0.009s	sys 0.009s
I20260709 12:22:15.632715 30857 raft_consensus.cc:2410] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:15.632596 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:15.633365 32173 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.633919 32187 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.634099 31476 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:15.634354 32187 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:15.634541 32264 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.634766 32187 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.636554 32277 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.565685 32171 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.622155 30856 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 12:22:15.582827 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 220928us
I20260709 12:22:15.554566 32211 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.626580 32258 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.621457 32259 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.632663 32177 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.646718 32259 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.547752 32245 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.647111 32177 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.647867 31507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "047196043bb744a6b94cb3b634b80771"
dest_uuid: "7857bffc34ce4e1db3617488701b9810"
 from {username='slave'} at 127.0.0.1:42840
I20260709 12:22:15.648772 32245 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:15.629011 32250 log.cc:927] Time spent T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 1.345s	user 0.015s	sys 0.020s
I20260709 12:22:15.649024 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:15.540145 32271 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.649716 31505 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.650997 32129 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.651425 32271 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.585567 32278 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.639266 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.587594 32152 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:15.621630 32142 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.643082 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 877) took 1442 ms. Trace:
I20260709 12:22:15.637652 31506 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:22:15.644102 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.654109 30778 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:15.657974 30856 rpcz_store.cc:276] 0709 12:22:14.200495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.601064 (+1400569us) service_pool.cc:224] Handling call
0709 12:22:15.621816 (+ 20752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:15.642597 (+ 20781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.643001 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.640995 30781 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:15.652693 32171 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.662657 31477 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.662750 32080 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:15.668668 31476 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:15.672644 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:15.673322 32171 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:15.677059 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 89187.3us
I20260709 12:22:15.678849 30856 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:15.680383 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 883) took 1435 ms. Trace:
I20260709 12:22:15.680955 30856 rpcz_store.cc:276] 0709 12:22:14.245014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.668048 (+1423034us) service_pool.cc:224] Handling call
0709 12:22:15.678643 (+ 10595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.680004 (+  1361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.680309 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.688292 32016 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.688575 31893 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:15.689986 30900 leader_election.cc:336] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.591s (SENT)
I20260709 12:22:15.690600 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.696038 30856 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:15.696748 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 889) took 1318 ms. Trace:
I20260709 12:22:15.697075 30856 rpcz_store.cc:276] 0709 12:22:14.378808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.682130 (+1303322us) service_pool.cc:224] Handling call
0709 12:22:15.695857 (+ 13727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.696510 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.696691 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.698040 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 42) took 1455 ms. Trace:
I20260709 12:22:15.698305 30856 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:15.698943 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 890) took 1295 ms. Trace:
W20260709 12:22:15.701021 30900 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.704s (SENT)
I20260709 12:22:15.701462 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.699309 30856 rpcz_store.cc:276] 0709 12:22:14.403707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.697822 (+1294115us) service_pool.cc:224] Handling call
0709 12:22:15.698140 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.698741 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.698898 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.678838 30780 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.676687 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:15.659768 32152 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.678517 32259 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.698637 30859 rpcz_store.cc:276] 0709 12:22:14.243002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.620799 (+1377797us) service_pool.cc:224] Handling call
0709 12:22:15.626545 (+  5746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:15.626920 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:15.626950 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:15.627406 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:22:15.678062 (+ 50656us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:15.697004 (+ 18942us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.697612 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.697705 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:15.697795 (+    90us) raft_consensus.cc:1685] finished
0709 12:22:15.697814 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.697969 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":319,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":278,"thread_start_us":55039,"threads_started":2,"wal-append.queue_time_us":66210}
I20260709 12:22:15.679412 32277 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.690543 31505 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:15.692736 32016 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:15.744887 30900 leader_election.cc:336] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.054s (SENT)
I20260709 12:22:15.745769 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.747080 32210 raft_consensus.cc:3055] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:15.747208 32016 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.747581 32210 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:15.748875 30900 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.066s (SENT)
I20260709 12:22:15.703699 32080 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.725162 30856 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:22:15.752300 30856 pending_rounds.cc:85] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 4
I20260709 12:22:15.752719 30856 pending_rounds.cc:107] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:22:15.715770 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 898) took 1292 ms. Trace:
I20260709 12:22:15.754230 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 873) took 1554 ms. Trace:
I20260709 12:22:15.754017 30859 rpcz_store.cc:276] 0709 12:22:14.423943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.709277 (+1285334us) service_pool.cc:224] Handling call
0709 12:22:15.714095 (+  4818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.714730 (+   635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:15.714771 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.714832 (+    61us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:15.714876 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.714952 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.715684 (+   732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.756214 30859 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:15.753515 30856 raft_consensus.cc:2889] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:15.756898 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 911) took 1228 ms. Trace:
I20260709 12:22:15.755301 30852 rpcz_store.cc:276] 0709 12:22:14.199393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.551006 (+1351613us) service_pool.cc:224] Handling call
0709 12:22:15.551410 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.551677 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:15.641534 (+ 89857us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.753434 (+111900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.753483 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:15.753531 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.753599 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.754170 (+   571us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":151381,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":81,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2150,"thread_start_us":152084,"threads_started":2}
W20260709 12:22:15.756505 30900 leader_election.cc:336] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.157s (SENT)
I20260709 12:22:15.707908 32259 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:15.748602 32210 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.762161 32210 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.759318 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.758214 30859 rpcz_store.cc:276] 0709 12:22:14.528486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.755627 (+1227141us) service_pool.cc:224] Handling call
0709 12:22:15.755996 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:15.756638 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.756845 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.761059 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 892) took 1356 ms. Trace:
I20260709 12:22:15.749913 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:15.765177 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 53151.8us
I20260709 12:22:15.765990 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:15.767781 30783 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:15.768428 32018 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.763762 30856 rpcz_store.cc:276] 0709 12:22:14.404564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.702323 (+1297759us) service_pool.cc:224] Handling call
0709 12:22:15.724807 (+ 22484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.760810 (+ 36003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.761006 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:15.758576 32188 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:15.769522 30900 leader_election.cc:336] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.172s (SENT)
I20260709 12:22:15.713294 31508 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:15.771627 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.751157 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 874) took 1551 ms. Trace:
I20260709 12:22:15.768980 32277 raft_consensus.cc:2764] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:15.763444 32259 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.778571 32188 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:15.768877 32018 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.773876 30851 rpcz_store.cc:276] 0709 12:22:14.199696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.583461 (+1383765us) service_pool.cc:224] Handling call
0709 12:22:15.584338 (+   877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.584647 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:15.667135 (+ 82488us) log.cc:844] Serialized 14 byte log entry
0709 12:22:15.706571 (+ 39436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:15.706628 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:15.706696 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.712503 (+  5807us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:15.749818 (+ 37315us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":15341824,"thread_start_us":28759,"threads_started":1,"wal-append.queue_time_us":39098}
W20260709 12:22:15.779405 30900 leader_election.cc:336] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.209s (SENT)
I20260709 12:22:15.780076 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.780822 32188 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.782670 32187 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.783402 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.784628 32116 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:15.784986 30776 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:15.785574 32152 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.769163 32080 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:15.785965 32116 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:15.786602 31507 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:15.786952 32187 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.787019 31507 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:15.791699 32259 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.794603 32259 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.796641 32040 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.799851 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:15.800745 32286 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.094s	user 0.003s	sys 0.000s
I20260709 12:22:15.801510 32259 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:15.802279 32259 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.803791 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:15.804463 30781 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.804690 30780 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:15.805089 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.806622 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:15.807360 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.808229 32080 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:15.808475 31476 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:15.808789 32080 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:15.809675 32059 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:15.810451 32059 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:15.811271 32059 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.812068 32259 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:15.812218 32059 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.814129 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:15.814445 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:15.814846 30851 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:15.809708 32080 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:15.815761 30928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33366 (request call id 54) took 1795 ms (client timeout 1739 ms). Trace:
I20260709 12:22:15.814141 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:15.816514 30932 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:15.813472 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:15.803793 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:15.818185 30860 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.819164 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:15.826792 30934 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:15.827898 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:15.828856 30934 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:15.819378 30930 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:15.819826 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:15.820291 30825 connection.cc:256] RPC call timeout handler was delayed by -1.6735237150001012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
I20260709 12:22:15.821893 30778 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:22:15.816269 30928 rpcz_store.cc:269] 0709 12:22:14.020125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.021185 (+  1060us) service_pool.cc:224] Handling call
0709 12:22:15.815532 (+1794347us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000b7554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:15.815690 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283161472}
I20260709 12:22:15.822618 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:15.822808 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:15.823573 30933 raft_consensus.cc:3055] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:15.843890 30933 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:15.824602 30927 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:15.832496 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.847287 30778 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
W20260709 12:22:15.833568 30825 connection.cc:256] RPC call timeout handler was delayed by -1.5178237150003042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 12:22:15.835966 30858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 902) took 1386 ms (client timeout 1704 ms). Trace:
I20260709 12:22:15.848191 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.848457 30855 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:15.848397 30858 rpcz_store.cc:269] 0709 12:22:14.449618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.474971 (+ 25353us) service_pool.cc:224] Handling call
0709 12:22:15.835772 (+1360801us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540015c554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:15.835904 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109027200}
I20260709 12:22:15.825898 31952 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:15.809357 32187 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.841275 30781 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
W20260709 12:22:15.842422 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:15.776974 32278 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.831249 31893 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:15.849136 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 875) took 1649 ms. Trace:
I20260709 12:22:15.849314 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.846312 30933 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.854192 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:15.848009 30900 leader_election.cc:336] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.055s (SENT)
I20260709 12:22:15.856047 30825 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:15.857172 32076 raft_consensus.cc:3055] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:15.858783 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:15.870394 32055 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.847131 30776 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.907641 30778 raft_consensus.cc:2410] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:15.906149 30860 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:15.908169 30930 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.908502 30855 rpcz_store.cc:276] 0709 12:22:14.200004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.583770 (+1383766us) service_pool.cc:224] Handling call
0709 12:22:15.848117 (+264347us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:15.848291 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.848922 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.849084 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9220352}
I20260709 12:22:15.909844 30933 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:15.917164 30927 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:15.910215 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.910759 32276 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:15.911355 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 55406us
I20260709 12:22:15.913545 30899 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:15.853621 31962 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:15.905889 32050 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:15.922559 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 63855.1us
I20260709 12:22:15.927452 30781 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:15.912344 32190 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:15.918831 31893 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.906869 32076 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:15.796656 31507 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:15.862638 31952 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.913606 32187 raft_consensus.cc:697] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:15.920296 32276 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:15.919348 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 71362.8us
I20260709 12:22:15.920540 32188 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:15.928390 31476 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:15.927516 32171 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.933948 30825 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:15.929584 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:15.948226 30900 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.096s (SENT)
I20260709 12:22:15.915827 32055 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.951331 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:15.935204 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:15.935302 31893 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.925160 31962 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.946782 32245 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:15.947751 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:15.953155 32150 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:15.945302 32276 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:15.985848 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:15.948683 32171 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:15.972267 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:15.929253 32050 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:15.932816 32211 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:22:15.952426 32235 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:15.980604 30930 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:15.969923 32188 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:15.999624 30783 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 938) took 3289 ms (client timeout 2086 ms). Trace:
I20260709 12:22:15.999490 30934 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:16.000428 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 874) took 2661 ms. Trace:
I20260709 12:22:16.041146 30777 rpcz_store.cc:276] 0709 12:22:13.338679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.973042 (+634363us) service_pool.cc:224] Handling call
0709 12:22:13.973381 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.524022 (+550641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.987290 (+1463268us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b540005cb54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:16.000346 (+ 13056us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252941568}
W20260709 12:22:16.040630 30783 rpcz_store.cc:269] 0709 12:22:12.710695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.400662 (+689967us) service_pool.cc:224] Handling call
0709 12:22:15.988399 (+2587737us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54001ea5d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:15.999534 (+ 11135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5369870592}
I20260709 12:22:16.004582 32055 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:15.969492 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:15.963560 30931 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:16.006398 30928 raft_consensus.cc:3055] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.006803 32278 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.007391 32010 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.010042 32192 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.000981 32171 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:15.983419 32245 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.012323 32050 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.006866 32150 raft_consensus.cc:697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:16.058440 32150 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.015167 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:16.061442 32216 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:22:16.061546 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 46532.5us
I20260709 12:22:16.062992 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.063797 32216 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:16.064081 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:16.066088 32290 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:22:16.066955 31962 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.066783 31893 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.068545 31952 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:16.070667 32245 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:16.071270 32157 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.071846 31999 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:16.072284 31999 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.072639 31999 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.053329 32187 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.076120 32273 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:16.043447 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 97528.2us
I20260709 12:22:16.047297 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.048139 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.078416 30934 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:16.049464 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:16.049924 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 103552us
I20260709 12:22:16.049149 30928 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.037874 32235 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:16.055593 32294 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.064193 32216 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.040808 30933 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:15.976655 32076 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.079057 30929 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
W20260709 12:22:16.045928 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 116623us
I20260709 12:22:16.076711 32273 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.053112 30926 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.054726 32192 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:16.087693 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.095520 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.091922 30825 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:16.076161 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:16.099606 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:16.119191 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.113200 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.120214 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.120872 30852 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:16.121727 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.121973 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.086743 32216 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.084281 32235 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.098043 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.123860 30858 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:16.127482 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:16.128038 30858 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.124240 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:16.129338 30852 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.115051 30899 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.125492 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.131114 30933 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:16.132344 31952 raft_consensus.cc:2764] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:16.098793 31962 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:22:16.135057 32192 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.136045 31962 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.096485 32153 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:22:16.136682 31962 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:16.112880 32299 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:16.137610 32299 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.137465 31962 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.137933 32101 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:16.138084 32299 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.112347 32143 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:16.136163 32192 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.100776 32076 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:16.100318 32050 consensus_queue.cc:1175] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" responder_term: 4 status { last_received { term: 4 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:16.085237 32186 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:22:16.102805 32177 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.086382 32040 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:22:16.147801 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:16.158479 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.116568 32055 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:22:16.152820 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:16.153338 30852 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:16.154444 30899 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.161060 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.173048 30929 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:16.149425 30858 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:16.151919 31509 raft_consensus.cc:2393] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:16.146027 32210 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.189800 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.190814 30855 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:16.144464 32143 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.177634 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.178848 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.187439 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:16.151748 31893 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.091289 32294 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.201668 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.196285 30856 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:16.205523 30856 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:16.212813 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.214187 30927 raft_consensus.cc:2410] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:22:16.215405 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.207010 32143 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.217018 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.147993 32101 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:16.164338 31962 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.165908 32059 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:16.132398 30928 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.239023 30928 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.238771 32059 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.235136 32101 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.240440 32101 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:16.240150 32142 consensus_queue.cc:1175] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:16.188928 32211 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:16.241333 32101 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.242542 32101 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.186347 32177 raft_consensus.cc:697] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:16.244254 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:16.244669 32177 consensus_queue.cc:237] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.241482 32211 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.248464 32211 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.315732 31504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 165) took 2523 ms. Trace:
I20260709 12:22:16.318703 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.319489 32264 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.320091 32264 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.323218 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.324095 30930 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:16.325280 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.329785 32269 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.330987 30935 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
W20260709 12:22:16.336609 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.348384 31508 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.349619 31506 raft_consensus.cc:1240] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:16.368711 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.499562 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.500857 30851 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
W20260709 12:22:16.456898 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.506433 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.507521 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 881) took 2275 ms. Trace:
I20260709 12:22:16.508713 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:16.458737 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 360588us
I20260709 12:22:16.509239 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.510040 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.510807 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.510921 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.511264 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:16.472549 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.475919 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 949) took 3246 ms. Trace:
I20260709 12:22:16.508242 30853 rpcz_store.cc:276] 0709 12:22:14.232343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.615283 (+1382940us) service_pool.cc:224] Handling call
0709 12:22:16.505422 (+890139us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:16.506124 (+   702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.506758 (+   634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:16.506807 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:16.506881 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:16.506964 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.507056 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.507250 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30973312}
I20260709 12:22:16.512251 30779 rpcz_store.cc:276] 0709 12:22:13.229411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.965932 (+736521us) service_pool.cc:224] Handling call
0709 12:22:13.966379 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:14.121138 (+154759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.475060 (+2353922us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400246654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:16.475644 (+   584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353395968}
I20260709 12:22:16.477686 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:16.479260 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 885) took 2038 ms. Trace:
I20260709 12:22:16.514452 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.513972 30782 rpcz_store.cc:276] 0709 12:22:14.440449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:14.482925 (+ 42476us) service_pool.cc:224] Handling call
0709 12:22:14.522509 (+ 39584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.419355 (+896846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.478387 (+1059032us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540005d054. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:16.478957 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045495040}
I20260709 12:22:16.515332 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.515686 30783 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:16.516222 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.516877 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.481890 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.518741 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.518821 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.484815 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:16.490818 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.520458 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:16.475929 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.493151 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 945) took 3282 ms. Trace:
I20260709 12:22:16.525132 30926 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:16.525492 30785 rpcz_store.cc:276] 0709 12:22:13.210754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.957383 (+746629us) service_pool.cc:224] Handling call
0709 12:22:15.413700 (+1456317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:15.508331 (+ 94631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.989926 (+481595us) spinlock_profiling.cc:243] Waited 93.1 ms on lock 0x7b540008c5d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:16.492677 (+502751us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540008c5d0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:16.492942 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3562369152}
I20260709 12:22:16.526577 30779 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:16.498495 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.527086 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:16.466603 30679 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 1 to 3, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 3 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.527733 30855 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.529167 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:16.480755 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.530416 30856 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:16.531574 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:16.532672 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 48259.7us
I20260709 12:22:16.518683 30777 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.529776 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.534636 30826 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:16.533360 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.537699 30679 catalog_manager.cc:5697] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 2 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.357380 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.407755 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.545655 30931 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:16.547044 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.547219 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.547598 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.548187 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.548594 30932 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.548915 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.514163 30852 raft_consensus.cc:2376] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4. Re-sending same reply.
I20260709 12:22:16.551811 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.552830 30934 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.553150 30852 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.316380 31504 rpcz_store.cc:276] 0709 12:22:13.792151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:13.809227 (+ 17076us) service_pool.cc:224] Handling call
0709 12:22:13.809715 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:14.010010 (+200295us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:14.256080 (+246070us) log.cc:844] Serialized 14 byte log entry
0709 12:22:14.303632 (+ 47552us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:14.311154 (+  7522us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:14.314879 (+  3725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:15.846305 (+1531426us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b1800363280. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:16.314702 (+468397us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b1800363280. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9002a6 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419
0709 12:22:16.315317 (+   615us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54004f92d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:16.315375 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:16.315610 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":284463,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":7778,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":86,"spinlock_wait_cycles":368211456,"thread_start_us":275161,"threads_started":2,"wal-append.queue_time_us":110023,"wal-append.run_cpu_time_us":1446,"wal-append.run_wall_time_us":1016063}
I20260709 12:22:16.497524 30854 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:16.555742 30854 pending_rounds.cc:85] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 1
I20260709 12:22:16.556108 30854 pending_rounds.cc:107] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:16.556555 30854 raft_consensus.cc:2889] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:16.556922 30852 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:16.557003 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:16.495267 30857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 872) took 2295 ms (client timeout 1591 ms). Trace:
W20260709 12:22:16.558079 30857 rpcz_store.cc:269] 0709 12:22:14.199152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.465427 (+1266275us) service_pool.cc:224] Handling call
0709 12:22:16.494555 (+1029128us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540015c054. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:16.494940 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332905344}
I20260709 12:22:16.558727 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 870) took 2360 ms. Trace:
I20260709 12:22:16.559217 30854 rpcz_store.cc:276] 0709 12:22:14.198540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.533986 (+1335446us) service_pool.cc:224] Handling call
0709 12:22:16.496088 (+962102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:16.557238 (+ 61150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:16.558459 (+  1221us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b540015c050. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:16.558635 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211507584}
I20260709 12:22:16.561003 30854 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.375213 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.563068 31477 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:16.563438 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.564464 30779 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.565094 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:16.385603 30929 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:16.371865 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.516965 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.567514 30778 raft_consensus.cc:2393] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:16.567684 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.567960 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.563185 31504 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.524873 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:16.373677 31507 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.565122 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.375602 31999 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.410900 32018 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.587255 31509 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.585287 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:16.587251 31505 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:16.590842 30782 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.407718 32143 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.593024 31999 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.582698 30930 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:16.595209 32187 raft_consensus.cc:2804] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.595942 32187 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:16.596683 32187 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.595736 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.597944 30930 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:16.598275 32190 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:16.599002 32190 raft_consensus.cc:697] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:16.599335 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.600330 30930 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:16.600739 32190 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.547518 30856 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.426131 32171 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.357532 32198 raft_consensus.cc:3055] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.620468 32198 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:16.622373 32171 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:16.622256 32198 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.624500 32198 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:16.571044 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.416054 32216 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:16.414381 32234 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:16.425719 32235 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.643793 30778 raft_consensus.cc:3055] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.644344 30778 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:16.645649 30778 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.646381 32235 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.421079 32244 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:16.649389 30899 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.636018 30853 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:16.654327 32216 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:16.568522 30929 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:16.571760 30785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:16.572402 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.655900 30785 raft_consensus.cc:606] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:16.655184 30854 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.656373 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.656594 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.656395 30785 raft_consensus.cc:614] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:16.657189 30929 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:16.658033 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.658684 30933 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.574746 31987 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.575222 32076 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.660614 31987 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.661149 31987 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.576195 30858 raft_consensus.cc:2410] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:16.578188 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:16.578590 32040 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:16.579348 32080 consensus_queue.cc:1059] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:16.579634 32165 consensus_queue.cc:1059] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:16.580039 32113 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.530874 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.584370 30935 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:16.377702 32059 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:16.678493 32113 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.682840 32113 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.683090 32059 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:16.603402 31504 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:16.601438 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.611230 30931 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:16.612241 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:16.526528 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.614288 32143 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.540707 30679 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 2 to 3, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 3 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.321159 32264 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.697463 30930 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:16.401983 32272 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.710495 32272 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.411391 32273 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.712416 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.712603 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.714015 32165 consensus_queue.cc:1059] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:16.714745 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.372653 32294 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.421557 32299 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.718564 32165 consensus_queue.cc:1243] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 7857bffc34ce4e1db3617488701b9810 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:16.719408 32165 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:16.719925 32152 raft_consensus.cc:3055] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.720501 32152 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.720876 32085 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.721093 32299 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.380134 32276 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.630806 30932 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:16.637071 30855 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:16.640019 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:16.642405 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 108719us
I20260709 12:22:16.646948 30778 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.575871 32170 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:16.682878 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.685524 30934 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
W20260709 12:22:16.664196 30776 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.010s
I20260709 12:22:16.689805 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.687417 32059 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.683090 32080 raft_consensus.cc:3055] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.694082 30927 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:16.700537 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.702808 32244 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:16.709388 32114 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.714800 30781 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:16.715440 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:16.721436 32085 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.726464 30784 raft_consensus.cc:2410] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:16.728503 30783 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.726580 30779 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.724143 32276 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.720535 32165 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:22:16.700453 32277 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.746775 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:16.749365 30930 raft_consensus.cc:2410] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:16.741453 32059 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:16.764281 32085 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.749022 32114 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.768441 32171 raft_consensus.cc:3055] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.768975 32171 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.770895 30781 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:16.774215 30860 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:16.741851 32080 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.775604 32080 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.777323 32080 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.757604 31810 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.778657 31810 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.779418 32244 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.779966 32244 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.781956 32085 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:16.757999 30785 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.774089 32165 raft_consensus.cc:3055] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.735749 30679 catalog_manager.cc:5697] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 4, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:16.768227 30780 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:16.786253 30934 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:16.792361 30934 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.787770 32165 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.795738 32016 consensus_queue.cc:1059] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:16.796191 32150 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:22:16.797302 32016 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:16.728633 32264 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.802454 30783 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:16.802882 30929 raft_consensus.cc:2410] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:16.747516 30776 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:16.801374 30934 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.810969 30679 catalog_manager.cc:5697] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:16.815709 30782 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.797745 32016 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.798308 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:16.822702 32016 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.826660 32016 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:16.828950 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 895) took 1324 ms. Trace:
I20260709 12:22:16.829507 30784 rpcz_store.cc:276] 0709 12:22:15.505013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.506537 (+  1524us) service_pool.cc:224] Handling call
0709 12:22:16.828652 (+1322115us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540008bbd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:16.828867 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676146432}
I20260709 12:22:16.830058 32276 consensus_queue.cc:1059] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:16.831513 32276 raft_consensus.cc:3055] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:16.831911 32276 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:16.832201 32114 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:16.833678 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 221663us
I20260709 12:22:16.721750 32152 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.837034 30932 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:22:16.842842 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 167184us
W20260709 12:22:16.848016 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.856948 30934 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:16.861780 30935 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:16.873220 31477 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:16.875227 30930 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.850636 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32970 (request call id 58) took 1042 ms. Trace:
W20260709 12:22:16.877804 30900 leader_election.cc:336] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.969s (SENT)
W20260709 12:22:16.878412 30928 consensus_meta.cc:287] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.639s	user 0.015s	sys 0.006s
I20260709 12:22:16.859035 32059 consensus_queue.cc:1059] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 12:22:16.879135 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.879427 30928 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.883030 30680 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 175) took 10206 ms. Trace:
I20260709 12:22:16.892300 30933 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:16.815435 32171 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.838521 32276 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:16.902508 32150 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:16.899518 30899 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:16.880612 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:16.910180 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.900331 30927 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:16.921872 32276 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:16.883463 30680 rpcz_store.cc:276] 0709 12:22:06.673367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:06.673962 (+   595us) service_pool.cc:224] Handling call
0709 12:22:16.880035 (+10206073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:11.137820 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:11.138682 (+   862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:11.138734 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:22:11.138762 (+    28us) tablet.cc:662] Decoding operations
0709 12:22:11.184532 (+ 45770us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:11.184617 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:11.184644 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:22:11.185324 (+   680us) tablet.cc:701] Row locks acquired
0709 12:22:11.185341 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:22:11.185486 (+   145us) write_op.cc:270] Start()
0709 12:22:11.185601 (+   115us) write_op.cc:276] Timestamp: P: 1783599731185443 usec, L: 0
0709 12:22:11.185622 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:22:11.188101 (+  2479us) log.cc:844] Serialized 2865 byte log entry
0709 12:22:12.439057 (+1250956us) op_driver.cc:464] REPLICATION: finished
0709 12:22:12.792713 (+353656us) write_op.cc:301] APPLY: starting
0709 12:22:12.792834 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:12.793125 (+   291us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:12.793278 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:12.794426 (+  1148us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:12.794715 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:22:12.794783 (+    68us) write_op.cc:312] APPLY: finished
0709 12:22:12.795160 (+   377us) log.cc:844] Serialized 58 byte log entry
0709 12:22:12.818561 (+ 23401us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:12.838628 (+ 20067us) write_op.cc:454] Released schema lock
0709 12:22:12.844609 (+  5981us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:12.871880 (+ 27271us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:12.874574 (+  2694us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43083,"reported_tablets":15,"spinlock_wait_cycles":10624,"child_traces":[["op",{"apply.queue_time_us":353320,"apply.run_cpu_time_us":3618,"apply.run_wall_time_us":67518,"num_ops":7,"prepare.queue_time_us":75460,"prepare.run_cpu_time_us":100798,"prepare.run_wall_time_us":616740,"raft.queue_time_us":196386,"raft.run_cpu_time_us":28334,"raft.run_wall_time_us":243185,"replication_time_us":1253214,"thread_start_us":847574,"threads_started":4,"wal-append.queue_time_us":737434,"wal-append.run_cpu_time_us":19248,"wal-append.run_wall_time_us":1878647}]]}
I20260709 12:22:16.923502 30931 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:16.929288 30929 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
W20260709 12:22:16.929560 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 65463.9us
I20260709 12:22:16.923380 30930 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.881417 30776 rpcz_store.cc:276] 0709 12:22:15.799642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:15.817117 (+ 17475us) service_pool.cc:224] Handling call
0709 12:22:16.838289 (+1021172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:16.923301 31506 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:16.947836 30927 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:22:16.950090 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.951236 30931 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:16.952661 31477 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:16.954918 32152 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:16.959061 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.956487 30931 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:16.956600 32190 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:16.960031 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.961671 32272 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:16.962466 30929 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:16.962567 32188 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:16.978191 30935 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:16.982594 30934 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:16.974609 30750 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:16.985906 31969 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:16.987632 31969 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:16.988795 31969 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:16.971676 31810 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.001736 30783 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
W20260709 12:22:17.005322 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:16.998023 32113 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:17.001222 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 95457.8us
I20260709 12:22:17.019100 30932 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:16.983814 32187 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:17.023805 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:17.026870 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:17.031114 30935 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:17.019863 32114 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.035451 32059 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:22:17.041291 30933 raft_consensus.cc:2410] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:17.040815 32165 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:17.041997 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.045907 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 56566us
W20260709 12:22:17.046386 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.050653 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:17.049273 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.051621 30860 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.052345 32277 raft_consensus.cc:2764] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 12:22:17.053118 32314 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.103s	user 0.002s	sys 0.000s
I20260709 12:22:17.054229 32165 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.055006 32171 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.060637 30860 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:17.061733 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:17.064607 32190 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:17.065266 32190 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:17.066418 32190 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:17.067071 30776 raft_consensus.cc:1240] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:17.070389 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.072129 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.086297 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.087944 32211 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:22:17.097899 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 58840.6us
I20260709 12:22:17.113135 30778 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:17.115772 30783 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:17.119441 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.119578 32272 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:17.122706 30782 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:17.106542 32114 consensus_queue.cc:1059] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:22:17.125080 31504 raft_consensus.cc:1240] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:17.125136 32272 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.125907 32272 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:17.127135 32272 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:17.128548 32272 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:17.129973 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.130479 30927 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:17.131575 32085 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:17.132050 32264 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.135229 32187 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:17.143301 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 81655.2us
I20260709 12:22:17.152441 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:17.153252 30933 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.150403 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:17.171691 30932 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.172312 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:17.181272 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:17.112339 32244 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.182144 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:17.183689 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:17.190621 30930 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:17.171801 32150 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:22:17.195228 30855 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:17.195612 30784 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:17.202031 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:17.205349 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:17.210148 30934 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:22:17.210269 32113 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.213446 32244 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:17.214325 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:17.214951 30779 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.225106 31476 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:17.228024 30932 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:17.229820 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:17.220652 30826 connection.cc:256] RPC call timeout handler was delayed by -1.3215115550001428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:22:17.233557 30826 connection.cc:256] RPC call timeout handler was delayed by -1.3116115550001268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 12:22:17.234206 30930 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
W20260709 12:22:17.234663 30826 connection.cc:256] RPC call timeout handler was delayed by -1.308011555000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:22:17.235036 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:17.235809 30932 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:17.235656 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:17.236516 30930 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.236613 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:17.230888 32190 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:17.242620 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.243046 30826 connection.cc:256] RPC call timeout handler was delayed by -1.2324115549999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 12:22:17.243366 30826 connection.cc:256] RPC call timeout handler was delayed by -1.2153115549999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:22:17.243995 30826 connection.cc:256] RPC call timeout handler was delayed by -1.1955115549999391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 12:22:17.244479 30826 connection.cc:256] RPC call timeout handler was delayed by -1.1802115549999144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 12:22:17.244958 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0857115550002163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 12:22:17.248677 30933 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:17.254345 32152 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.220065 32277 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:22:17.279640 30934 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:17.281077 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:17.282224 30935 raft_consensus.cc:2410] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:17.291707 30779 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:17.293676 30899 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:17.296792 32152 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.297468 32152 raft_consensus.cc:697] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:17.298992 32152 consensus_queue.cc:237] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:17.280594 31987 consensus_meta.cc:287] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.009s
I20260709 12:22:17.306468 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:17.307955 30934 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.283800 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:17.310191 30935 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
W20260709 12:22:17.309525 30826 connection.cc:256] RPC call timeout handler was delayed by -1.071311555000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 12:22:17.312162 30935 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 12:22:17.323741 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.305629 31987 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.325193 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.328274 31810 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.336915 30934 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:17.337345 30900 leader_election.cc:336] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.693s (SENT)
I20260709 12:22:17.337929 30900 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:17.349107 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:17.352936 30783 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:17.344250 32198 consensus_meta.cc:287] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.010s
I20260709 12:22:17.339835 32276 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:17.364184 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:17.364949 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:17.365509 30779 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:17.365866 30927 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:17.366657 30780 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:17.367651 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.368405 30779 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
W20260709 12:22:17.369345 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 56079.4us
I20260709 12:22:17.370886 30776 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:22:17.353122 32080 consensus_meta.cc:287] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 12:22:17.375222 30777 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:17.351253 31969 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:17.377967 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:17.341843 31810 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.381182 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:17.384903 30858 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:17.383662 30785 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:17.386178 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 51960.2us
I20260709 12:22:17.379390 32113 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:17.394897 32113 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.395126 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:17.395898 30859 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:17.399325 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:17.400236 30859 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
W20260709 12:22:17.398370 30900 leader_election.cc:336] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.695s (SENT)
I20260709 12:22:17.402281 30900 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:17.403748 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.416570 30779 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.398658 32113 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.419077 30858 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.419858 30858 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:17.417621 31969 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.422768 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:17.425252 30900 leader_election.cc:336] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.556s (SENT)
I20260709 12:22:17.396679 32276 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.434109 31987 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.435774 32276 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.434543 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:17.437081 31810 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.428057 30859 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:17.401979 32187 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:22:17.430953 32272 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.432767 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:17.440626 30783 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:17.438597 30858 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.438979 30859 pending_rounds.cc:85] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 1
I20260709 12:22:17.442845 30859 pending_rounds.cc:107] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:17.443172 30859 raft_consensus.cc:2889] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:17.444041 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:17.444602 30860 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.445298 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:17.448683 30855 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.441649 32276 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.467875 30930 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:17.459615 30858 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.448077 32165 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.446977 32272 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:17.461992 31987 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.462182 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:17.463666 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.897s (SENT) [suppressed 37 similar messages]
I20260709 12:22:17.476141 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.476501 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:17.477962 32123 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:17.478434 32123 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.478865 32123 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:17.482290 32165 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.473788 32276 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.482940 32165 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:17.483410 32198 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:17.485090 32272 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.486752 31987 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:17.488322 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.487954 31987 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:17.482868 32211 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.489859 32211 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.491160 32276 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.492336 32211 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:17.498046 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.501868 32331 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.508376 30860 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:17.491868 32165 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:17.510841 30783 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:17.514336 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:17.512274 30899 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:17.520378 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:17.521945 30859 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:17.521385 32165 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:17.538204 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 74555.9us
I20260709 12:22:17.540337 32165 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.523353 32331 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:17.543690 32331 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:17.545272 32332 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:22:17.547868 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:17.548681 31504 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:17.540928 32165 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:17.551522 30926 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:17.554641 30860 raft_consensus.cc:3055] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.555073 30860 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:17.555869 30860 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.556528 30855 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:17.556838 30860 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.560488 32276 consensus_queue.cc:1059] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.560796 31810 consensus_queue.cc:1059] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.561707 31810 raft_consensus.cc:3055] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.561508 32276 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.562136 31810 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:17.563197 31810 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.564369 31810 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:17.564493 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.565049 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.566906 32331 raft_consensus.cc:3055] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.567440 32331 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:17.548987 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.568816 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 90459.8us
W20260709 12:22:17.571424 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.578014 30858 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:17.553526 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33366 (request call id 59) took 1392 ms. Trace:
I20260709 12:22:17.578500 30858 pending_rounds.cc:85] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 1
I20260709 12:22:17.581390 30858 pending_rounds.cc:107] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:17.581715 30858 raft_consensus.cc:2889] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:17.579670 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:17.586143 32335 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:22:17.580349 30926 rpcz_store.cc:276] 0709 12:22:16.161291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.526205 (+364914us) service_pool.cc:224] Handling call
0709 12:22:17.553324 (+1027119us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54002a3354. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:17.553464 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1609656064}
I20260709 12:22:17.590261 32334 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.597343 31810 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:17.588917 32331 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.618141 30933 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:17.620710 32190 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:17.621240 30934 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:17.629472 30860 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:17.630434 30860 pending_rounds.cc:85] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 1
I20260709 12:22:17.631049 30860 pending_rounds.cc:107] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:17.631477 30860 raft_consensus.cc:2889] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:17.582587 32123 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:17.641584 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.642131 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.642514 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.642554 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.644366 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 121895us
I20260709 12:22:17.589006 32165 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.602187 32277 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:22:17.627998 32227 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:22:17.656036 32331 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.661543 30780 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:17.693334 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:17.695101 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:17.666728 32113 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.695014 32198 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.683642 32343 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.708012 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:17.713971 32198 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.710484 32123 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.717388 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:17.711180 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:17.721354 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:17.714763 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.724628 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 69816.2us
I20260709 12:22:17.726922 30825 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.728124 32276 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:17.728480 30825 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.728667 32276 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.729200 32276 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.729995 32123 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.717793 32343 raft_consensus.cc:2764] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:22:17.741559 32331 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.748023 32334 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:17.751837 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:17.752548 30783 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:17.735000 32344 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:17.745952 32198 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.758390 30825 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.761355 32113 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:17.764277 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 47016.8us
I20260709 12:22:17.768806 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:17.770787 32323 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.374s	user 0.001s	sys 0.004s
I20260709 12:22:17.771588 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:17.773952 32341 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:17.774457 32341 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:17.729712 32348 consensus_queue.cc:1059] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:22:17.775274 32348 consensus_queue.cc:1243] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:17.776036 32348 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:17.776473 32346 log.cc:927] Time spent T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:22:17.776932 32348 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:17.773273 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:17.777455 32348 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:17.790930 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:17.773980 32344 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.799435 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.801935 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.806674 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:17.807564 32351 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.808238 32123 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:17.809566 32343 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:17.810091 32343 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.810484 32343 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.810652 32123 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:17.811508 32113 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.813908 32165 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:17.814972 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.815419 30779 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:17.815941 30785 raft_consensus.cc:2410] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:17.817050 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.818718 32348 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:17.820226 32348 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.822495 30782 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:17.822317 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.822943 30782 pending_rounds.cc:85] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 1
I20260709 12:22:17.823275 30782 pending_rounds.cc:107] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:17.823534 30782 raft_consensus.cc:2889] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:17.823622 32113 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:17.824595 32113 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:17.826282 32113 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.832015 30780 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:17.829424 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:17.833727 31987 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:17.835918 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:17.845830 30777 raft_consensus.cc:2368] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:17.854497 30783 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:17.855932 30899 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:17.800403 30900 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.991s (SENT)
W20260709 12:22:17.868638 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.869290 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:17.875262 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 68715.8us
I20260709 12:22:17.876525 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:17.882942 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 47155.4us
I20260709 12:22:17.883612 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.878022 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.865625 32198 raft_consensus.cc:2764] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:22:17.871047 32152 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:22:17.888788 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 95223.4us
W20260709 12:22:17.885659 32347 log.cc:927] Time spent T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:22:17.775450 32341 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.871001 32187 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:22:17.882035 32272 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:17.902860 30825 leader_election.cc:400] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:17.903396 30825 leader_election.cc:403] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:17.895323 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:17.871001 32085 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:22:17.885774 31810 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:17.902029 30855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb"
dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:32956
I20260709 12:22:17.882326 32331 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:17.882063 32276 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.895161 32351 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:17.911119 30855 raft_consensus.cc:606] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:17.914122 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.898694 32354 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.899021 31987 raft_consensus.cc:2764] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:17.917026 30855 raft_consensus.cc:614] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:17.925853 32354 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.915077 32080 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.927512 32080 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.928395 32354 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:17.932478 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.910620 31810 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:17.937422 31810 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.917179 32344 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:22:17.915320 32152 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:17.943406 32152 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:17.944089 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 44636.5us
I20260709 12:22:17.945986 32123 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:17.946051 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.946499 32123 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.946610 31987 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.947008 32123 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:17.948042 32337 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:17.948668 32337 raft_consensus.cc:697] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:17.949448 30679 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 77) took 8271 ms. Trace:
I20260709 12:22:17.949719 32337 consensus_queue.cc:237] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.953384 32331 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:17.960269 30779 raft_consensus.cc:1275] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:17.963033 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:17.968860 32198 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:17.976493 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 73849.6us
I20260709 12:22:17.979429 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:17.983218 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:17.949893 30679 rpcz_store.cc:276] 0709 12:22:09.678472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:09.681907 (+  3435us) service_pool.cc:224] Handling call
0709 12:22:17.949340 (+8267433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:17.039459 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:17.040223 (+   764us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:17.040290 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:22:17.040311 (+    21us) tablet.cc:662] Decoding operations
0709 12:22:17.041124 (+   813us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:17.041242 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:17.041271 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:22:17.144750 (+103479us) tablet.cc:701] Row locks acquired
0709 12:22:17.176804 (+ 32054us) write_op.cc:260] PREPARE: finished
0709 12:22:17.197620 (+ 20816us) write_op.cc:270] Start()
0709 12:22:17.229248 (+ 31628us) write_op.cc:276] Timestamp: P: 1783599737184850 usec, L: 0
0709 12:22:17.233068 (+  3820us) op_driver.cc:348] REPLICATION: starting
0709 12:22:17.330582 (+ 97514us) log.cc:844] Serialized 2194 byte log entry
0709 12:22:17.683610 (+353028us) op_driver.cc:464] REPLICATION: finished
0709 12:22:17.875173 (+191563us) write_op.cc:301] APPLY: starting
0709 12:22:17.875293 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:17.875490 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:17.875670 (+   180us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:17.876689 (+  1019us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:17.876994 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:22:17.877060 (+    66us) write_op.cc:312] APPLY: finished
0709 12:22:17.877416 (+   356us) log.cc:844] Serialized 46 byte log entry
0709 12:22:17.877694 (+   278us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:17.879818 (+  2124us) write_op.cc:454] Released schema lock
0709 12:22:17.879892 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:17.912912 (+ 33020us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:17.915459 (+  2547us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1561403,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":188467,"apply.run_cpu_time_us":3306,"apply.run_wall_time_us":23551,"num_ops":5,"prepare.queue_time_us":139794,"prepare.run_cpu_time_us":28050,"prepare.run_wall_time_us":372730,"raft.queue_time_us":125176,"raft.run_cpu_time_us":10619,"raft.run_wall_time_us":122003,"replication_time_us":449020,"thread_start_us":288541,"threads_started":4,"wal-append.queue_time_us":89610}]]}
W20260709 12:22:17.996729 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.000989 32244 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.003536 32343 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.004096 32272 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.983310 32344 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:18.029449 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.004922 32123 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.053838 32341 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:18.058137 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.038769 32165 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.059636 32165 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.061308 32354 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.062493 30678 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to <none>, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:18.064430 30678 catalog_manager.cc:5697] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:18.065032 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:18.067380 30779 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:18.069211 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.047564 32080 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.075544 30678 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 3 to 4, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 4 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:18.081534 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 113908us
I20260709 12:22:18.082856 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.084133 32354 raft_consensus.cc:2764] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:18.082561 30678 catalog_manager.cc:5697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.090339 30929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:18.091243 30929 raft_consensus.cc:606] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.091722 30929 raft_consensus.cc:614] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:18.093304 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.085709 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:18.085958 32343 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.094091 32351 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.136335 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:18.140151 32123 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.146140 32276 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.148763 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:18.102185 32198 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:18.154953 30900 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.299s (SENT)
I20260709 12:22:18.099366 30678 catalog_manager.cc:5697] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 3, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.113957 32278 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.155993 32278 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.157823 32351 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.159421 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.116667 32165 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.118522 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.120952 32016 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.161876 30781 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:18.121966 32334 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:18.165252 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.166635 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:18.184960 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 62110.5us
I20260709 12:22:18.187664 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.097129 31810 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.189241 30779 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:18.194613 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.153105 32344 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
W20260709 12:22:18.196044 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 225835us
I20260709 12:22:18.196380 30855 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:18.198033 31477 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.198050 30825 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:18.199036 32085 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:18.160802 32351 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:18.199147 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 44244.5us
I20260709 12:22:18.188593 32080 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.171752 32334 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:18.189879 32343 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:18.219974 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:18.211145 32362 log.cc:927] Time spent T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.220s	user 0.000s	sys 0.004s
I20260709 12:22:18.213881 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.211862 32227 raft_consensus.cc:2804] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:18.211422 32334 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.188913 32016 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.198227 30678 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:18.259209 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 49593.6us
I20260709 12:22:18.261667 32114 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:18.261996 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48190.7us
I20260709 12:22:18.269423 30929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "7857bffc34ce4e1db3617488701b9810"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:18.270841 30929 raft_consensus.cc:606] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Received request to transfer leadership to TS 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:18.271268 30929 raft_consensus.cc:614] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:18.218212 32358 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:18.213423 32080 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.275916 30678 catalog_manager.cc:5697] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 3, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.252538 32227 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.253866 32348 raft_consensus.cc:2764] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:18.286790 30678 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:18.289508 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.248173 32368 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:22:18.268983 32114 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:18.303669 32278 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.305979 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
W20260709 12:22:18.308229 32366 log.cc:927] Time spent T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:22:18.309626 31810 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.287792 32227 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.311231 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.283618 32358 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:18.267635 32198 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.339354 32277 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:18.340119 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:18.341150 32080 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.343523 32358 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.347342 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:18.347739 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 51425.5us
I20260709 12:22:18.348291 32123 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:18.349686 32016 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:18.351531 32371 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.352650 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.352828 32085 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.353590 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:18.375316 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.321910 32114 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.370782 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:18.375761 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.375726 30785 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:18.372260 32123 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.372552 31810 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.392220 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:18.396430 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 49279.1us
I20260709 12:22:18.382892 32341 raft_consensus.cc:2764] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:22:18.385213 32272 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:18.401983 32361 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:22:18.390857 32123 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:18.398914 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:18.368602 32277 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.403293 32272 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:18.410388 32272 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.410542 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.412192 31504 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:18.413484 32368 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:18.414099 32368 raft_consensus.cc:697] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:18.414990 32368 consensus_queue.cc:237] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.378625 32371 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.396546 31810 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.429560 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.385684 32085 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.435022 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.445936 31810 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:18.447309 31810 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:18.440721 32165 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.451195 32371 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:18.450898 32165 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.463898 31810 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:18.471381 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 67934us
I20260709 12:22:18.453713 32165 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:18.474972 30900 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.036s (SENT)
I20260709 12:22:18.475436 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.477818 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:18.482311 31810 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:18.500897 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 59722us
I20260709 12:22:18.489029 32152 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:18.508901 32277 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.510190 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.510622 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:18.511168 30859 raft_consensus.cc:2393] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:18.511598 30928 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:18.514755 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.494033 32351 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:18.489418 32198 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:22:18.517128 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 51458.3us
I20260709 12:22:18.484318 31987 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:22:18.523006 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:18.496532 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:18.532498 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:18.535466 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.539913 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.539572 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.541705 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.525403 32085 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.545296 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.547832 31476 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.548810 32374 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.535574 32165 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:18.534199 32371 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:18.538707 32244 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:18.562879 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.559754 32165 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.566306 32165 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.568044 32341 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.543627 32152 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.573064 32152 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.575438 32152 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:18.555786 32344 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.576673 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:18.576830 32244 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.577611 31504 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:18.579191 32244 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.579818 32244 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.534592 32113 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:22:18.580554 32244 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.581115 32371 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:18.611866 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:18.613816 32391 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:22:18.624995 32165 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.628134 32165 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:18.629443 32389 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:22:18.629904 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:18.630498 32244 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.630661 31504 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.633350 32374 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.634934 32383 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.635701 32371 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.638768 32244 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.609866 32368 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:22:18.610181 32198 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:22:18.646265 32150 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:18.641439 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.651176 32150 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.651801 32227 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.653062 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.654528 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.655402 32331 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:18.655742 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.656347 32344 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.657150 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:18.655779 32331 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.657887 32331 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.648612 32113 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.663812 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.664796 30860 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:18.665719 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:18.666002 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.666465 30859 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.666761 30778 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:18.665639 32150 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.667558 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:18.668140 30776 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.668731 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.669327 30778 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
W20260709 12:22:18.670171 30900 leader_election.cc:336] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.830s (SENT)
I20260709 12:22:18.671427 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.675611 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.676618 30781 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:18.680202 32123 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.682651 32123 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.661700 32383 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.684717 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:18.686578 32383 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.697921 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.704268 32272 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.706076 32085 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.666486 32334 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.707842 30855 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:18.706092 32016 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.710525 32016 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.711910 32152 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.712673 32152 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.715389 32016 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.715684 32152 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.717444 30777 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:18.718974 32272 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.722013 32374 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:18.732143 32383 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.732937 32383 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.662319 32244 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.748744 32244 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.748762 32354 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:18.750140 32354 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:18.750651 32354 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:18.709492 32334 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:18.743462 30785 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:18.744910 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 57326.7us
I20260709 12:22:18.766455 30679 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 2 to 3, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 3 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.768201 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.769835 32358 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:18.770243 32358 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.770632 32358 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.743511 32277 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:22:18.768524 30679 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 3 to 5, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 5 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.751602 32354 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.785709 32114 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.662170 32227 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.777158 32277 raft_consensus.cc:3055] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:18.787516 32277 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:18.785583 32276 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:22:18.786379 32354 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.661397 32343 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 12:22:18.777918 31504 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:18.736709 32383 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.793006 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.784561 32358 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.789264 30679 catalog_manager.cc:5697] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 1 to 3, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 3 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:18.814939 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 203136us
I20260709 12:22:18.815469 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.816901 30679 catalog_manager.cc:5697] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 2 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:18.822796 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.817533 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.801612 30859 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:18.793634 30678 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 202) took 1973 ms. Trace:
W20260709 12:22:18.794996 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 119218us
I20260709 12:22:18.826720 31477 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.826660 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:18.829150 30782 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:18.825695 30899 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:18.833284 31810 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.833956 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:18.827544 30679 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:18.824481 32334 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.815933 32383 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.833262 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:18.844614 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.845122 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.845464 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.827229 32343 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:18.851820 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.825404 30678 rpcz_store.cc:276] 0709 12:22:16.820413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:16.820795 (+   382us) service_pool.cc:224] Handling call
0709 12:22:18.793549 (+1972754us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:18.420794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:18.421459 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:18.421492 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:22:18.421508 (+    16us) tablet.cc:662] Decoding operations
0709 12:22:18.422467 (+   959us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:18.422519 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:18.422567 (+    48us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:18.423402 (+   835us) tablet.cc:701] Row locks acquired
0709 12:22:18.423429 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:22:18.423614 (+   185us) write_op.cc:270] Start()
0709 12:22:18.423750 (+   136us) write_op.cc:276] Timestamp: P: 1783599738423561 usec, L: 0
0709 12:22:18.423772 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:22:18.424639 (+   867us) log.cc:844] Serialized 3580 byte log entry
0709 12:22:18.508580 (+ 83941us) op_driver.cc:464] REPLICATION: finished
0709 12:22:18.529160 (+ 20580us) write_op.cc:301] APPLY: starting
0709 12:22:18.529280 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:18.529585 (+   305us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:18.529775 (+   190us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:18.562203 (+ 32428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:18.598442 (+ 36239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:22:18.601507 (+  3065us) write_op.cc:312] APPLY: finished
0709 12:22:18.621027 (+ 19520us) log.cc:844] Serialized 64 byte log entry
0709 12:22:18.636327 (+ 15300us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:18.636449 (+   122us) write_op.cc:454] Released schema lock
0709 12:22:18.636497 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:18.636892 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:18.636918 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71179,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":20269,"apply.run_cpu_time_us":4178,"apply.run_wall_time_us":107732,"num_ops":8,"prepare.queue_time_us":98944,"prepare.run_cpu_time_us":4253,"prepare.run_wall_time_us":4253,"replication_time_us":84648,"spinlock_wait_cycles":22784,"thread_start_us":97498,"threads_started":2}]]}
I20260709 12:22:18.831318 32123 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:18.839323 32244 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:18.838161 32198 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:18.854895 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.838121 32374 raft_consensus.cc:2804] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:18.846676 32165 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:18.850747 32348 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:18.863353 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:18.865240 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.872606 30855 raft_consensus.cc:2410] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:18.860565 30859 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:18.867776 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.857239 32244 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:18.788883 32277 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:18.869832 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.882272 30858 raft_consensus.cc:2410] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:18.883107 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:18.883962 30853 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:18.885558 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:18.886129 30929 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.886875 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:18.887547 30928 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.888342 32358 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.839404 32351 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:22:18.889154 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:18.873378 30860 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:18.837690 32341 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:22:18.858692 32123 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:18.847810 32383 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.854791 32016 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:22:18.891283 32123 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.892767 32383 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:18.868450 32165 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:18.893895 32165 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.895612 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:18.896247 30855 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.890012 30777 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:18.899091 30780 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:18.901158 30854 raft_consensus.cc:1240] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:18.901844 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.868193 32374 raft_consensus.cc:697] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:18.860148 32198 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:18.907341 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:18.907658 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.907982 30859 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.897617 32244 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.910037 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:18.932228 30856 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.933023 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:18.933569 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:18.933825 30926 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.934232 30934 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:18.841467 32367 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:22:18.936455 32348 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:18.936482 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:18.936899 32276 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:18.937011 32348 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.937407 30854 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
W20260709 12:22:18.889236 30668 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet dd65da5a34854820ae636ab77116f737 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 47c0d0bc235a443aad3c62643e91b081 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:18.938587 30668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 87540.5us
I20260709 12:22:18.872895 32344 consensus_queue.cc:1059] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:22:18.939422 32348 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.939615 32344 raft_consensus.cc:3055] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:18.940896 32331 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:18.947459 30933 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:22:18.948431 30933 pending_rounds.cc:85] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 3
I20260709 12:22:18.948345 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.950356 30932 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:18.950127 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:18.951479 30930 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.959229 30935 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:18.961345 30932 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:18.963922 30929 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:18.965938 30934 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:18.908886 32198 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:18.967059 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:18.907480 32277 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:18.975703 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:18.976889 30777 raft_consensus.cc:2393] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:18.911271 32114 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:18.978901 30854 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 3. Ops: []
I20260709 12:22:18.978917 30855 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:18.948091 32344 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:18.948812 30933 pending_rounds.cc:107] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:22:19.001750 30933 raft_consensus.cc:2917] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 12:22:19.002339 30933 raft_consensus.cc:2889] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:18.995633 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:18.970274 32016 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.004647 30856 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:19.012072 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.012929 30855 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.008814 30859 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:19.008814 30930 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:19.019368 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.019022 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.020076 30854 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:19.024981 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.039049 30856 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:19.045933 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:19.046324 30859 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:19.046590 30930 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:19.047447 30852 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:19.047724 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.048352 30859 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:19.019047 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:19.061329 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:19.056430 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 45669.7us
I20260709 12:22:19.062265 30859 raft_consensus.cc:2410] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:19.064059 30855 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:19.066190 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.014451 32016 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.067948 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.068516 30856 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:19.049021 32343 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.044072 32272 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.084683 30852 raft_consensus.cc:2368] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4.
I20260709 12:22:19.075309 32165 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:19.076674 32080 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.089529 30854 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:19.080394 30776 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:19.046500 32344 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.084034 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:19.056123 32332 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:22:19.085361 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.096827 30930 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:19.097218 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.078511 31505 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:22:19.091359 30855 raft_consensus.cc:2368] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3.
W20260709 12:22:19.097708 30900 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 3.146s (SENT)
I20260709 12:22:19.097941 30859 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:19.111301 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.112623 30854 raft_consensus.cc:2410] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:19.115480 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.116659 30855 raft_consensus.cc:2410] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:19.118614 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.120316 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.121269 30852 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:19.021267 32374 consensus_queue.cc:237] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:19.145875 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:19.146641 30933 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:19.154968 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 110165us
W20260709 12:22:19.155242 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 57571.9us
I20260709 12:22:19.110319 31505 pending_rounds.cc:85] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Aborting all ops after (but not including) 3
I20260709 12:22:19.161293 30856 raft_consensus.cc:1240] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:19.165551 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.167274 30852 raft_consensus.cc:2368] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5.
I20260709 12:22:19.070652 32123 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:19.168634 30900 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.644s (SENT)
I20260709 12:22:19.172298 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:19.167009 30899 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:19.179761 30930 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.180053 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:19.181360 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:19.086896 32343 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.097693 32272 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:19.227912 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 60994.3us
I20260709 12:22:19.214517 30933 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:19.233075 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.165398 32367 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.116441 32114 consensus_queue.cc:1059] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:22:19.113838 32080 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.158121 32150 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.166085 31505 pending_rounds.cc:107] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 12:22:19.240336 30852 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:19.148211 32190 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.165891 32354 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:19.250545 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 94589.8us
I20260709 12:22:19.167850 30927 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:19.252830 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:19.253429 30856 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:19.227402 32331 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.225497 32113 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:22:19.245975 32407 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:19.260130 32403 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:22:19.260895 32165 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:19.263715 32401 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:22:19.263923 32150 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:19.266533 32080 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:19.269114 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.270553 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:19.272935 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.273819 30855 raft_consensus.cc:2410] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:19.185635 32396 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:22:19.307987 30930 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:19.251129 32409 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:19.335559 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.339499 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:19.263783 30928 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:19.277637 31505 raft_consensus.cc:2917] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
W20260709 12:22:19.343818 30900 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.457s (SENT)
W20260709 12:22:19.361989 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 178633us
I20260709 12:22:19.362670 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:19.366995 31987 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:19.375535 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:19.379853 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.252483 32367 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.341382 32334 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.338099 32407 raft_consensus.cc:697] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:19.305882 32354 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.295729 32190 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:19.406303 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 62518.6us
I20260709 12:22:19.370640 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:19.372414 32409 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:19.417357 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.385905 31505 raft_consensus.cc:2889] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:19.459076 32406 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:22:19.457573 32413 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:22:19.640738 32198 consensus_meta.cc:287] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.003s
I20260709 12:22:19.470117 32354 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.405509 32152 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:19.472164 32150 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.473042 32343 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.456696 32394 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:19.474148 32276 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:19.671841 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 294206us
I20260709 12:22:19.672428 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:19.474862 32367 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.400667 32334 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.395166 30776 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:19.614569 30852 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:19.615355 30779 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:19.396189 31507 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:19.475962 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.688074 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:19.688843 30785 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:19.639830 32425 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:19.641141 32413 raft_consensus.cc:697] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:19.470117 32405 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:22:19.655088 32344 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.644358 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:19.672708 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:19.701361 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:19.679558 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 70474.5us
W20260709 12:22:19.702394 30900 leader_election.cc:336] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.672s (SENT)
I20260709 12:22:19.702872 30900 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:19.638664 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.671684 32085 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:19.705801 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:19.707137 30857 raft_consensus.cc:2368] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5.
I20260709 12:22:19.697223 30860 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:19.710037 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.707890 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:19.659021 32198 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.709854 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:19.715188 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.718170 32165 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:19.693799 32272 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.699265 32383 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:19.720651 32383 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.704227 32123 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.724069 32383 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:19.724462 30926 consensus_meta.cc:287] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.006s
I20260709 12:22:19.724843 30926 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:19.724987 30935 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:19.726331 32190 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:19.717299 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:19.718454 32410 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:22:19.785133 30860 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:19.788336 30857 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:19.706645 32367 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:19.783842 30900 leader_election.cc:336] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.897s (SENT)
I20260709 12:22:19.790836 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:19.791558 30857 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:19.791960 30857 pending_rounds.cc:85] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 1
I20260709 12:22:19.792191 30857 pending_rounds.cc:107] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:19.792057 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:19.792956 30857 raft_consensus.cc:2889] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:19.681335 32276 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.726332 32016 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:19.801949 32424 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:19.804324 32424 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:19.804778 32404 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.639s	user 0.000s	sys 0.001s
I20260709 12:22:19.710021 32114 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:19.804896 32424 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.806010 32114 raft_consensus.cc:697] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:19.807101 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.807377 32424 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:19.714041 32085 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.807853 30858 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
W20260709 12:22:19.808262 30900 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 3.241s (SENT)
I20260709 12:22:19.809438 32085 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:19.809991 30900 leader_election.cc:336] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.873s (SENT)
I20260709 12:22:19.810446 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:19.810135 32413 consensus_queue.cc:237] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:19.811614 30900 leader_election.cc:336] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.943s (SENT)
I20260709 12:22:19.812011 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:19.794955 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:19.799692 32277 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.000s
I20260709 12:22:19.788086 32272 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:19.813403 32272 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:19.705578 32407 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:19.798571 31506 raft_consensus.cc:1240] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:19.799566 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.807022 32114 consensus_queue.cc:237] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.817982 31477 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:19.825742 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:19.820852 32424 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:19.832247 32334 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.833350 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.849571 30855 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:19.825246 32016 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:19.836380 30853 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:19.836470 32123 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:19.693017 32394 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:19.818077 32371 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:19.868999 32085 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:19.821486 32425 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:19.870011 32085 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:19.871240 32085 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:19.878955 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.880017 30856 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:19.882175 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.883613 32198 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.884179 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.885205 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:19.816260 32276 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.888090 32227 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:19.888558 32227 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:19.888903 32227 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:19.889120 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.889948 30860 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:19.890801 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.891566 30860 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:19.891759 32430 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:22:19.892419 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.893522 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.895104 30853 raft_consensus.cc:2410] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:19.896447 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.898151 32272 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:19.902408 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 76708.8us
I20260709 12:22:19.893600 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.885421 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:19.915046 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 103468us
I20260709 12:22:19.693898 32409 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:19.923506 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:19.900678 32227 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:19.857437 32190 raft_consensus.cc:2804] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:19.897394 30853 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:19.946307 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.963517 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:19.951758 30900 leader_election.cc:336] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.627s (SENT)
I20260709 12:22:19.964764 30855 raft_consensus.cc:2410] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:19.964579 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:19.968181 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.970669 32408 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:19.967221 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:19.941439 32123 raft_consensus.cc:697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:19.981256 32123 consensus_queue.cc:237] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:19.985157 32429 log.cc:927] Time spent T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:22:19.976123 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.978356 32227 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:19.941937 32371 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:19.979981 30900 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.143s (SENT)
W20260709 12:22:19.950506 32244 consensus_meta.cc:287] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.986s	user 0.009s	sys 0.004s
I20260709 12:22:19.986367 30860 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.950145 31987 raft_consensus.cc:3055] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:19.993840 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.993626 30852 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:19.999356 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.000183 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:19.957010 32190 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.002507 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:19.996256 30855 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:19.949565 32425 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:20.004343 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:20.004913 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 191162us
I20260709 12:22:20.007666 30856 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:20.008625 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.016541 30859 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:20.018206 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.030001 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.031122 30852 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:20.035563 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.036505 32113 consensus_queue.cc:1059] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:20.024494 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.041121 30856 raft_consensus.cc:2376] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
I20260709 12:22:20.045671 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.046496 30856 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:20.047559 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.048888 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.049696 30859 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:20.055999 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.057714 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:20.014607 32190 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:19.998270 31987 raft_consensus.cc:740] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:20.057595 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.068634 30860 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:20.081298 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.028810 32276 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.082260 30855 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:20.084357 30855 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:22:20.084955 30855 pending_rounds.cc:85] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 1
I20260709 12:22:20.085352 30855 pending_rounds.cc:107] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:20.085799 30855 raft_consensus.cc:2889] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:20.040037 32418 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:20.057211 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1149) took 1100 ms. Trace:
I20260709 12:22:20.070866 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.013688 32367 raft_consensus.cc:697] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:20.091173 30860 raft_consensus.cc:1275] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:20.091892 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.046237 32016 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.069377 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:20.092913 32334 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:20.002316 32244 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:20.124152 30856 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:20.095206 32427 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:22:20.122428 30851 rpcz_store.cc:276] 0709 12:22:18.939644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.940245 (+   601us) service_pool.cc:224] Handling call
0709 12:22:18.941015 (+   770us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:18.941658 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:18.941696 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:18.942985 (+  1289us) log.cc:844] Serialized 590 byte log entry
0709 12:22:19.026259 (+ 83274us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:19.044327 (+ 18068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.056302 (+ 11975us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.804039 (+747737us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:19.995144 (+191105us) raft_consensus.cc:1685] finished
0709 12:22:19.997709 (+  2565us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.032224 (+ 34515us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2038,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":17865600,"thread_start_us":66050,"threads_started":1,"wal-append.queue_time_us":124124}
I20260709 12:22:20.131120 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.129607 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.131331 32367 consensus_queue.cc:237] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:20.132277 30860 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:20.132962 32016 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:20.135619 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.136896 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.042006 32337 consensus_queue.cc:1059] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:22:20.140110 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.060634 32198 consensus_queue.cc:1059] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:22:20.141387 30859 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:20.066020 32396 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:22:20.163753 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.165271 30860 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:20.167840 30852 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
W20260709 12:22:20.170269 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 190307us
I20260709 12:22:20.171805 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.174597 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.206717 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:20.207641 30852 raft_consensus.cc:2376] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5. Re-sending same reply.
I20260709 12:22:20.206985 30779 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:20.173888 30853 raft_consensus.cc:2410] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:20.171192 32150 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:20.215113 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.224525 30852 raft_consensus.cc:2376] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5. Re-sending same reply.
I20260709 12:22:20.213461 32016 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:20.198846 32375 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:22:20.218924 32394 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:20.219446 32244 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:20.123539 32276 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:20.136197 32371 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:20.220906 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.222064 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1161) took 1249 ms. Trace:
I20260709 12:22:20.232090 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.169315 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1202) took 1155 ms. Trace:
I20260709 12:22:20.236145 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:20.247871 30860 raft_consensus.cc:2376] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
W20260709 12:22:20.236717 30900 leader_election.cc:336] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 3.015s (SENT)
I20260709 12:22:20.238003 32198 raft_consensus.cc:3055] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:20.239225 30854 rpcz_store.cc:276] 0709 12:22:18.972529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.646886 (+674357us) service_pool.cc:224] Handling call
0709 12:22:19.647350 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.647776 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.647813 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.648358 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.928209 (+279851us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.928275 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.928399 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.221857 (+293458us) raft_consensus.cc:1685] finished
0709 12:22:20.221877 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.222003 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2256,"raft.queue_time_us":1568,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":17254,"thread_start_us":279342,"threads_started":1,"wal-append.queue_time_us":396726}
I20260709 12:22:20.245573 30780 raft_consensus.cc:3055] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:20.259016 30780 raft_consensus.cc:740] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:20.249310 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:20.252498 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.253515 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.246188 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.287168 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:20.287875 30782 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.291334 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.292388 30929 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:20.298096 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:20.298413 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:20.299027 30930 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.299333 30777 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:20.304523 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.230583 32150 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:20.310844 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:20.315480 30785 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:20.315546 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 78883.7us
I20260709 12:22:20.285884 30780 consensus_queue.cc:260] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:20.316251 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:20.316809 30900 leader_election.cc:336] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.729s (SENT)
I20260709 12:22:20.317199 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:20.173866 31987 consensus_queue.cc:260] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:20.319828 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:20.321239 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:20.322016 30929 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.323525 30899 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:20.161518 32425 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:20.258664 32198 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:20.330089 30780 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.285144 32424 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:20.339891 30826 connection.cc:256] RPC call timeout handler was delayed by -1.582226714999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 12:22:20.347803 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:20.348187 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 267053us
I20260709 12:22:20.368048 30930 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:20.369541 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:20.348569 32435 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:22:20.336301 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.383641 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.388958 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.392961 30780 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:22:20.367046 32383 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:20.403395 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:20.396060 30934 raft_consensus.cc:2393] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:20.368239 31987 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.371275 32085 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:20.412034 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.410069 30856 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:20.413091 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:20.414229 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.417371 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:20.418489 30934 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:20.427899 30929 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
W20260709 12:22:20.430826 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 122169us
W20260709 12:22:20.429463 32364 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:22:20.435035 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:20.438480 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.376461 32337 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:22:20.443338 30930 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.445362 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:20.443498 30929 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:20.409722 32383 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:20.454159 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:20.457252 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:20.383183 32113 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:22:20.429472 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:20.470192 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 160466us
I20260709 12:22:20.477130 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:20.437824 32331 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:20.489426 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:20.490263 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 173465us
I20260709 12:22:20.495604 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.504443 30934 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:20.505826 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:20.506676 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.512898 30930 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:20.514834 30930 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:20.516616 30930 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:20.519671 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:20.520341 30929 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.459028 32383 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:20.459348 32343 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:20.467252 32334 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:20.467399 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:20.552718 32343 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:20.416694 32198 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:20.561034 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1212) took 1397 ms. Trace:
W20260709 12:22:20.563024 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 239097us
I20260709 12:22:20.553057 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:20.569128 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 61622.7us
I20260709 12:22:20.575405 30932 rpcz_store.cc:276] 0709 12:22:19.163311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.648875 (+485564us) service_pool.cc:224] Handling call
0709 12:22:19.649214 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.670814 (+ 21600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.670863 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.681203 (+ 10340us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.937521 (+256318us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.937582 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.937696 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:20.560720 (+623024us) raft_consensus.cc:1685] finished
0709 12:22:20.560750 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.560947 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5304,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":19727,"thread_start_us":229892,"threads_started":1,"wal-append.queue_time_us":325149}
W20260709 12:22:20.584661 30900 leader_election.cc:336] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.760s (SENT)
I20260709 12:22:20.581101 30929 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:20.585206 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:20.587231 30930 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:22:20.589921 30899 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:20.592835 30900 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.789s (SENT)
I20260709 12:22:20.258930 30931 rpcz_store.cc:276] 0709 12:22:18.994984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.010628 (+ 15644us) service_pool.cc:224] Handling call
0709 12:22:19.086013 (+ 75385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.224267 (+138254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.227146 (+  2879us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.357437 (+130291us) log.cc:844] Serialized 26 byte log entry
0709 12:22:19.670641 (+313204us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:19.680173 (+  9532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:19.692157 (+ 11984us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:19.984310 (+292153us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:20.097208 (+112898us) raft_consensus.cc:1685] finished
0709 12:22:20.097244 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.142012 (+ 44768us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26577,"raft.queue_time_us":51132,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":47240,"spinlock_wait_cycles":21250944,"thread_start_us":229670,"threads_started":1,"wal-append.queue_time_us":388200}
I20260709 12:22:20.623768 32334 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:20.624785 32334 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:20.628715 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 151710us
I20260709 12:22:20.631713 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:20.633114 32343 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:20.635185 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:20.636590 32343 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:20.637282 32343 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:20.638425 32343 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:20.644613 30826 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:20.592658 30927 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.654018 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:20.537292 32331 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:20.599825 32424 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:20.695866 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.660678 32198 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:20.708990 30782 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:20.667930 32150 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:20.676354 32424 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:20.722682 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:20.711015 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:20.742220 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:20.761288 32412 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:22:20.751163 32394 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:20.716766 32016 consensus_queue.cc:1059] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 12:22:20.765916 30933 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.011s	sys 0.042s
I20260709 12:22:20.702948 32080 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
W20260709 12:22:20.880229 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 138146us
W20260709 12:22:20.915285 30933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.012s	sys 0.042s
I20260709 12:22:20.916196 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:20.916606 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1209) took 1919 ms. Trace:
I20260709 12:22:20.918068 30900 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:20.746008 32371 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:20.885244 30785 consensus_meta.cc:287] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.566s	user 0.015s	sys 0.000s
I20260709 12:22:20.933102 30785 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:20.738997 32343 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:20.949496 30852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.024s
I20260709 12:22:20.730494 32424 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:20.939345 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:20.917214 30933 rpcz_store.cc:276] 0709 12:22:18.997178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.244116 (+246938us) service_pool.cc:224] Handling call
0709 12:22:19.244370 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:19.244569 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:19.677416 (+432847us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.916070 (+1238654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:20.916150 (+    80us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:20.916226 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.916348 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:20.916525 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":403255,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":1640011,"threads_started":2}
I20260709 12:22:20.934583 30899 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:20.932476 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 967) took 1051 ms. Trace:
I20260709 12:22:20.967950 30853 rpcz_store.cc:276] 0709 12:22:19.880994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.967833 (+ 86839us) service_pool.cc:224] Handling call
0709 12:22:20.760680 (+792847us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54004371d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:20.911672 (+150992us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397276032}
W20260709 12:22:20.968639 32447 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.376s	user 0.000s	sys 0.000s
I20260709 12:22:20.969039 32080 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:20.877051 30931 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:20.765498 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:20.934458 32244 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:20.933899 32418 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:20.912148 32375 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:20.763916 32464 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.482s
I20260709 12:22:21.004154 32113 raft_consensus.cc:3055] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:22:21.165963 30860 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.014s	sys 0.071s
W20260709 12:22:21.166479 30860 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.071s
W20260709 12:22:21.147014 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 493835us
I20260709 12:22:21.172214 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:21.160146 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 225480us
W20260709 12:22:21.078276 32451 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 12:22:21.076861 32394 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.003746 32465 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:21.179654 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:21.238579 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.231714 30926 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:21.156246 32422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.107s	sys 0.114s
I20260709 12:22:21.175933 32113 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:21.175246 32343 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:21.267350 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.012s
W20260709 12:22:21.308739 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.013s	sys 0.013s
W20260709 12:22:21.309743 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.310293 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.251320 32244 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:21.319482 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 401493us
I20260709 12:22:21.320835 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.242117 32348 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.330873 32348 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:21.300092 32422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.107s	sys 0.115s
I20260709 12:22:21.334873 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.291764 32465 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
W20260709 12:22:21.307418 32449 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.430s	user 0.000s	sys 0.001s
I20260709 12:22:21.377643 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:21.377868 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:21.177186 32375 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.392236 32485 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.394177 32375 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.395308 32465 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.358135 32334 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.342720 32244 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:21.341581 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 971) took 1075 ms. Trace:
I20260709 12:22:21.399749 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:21.368695 32343 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.395838 32464 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:21.410109 31477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.000s	sys 0.014s
W20260709 12:22:21.427556 31477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.000s	sys 0.015s
W20260709 12:22:21.427979 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 939585us
W20260709 12:22:21.446481 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 266919us
I20260709 12:22:21.447458 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:21.458388 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 79227.7us
W20260709 12:22:21.459707 30823 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.006s	sys 0.001s
I20260709 12:22:21.406761 32422 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:21.494762 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 63263us
I20260709 12:22:21.500259 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1175) took 1083 ms. Trace:
I20260709 12:22:21.436693 32348 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.453116 32491 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:21.512924 30860 rpcz_store.cc:276] 0709 12:22:20.416893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.417094 (+   201us) service_pool.cc:224] Handling call
0709 12:22:20.417451 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:20.417706 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:21.166941 (+749235us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.499826 (+332885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.499897 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:21.499960 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.500052 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.500197 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":364,"prepare.queue_time_us":552028,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":16559,"raft.queue_time_us":63994,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":1067994,"threads_started":3}
I20260709 12:22:21.460901 32334 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:21.515340 30823 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.008s	sys 0.001s
W20260709 12:22:21.537863 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 160297us
I20260709 12:22:21.540417 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.500561 32344 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.541893 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.542567 32491 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:21.543524 30929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.003s	sys 0.010s
W20260709 12:22:21.549744 30929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.003s	sys 0.011s
I20260709 12:22:21.405771 30926 rpcz_store.cc:276] 0709 12:22:20.251571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.260085 (+  8514us) service_pool.cc:224] Handling call
0709 12:22:20.765274 (+505189us) spinlock_profiling.cc:243] Waited 4.88 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:21.317036 (+551762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11217664}
I20260709 12:22:21.453284 32464 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:21.555835 31475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.000s	sys 0.038s
W20260709 12:22:21.569866 31475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.000s	sys 0.039s
I20260709 12:22:21.578567 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.444698 32113 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:21.590860 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.603112 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:21.554425 32474 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.605779 32420 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.555748 32422 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:21.607784 32420 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:21.608675 32487 log.cc:927] Time spent T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:22:21.608949 32448 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.523s	user 0.000s	sys 0.002s
I20260709 12:22:21.560657 32442 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:22:21.609227 32422 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:21.609905 32475 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:22:21.562069 32493 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 12:22:21.611008 32460 raft_consensus.cc:2764] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:21.580256 32485 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.610509 32442 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:21.566119 32343 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.635160 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:21.635418 32506 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:21.636036 30852 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:21.586155 32334 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:21.637094 32446 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.585s	user 0.000s	sys 0.006s
I20260709 12:22:21.638401 32331 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:21.638857 32479 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:22:21.639063 32331 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.639174 32442 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.636040 32506 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:21.639972 31987 consensus_meta.cc:287] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.223s	user 0.013s	sys 0.000s
I20260709 12:22:21.640275 32506 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.638000 32334 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.641896 32490 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.642366 32490 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.644460 32490 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.539791 32244 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:21.649923 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 143390us
I20260709 12:22:21.604601 32394 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:21.604895 32348 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:21.614885 32113 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:21.641533 32442 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:21.663291 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 84863.3us
I20260709 12:22:21.554046 32491 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.688155 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.639681 32331 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.673556 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:21.708907 30826 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:21.640545 30776 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:21.650507 32343 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.733901 30853 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:21.617367 32474 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.674211 32348 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.718783 32442 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:21.730566 32198 consensus_meta.cc:287] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.010s	user 0.006s	sys 0.006s
I20260709 12:22:21.751729 32464 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.752744 32464 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.753044 32497 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.661019 32485 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.765995 32198 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:21.766587 32198 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.767575 32485 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.767838 32513 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:21.768296 32417 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:21.768100 32442 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.768695 32198 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.768445 32513 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.769985 32467 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.770483 32442 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:21.771449 32491 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:21.765642 32348 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:21.773582 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:21.754580 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 86) took 1269 ms. Trace:
I20260709 12:22:21.746871 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:21.753544 32464 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.755975 32514 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:21.755867 32497 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.757262 32511 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.757725 32331 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.758668 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1218) took 1360 ms. Trace:
I20260709 12:22:21.761565 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 941) took 2099 ms. Trace:
I20260709 12:22:21.761742 32515 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.762041 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1011) took 1452 ms. Trace:
I20260709 12:22:21.762488 32502 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.763443 32474 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.763958 32490 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.812096 32331 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:21.779003 32509 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.812041 32490 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.780284 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49608 (request call id 69) took 2702 ms. Trace:
I20260709 12:22:21.812968 32331 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.764173 32473 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:21.764928 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:21.753664 30927 consensus_meta.cc:287] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.097s	user 0.010s	sys 0.003s
W20260709 12:22:21.807710 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:21.782229 32513 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:21.819188 32490 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.809787 32502 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:21.798130 30933 rpcz_store.cc:276] 0709 12:22:20.398741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.963941 (+565200us) service_pool.cc:224] Handling call
0709 12:22:20.964314 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.072321 (+108007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.072378 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.128784 (+ 56406us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.415773 (+286989us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:21.415840 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.415957 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.758382 (+342425us) raft_consensus.cc:1685] finished
0709 12:22:21.758412 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.758603 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":306571,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":32717,"thread_start_us":178894,"threads_started":1,"wal-append.queue_time_us":471789}
I20260709 12:22:21.798416 32511 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.814698 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 984) took 1554 ms. Trace:
I20260709 12:22:21.778066 30859 rpcz_store.cc:276] 0709 12:22:20.485299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.485454 (+   155us) service_pool.cc:224] Handling call
0709 12:22:20.485931 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.575023 (+ 89092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.575055 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.575935 (+   880us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.002216 (+426281us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:21.002267 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.002362 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.754316 (+751954us) raft_consensus.cc:1685] finished
0709 12:22:21.754341 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.754502 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105420,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":15846,"thread_start_us":446745,"threads_started":2,"wal-append.queue_time_us":1150938}
I20260709 12:22:21.830436 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:21.831291 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:21.807307 30778 rpcz_store.cc:276] 0709 12:22:20.309824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.309977 (+   153us) service_pool.cc:224] Handling call
0709 12:22:20.310411 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.337315 (+ 26904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.337346 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.338021 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.881258 (+543237us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:20.881299 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.881370 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.761830 (+880460us) raft_consensus.cc:1685] finished
0709 12:22:21.761851 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.761984 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82751,"raft.queue_time_us":18695,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":24608,"thread_start_us":493561,"threads_started":1,"wal-append.queue_time_us":1387135}
I20260709 12:22:21.831357 30859 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:21.838500 30860 raft_consensus.cc:2410] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:21.827253 30929 rpcz_store.cc:276] 0709 12:22:20.317386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.588826 (+271440us) service_pool.cc:224] Handling call
0709 12:22:20.593294 (+  4468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.627073 (+ 33779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.627124 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:20.629622 (+  2498us) log.cc:844] Serialized 26 byte log entry
0709 12:22:21.550734 (+921112us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:21.588163 (+ 37429us) log.cc:844] Serialized 14 byte log entry
0709 12:22:21.588401 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.588587 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.814454 (+225867us) raft_consensus.cc:1685] finished
0709 12:22:21.814475 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.814630 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215081,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":211075,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":38316,"spinlock_wait_cycles":28455680,"thread_start_us":846738,"threads_started":2,"wal-append.queue_time_us":1078738}
I20260709 12:22:21.840396 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:21.841285 30859 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.768715 32417 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:21.800011 32464 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:21.792404 32190 consensus_meta.cc:287] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 1.696s	user 0.014s	sys 0.001s
I20260709 12:22:21.844180 32331 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:21.843966 32417 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.794713 32085 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:21.811057 30853 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:21.802738 30857 rpcz_store.cc:276] 0709 12:22:19.662019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.800290 (+138271us) service_pool.cc:224] Handling call
0709 12:22:19.800615 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.800983 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.801013 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.801479 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.245065 (+443586us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:20.414304 (+169239us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.432462 (+ 18158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.432538 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.761308 (+1328770us) raft_consensus.cc:1685] finished
0709 12:22:21.761331 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.761488 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18501,"prepare.queue_time_us":507250,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":22068,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":7837,"thread_start_us":590762,"threads_started":2,"wal-append.queue_time_us":1956164}
I20260709 12:22:21.847885 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:21.797717 32497 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.865499 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:21.867585 30857 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:21.868856 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:21.827236 32383 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.260s	user 0.012s	sys 0.002s
I20260709 12:22:21.866335 30781 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:21.819410 30927 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:21.844192 32190 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:21.862653 32085 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:21.813504 30928 rpcz_store.cc:276] 0709 12:22:19.078365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.407238 (+328873us) service_pool.cc:224] Handling call
0709 12:22:21.779996 (+2372758us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54000b7054. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a25735 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54 00007f960ef61be2 00007f960ef61b11 00007f960ef61a8c 00007f960ef60d42 00007f960ed5a48c 00007f960ed598c6
0709 12:22:21.780190 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080481536}
I20260709 12:22:21.903342 30932 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:21.877810 32417 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:21.903908 32085 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.765745 32506 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.915940 32438 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:21.902254 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 975) took 1646 ms. Trace:
I20260709 12:22:21.809366 32515 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:21.905584 32424 consensus_meta.cc:287] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.001s
I20260709 12:22:21.903445 32442 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:21.881698 32383 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:21.925940 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 252474us
I20260709 12:22:21.920552 31506 raft_consensus.cc:1240] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 4. Ops: []
I20260709 12:22:21.928390 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.931460 30934 raft_consensus.cc:2393] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:21.926038 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:21.936023 30859 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:21.941095 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 943) took 2227 ms. Trace:
I20260709 12:22:21.937721 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:21.921738 30927 rpcz_store.cc:276] 0709 12:22:20.255839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.499866 (+244027us) service_pool.cc:224] Handling call
0709 12:22:21.895130 (+1395264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:21.926105 32424 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.935593 30926 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:21.926792 32442 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.955639 30858 rpcz_store.cc:276] 0709 12:22:19.714144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.808778 (+ 94634us) service_pool.cc:224] Handling call
0709 12:22:19.809130 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:19.809493 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:19.809521 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:19.817598 (+  8077us) log.cc:844] Serialized 26 byte log entry
0709 12:22:20.028692 (+211094us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:20.331162 (+302470us) log.cc:844] Serialized 14 byte log entry
0709 12:22:20.331784 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.332481 (+   697us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:21.938516 (+1606035us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b1800383380. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:21.940767 (+  2251us) raft_consensus.cc:1685] finished
0709 12:22:21.940861 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.941008 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5974,"prepare.queue_time_us":573042,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":62,"raft.queue_time_us":6576,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":25830,"spinlock_wait_cycles":17519488,"thread_start_us":454871,"threads_started":2,"wal-append.queue_time_us":857334}
I20260709 12:22:21.935837 32500 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:21.941891 32491 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:21.939826 32383 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:21.939414 32425 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:21.966864 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.963425 30855 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:21.938949 32190 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:21.974152 30900 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:21.926580 32438 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:21.976835 32424 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:21.976928 32515 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:21.977403 32438 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:21.978044 32425 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:21.978837 32494 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:22:21.979005 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1228) took 1524 ms. Trace:
I20260709 12:22:21.961416 32481 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:21.916113 31504 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:21.959908 32503 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:21.932399 32509 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:22:21.999392 30858 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:21.951588 32467 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:22:21.998421 32383 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:21.941880 32514 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:22:21.977692 32424 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:22.002452 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:22.012140 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:22.002281 32503 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:22.014263 32502 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:22:22.021509 32521 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.022859 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:22.023699 30935 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:22.024132 30935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 982) took 1764 ms (client timeout 1675 ms). Trace:
W20260709 12:22:22.024518 30935 rpcz_store.cc:269] 0709 12:22:20.259385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.332562 (+ 73177us) service_pool.cc:224] Handling call
0709 12:22:22.022678 (+1690116us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:22.024062 (+  1384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9289984}
I20260709 12:22:22.009661 32334 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:22.026321 30668 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet dd65da5a34854820ae636ab77116f737 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:22.019003 32491 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:22.030778 32521 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:21.989952 30927 rpcz_store.cc:276] 0709 12:22:20.454456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.964870 (+1510414us) service_pool.cc:224] Handling call
0709 12:22:21.978395 (+ 13525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.978607 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.978645 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:21.978706 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:21.978747 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:21.978822 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:21.978942 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.031680 32521 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.032799 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1230) took 1536 ms. Trace:
I20260709 12:22:22.033241 30927 rpcz_store.cc:276] 0709 12:22:20.496522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.031849 (+1535327us) service_pool.cc:224] Handling call
0709 12:22:22.032202 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.032419 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.032446 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.032490 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:22.032534 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.032600 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.032727 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.034539 32521 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:21.938287 30853 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:22.035009 32425 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:22.035612 32080 raft_consensus.cc:3055] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:22.042996 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:22.044396 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:22.038250 32511 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.036026 32080 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:22.038655 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1229) took 1577 ms. Trace:
I20260709 12:22:22.048756 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:22.108807 30785 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.108448 30935 rpcz_store.cc:276] 0709 12:22:20.461318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.025346 (+1564028us) service_pool.cc:224] Handling call
0709 12:22:22.025658 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.037998 (+ 12340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.038041 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.038119 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:22.038164 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.038256 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.038593 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:22.048682 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:22.019961 32503 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:21.974159 32500 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.037292 32506 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:22.038568 32502 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:22.130712 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:22.129843 30785 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:22.001209 32481 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:22.114238 31475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.019s
I20260709 12:22:22.026342 32334 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:22.122822 32465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.007s	sys 0.015s
I20260709 12:22:22.117921 32424 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:22.138020 31475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.005s	sys 0.019s
W20260709 12:22:22.143982 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 196008us
W20260709 12:22:22.196935 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:22.182942 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 350047us
W20260709 12:22:22.142071 32465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.015s
I20260709 12:22:22.137630 32502 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:22.133642 32514 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:22.161443 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.137504 32509 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:22.223471 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1225) took 1786 ms. Trace:
I20260709 12:22:22.140852 32244 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.229853 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:22.237125 30929 rpcz_store.cc:276] 0709 12:22:20.436727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.839600 (+1402873us) service_pool.cc:224] Handling call
0709 12:22:21.872744 (+ 33144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.873019 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:21.894209 (+ 21190us) log.cc:844] Serialized 14 byte log entry
0709 12:22:22.222951 (+328742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.223038 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:22.223098 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.223200 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.223386 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22446,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":73520,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3272,"thread_start_us":253498,"threads_started":1}
W20260709 12:22:22.249202 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.250658 30857 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 1.
I20260709 12:22:22.251375 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:22.254125 30857 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:22.201503 32442 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.255676 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:22.145519 32424 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.259537 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.260414 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:22.266820 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 136207us
I20260709 12:22:22.255837 32383 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:22.255088 32511 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.327745 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.172379 32080 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.256047 32244 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.262218 32364 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:22.254940 32227 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:22.257541 32198 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:22.300966 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1226) took 1849 ms. Trace:
W20260709 12:22:22.347276 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 60637.3us
I20260709 12:22:22.248490 32514 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.347162 30857 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:22.252326 32509 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:22:22.387001 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 128681us
I20260709 12:22:22.400034 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:22.379590 32526 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:22:22.424896 30935 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:22.397917 32198 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:22.441185 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 209442us
I20260709 12:22:22.418488 30927 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:22.447736 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:22.451227 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:22.458668 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.384459 32511 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.463377 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:22.466209 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:22.432384 32080 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.470093 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:22.471156 30858 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:22.403537 32227 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:22.445454 32198 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:22.489050 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:22.493999 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:22.508831 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 110163us
I20260709 12:22:22.469789 32538 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.444039 32515 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:22.457840 32508 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:22.518874 30826 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.67:38729 timed out after 1.969s (SENT) [suppressed 28 similar messages]
I20260709 12:22:22.545259 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:22.524780 30852 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:22.549152 30826 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:22.471791 32522 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:22:22.462883 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:22.533595 30929 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:22.549314 31503 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:22.564991 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:22.565405 32525 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 12:22:22.581123 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 181206us
I20260709 12:22:22.538610 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:22.536586 32334 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.566414 31509 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:22.548359 32383 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:22.544296 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1220) took 2144 ms. Trace:
I20260709 12:22:22.605444 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.608601 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:22.556666 32515 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.630689 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.580534 32364 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:22.665421 30929 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:22.670810 30852 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
W20260709 12:22:22.630492 32536 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:22:22.556496 32538 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:22.609812 32334 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:22.631248 32527 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.337s	user 0.001s	sys 0.001s
W20260709 12:22:22.668854 32533 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 12:22:22.561717 32508 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.609748 32343 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.608804 32424 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:22.625172 32519 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:22:22.624516 32539 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:22.630837 32524 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.628136 32502 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:22.714977 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.728127 30929 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:22.695538 32549 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:22.729332 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.730110 30929 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
W20260709 12:22:22.731206 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.731882 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:22.713733 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 180031us
I20260709 12:22:22.669035 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:22.703547 32481 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.717670 32227 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:22.736052 31504 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 12:22:22.736234 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:22.737314 30853 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 12:22:22.744310 30929 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:22.748603 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.722909 32244 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:22.750253 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.751384 30929 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:22.752393 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.738058 32509 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:22.740552 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:22.753139 30929 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
W20260709 12:22:22.782341 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 233298us
I20260709 12:22:22.403714 30928 rpcz_store.cc:276] 0709 12:22:20.444765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.916855 (+1472090us) service_pool.cc:224] Handling call
0709 12:22:21.928744 (+ 11889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.935255 (+  6511us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:21.967307 (+ 32052us) log.cc:844] Serialized 14 byte log entry
0709 12:22:22.252715 (+285408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:22.255121 (+  2406us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:22.260134 (+  5013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.285120 (+ 24986us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.293958 (+  8838us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75645,"prepare.queue_time_us":12222,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":3169,"raft.queue_time_us":106772,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5457,"thread_start_us":169909,"threads_started":1,"wal-append.queue_time_us":353867}
I20260709 12:22:22.730723 32539 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.796350 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:22.785135 32509 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:22.791221 32511 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.806599 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.781585 32547 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:22.738870 32524 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.751211 32514 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:22.804546 32537 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 12:22:22.817710 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:22.809968 32085 consensus_meta.cc:287] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.002s
I20260709 12:22:22.811520 32538 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:22.812279 32515 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:22.797731 32529 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 12:22:22.810612 32547 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.830139 32085 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.830853 32276 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.832187 32547 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.832358 32085 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:22.809011 32534 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:22:22.834497 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:22.835124 32524 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:22.824122 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.836293 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1189) took 1056 ms. Trace:
I20260709 12:22:22.836683 30860 rpcz_store.cc:276] 0709 12:22:21.772109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.773302 (+  1193us) service_pool.cc:224] Handling call
0709 12:22:22.827853 (+1054551us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b5400075b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:22.828010 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143532928}
I20260709 12:22:22.840648 32539 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:22.841925 32508 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:22.842737 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.749830 32364 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.846046 30860 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:22.841962 31507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42836 (request call id 167) took 1149 ms. Trace:
I20260709 12:22:22.844064 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.810557 32509 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:22.853250 31505 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:22.850311 31507 rpcz_store.cc:276] 0709 12:22:21.722088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.734501 (+ 12413us) service_pool.cc:224] Handling call
0709 12:22:21.746423 (+ 11922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.746833 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.746873 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.803442 (+ 56569us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.256297 (+452855us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:22.260283 (+  3986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.284152 (+ 23869us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.836048 (+551896us) raft_consensus.cc:1685] finished
0709 12:22:22.838005 (+  1957us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.841873 (+  3868us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26044,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":374988,"threads_started":1,"wal-append.queue_time_us":676744}
W20260709 12:22:22.853940 31505 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42838 (request call id 84) took 2409 ms (client timeout 1546 ms). Trace:
W20260709 12:22:22.854331 31505 rpcz_store.cc:269] 0709 12:22:20.479386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.496778 (+ 17392us) service_pool.cc:224] Handling call
0709 12:22:22.834323 (+2337545us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800023498. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:22.853846 (+ 19523us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25529600}
W20260709 12:22:22.856595 32503 consensus_meta.cc:287] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.001s
I20260709 12:22:22.858704 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1219) took 2459 ms. Trace:
I20260709 12:22:22.859129 30934 rpcz_store.cc:276] 0709 12:22:20.399280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.505399 (+106119us) service_pool.cc:224] Handling call
0709 12:22:22.858455 (+2353056us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002143d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:22.858602 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3276476160}
I20260709 12:22:22.859906 32509 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:22.860427 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.861163 30934 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:22.861917 30928 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:22.605909 30931 rpcz_store.cc:276] 0709 12:22:20.399684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.299109 (+899425us) service_pool.cc:224] Handling call
0709 12:22:21.363337 (+ 64228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.633812 (+270475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.646923 (+ 13111us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.731792 (+ 84869us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.133045 (+401253us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:22.136065 (+  3020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.141566 (+  5501us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:22.467648 (+326082us) raft_consensus.cc:1685] finished
0709 12:22:22.470913 (+  3265us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:22.535555 (+ 64642us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15725,"raft.queue_time_us":276647,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":27334,"thread_start_us":503548,"threads_started":2,"wal-append.queue_time_us":389918}
I20260709 12:22:22.857138 32503 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:22.870800 30776 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32970 (request call id 91) took 2720 ms (client timeout 1983 ms). Trace:
I20260709 12:22:22.873888 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.887807 30934 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:22.781095 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.889071 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.890100 30934 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:22.890960 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:22.893832 30934 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:22.894407 32198 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:22.908174 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 299636us
I20260709 12:22:22.909147 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:22.922079 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:22.922521 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:22.887375 30776 rpcz_store.cc:269] 0709 12:22:20.150068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.174612 (+ 24544us) service_pool.cc:224] Handling call
0709 12:22:22.870580 (+2695968us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540005d554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:22.870701 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3222737152}
I20260709 12:22:22.926890 32509 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:22.934104 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:22.959867 30900 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:22.965931 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 232660us
I20260709 12:22:22.967033 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:22.967694 30860 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:22.973141 30935 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:22.932463 32491 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:22.978199 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:22.979020 30860 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:22.962344 32558 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:22.963268 32539 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:22.964092 32394 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:23.003480 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:22.961951 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:22.974934 32452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.520s	user 0.007s	sys 0.013s
W20260709 12:22:23.012483 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.011456 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.015998 30935 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:23.017257 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:23.018232 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:23.019891 30935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:22.965024 32524 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:22:23.000516 32425 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:23.010624 32452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.565s	user 0.008s	sys 0.014s
I20260709 12:22:23.022310 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.026866 30860 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:23.006295 30931 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:23.014498 32272 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:23.010679 30927 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:23.030484 30900 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:23.017007 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:23.034121 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.036158 30860 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:23.024282 32545 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:23.040231 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:23.025503 32509 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:23.044499 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.042503 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:23.047521 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.031407 32272 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:23.054158 32272 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:23.041445 32545 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.050704 32423 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:22:23.055505 32545 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.057489 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 983) took 2797 ms. Trace:
I20260709 12:22:23.058106 30930 rpcz_store.cc:276] 0709 12:22:20.260034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.543754 (+283720us) service_pool.cc:224] Handling call
0709 12:22:20.586922 (+ 43168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:20.587819 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.051192 (+2463373us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b540027c250. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:23.057347 (+  6155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98257280}
I20260709 12:22:23.058787 32417 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.059262 32417 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.059636 32417 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.061457 32442 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:23.063774 32556 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:22:23.066713 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.067960 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.069120 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.034989 31504 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42836 (request call id 168) took 1226 ms. Trace:
I20260709 12:22:23.071060 32423 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:23.061677 32441 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:22:23.070449 31504 rpcz_store.cc:276] 0709 12:22:21.821213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.862073 (+ 40860us) service_pool.cc:224] Handling call
0709 12:22:21.906756 (+ 44683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.915950 (+  9194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:22.749710 (+833760us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.015653 (+265943us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.024019 (+  8366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:23.024096 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:23.024157 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.026218 (+  2061us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.032969 (+  6751us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4032,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3044,"raft.queue_time_us":5157,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":13709,"spinlock_wait_cycles":2866048,"thread_start_us":224971,"threads_started":1}
I20260709 12:22:23.071702 32423 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.075856 32423 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.076236 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:23.076879 30931 raft_consensus.cc:2376] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5. Re-sending same reply.
I20260709 12:22:23.077275 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.077888 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.078531 30931 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:23.079356 32481 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:23.079672 30931 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:23.081008 30934 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:23.081104 30931 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:23.082289 30857 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:23.082577 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:23.035786 32539 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.086831 32539 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:23.086862 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:23.087387 32539 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.088413 32481 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:23.088526 32368 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.089329 32368 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:23.091367 32503 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.091499 32368 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.092223 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.092926 30855 raft_consensus.cc:2376] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4. Re-sending same reply.
I20260709 12:22:23.094340 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.052096 32562 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:22:23.088878 32481 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:23.049141 30860 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:23.118124 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.119071 30860 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:23.120528 30860 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:23.122068 30860 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:23.034178 32198 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.011049 32558 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:23.099788 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59681us
W20260709 12:22:23.154488 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 44107.3us
I20260709 12:22:23.153414 30857 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:23.163851 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.165108 30859 raft_consensus.cc:2410] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:23.047983 32509 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.030566 32425 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.168818 32423 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 12:22:23.168982 30668 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet dd65da5a34854820ae636ab77116f737 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:23.169827 32413 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:23.170459 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.190446 30855 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.170468 32442 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:23.151329 32481 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.048338 31507 raft_consensus.cc:2376] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4. Re-sending same reply.
I20260709 12:22:23.108965 32525 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:23.094501 32383 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.179417 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:23.151358 32503 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:23.196547 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.206000 32503 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:23.206522 30927 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:23.209321 32425 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.181816 32408 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:23.210271 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:23.210093 32408 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:23.212548 32530 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.831s	user 0.000s	sys 0.002s
I20260709 12:22:23.214063 31507 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:23.214625 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.215483 30858 raft_consensus.cc:2410] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:23.215989 32515 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:23.216672 30858 raft_consensus.cc:1275] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:23.218366 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1224) took 2786 ms. Trace:
W20260709 12:22:23.218801 32471 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 2.042s	user 0.005s	sys 0.000s
I20260709 12:22:23.199627 30935 raft_consensus.cc:606] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.201043 32558 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.202292 32525 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.179145 32509 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.206558 32503 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.218422 30859 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:23.218945 30933 rpcz_store.cc:276] 0709 12:22:20.432288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.835944 (+1403656us) service_pool.cc:224] Handling call
0709 12:22:21.836434 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:21.836922 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:21.836997 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:21.837921 (+   924us) log.cc:844] Serialized 26 byte log entry
0709 12:22:22.138350 (+300429us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:22.138407 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:22.138484 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.211966 (+1073482us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:23.218035 (+  6069us) raft_consensus.cc:1685] finished
0709 12:22:23.218061 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.218284 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8589,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2094,"spinlock_wait_cycles":6243584,"thread_start_us":253662,"threads_started":1,"wal-append.queue_time_us":356924}
I20260709 12:22:23.220465 30935 raft_consensus.cc:614] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:23.199169 32491 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:23.221060 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 65925us
I20260709 12:22:23.197988 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:23.250136 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1174) took 2835 ms. Trace:
W20260709 12:22:23.253345 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 55621.3us
I20260709 12:22:23.253391 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:23.254998 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:23.253823 30856 rpcz_store.cc:276] 0709 12:22:20.415155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.415391 (+   236us) service_pool.cc:224] Handling call
0709 12:22:20.415817 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:20.432770 (+ 16953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:20.432816 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:20.439930 (+  7114us) log.cc:844] Serialized 52 byte log entry
0709 12:22:20.584822 (+144892us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:20.584874 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:20.584959 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:23.218192 (+2633233us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:23.219992 (+  1800us) raft_consensus.cc:1685] finished
0709 12:22:23.220014 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.250039 (+ 30025us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16464,"raft.queue_time_us":19980,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":12991,"spinlock_wait_cycles":40733440,"thread_start_us":89573,"threads_started":1,"wal-append.queue_time_us":304837}
I20260709 12:22:23.212582 32408 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.265301 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.266396 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.266956 30856 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:23.267966 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.269325 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.290385 32408 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:23.293439 32413 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:23.294014 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.294595 31507 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:23.294950 32413 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:23.295481 32413 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:23.262545 31987 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:23.298108 31987 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:23.298552 31987 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:23.299831 32545 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.296406 32413 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.302353 32425 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:23.302896 32425 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:23.303260 32525 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.233296 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:23.303283 32425 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:23.310046 32516 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:23.310509 32516 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:23.310921 32516 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.264856 32383 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.312521 32383 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.312923 32383 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.255685 32491 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.321084 30855 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:23.322064 30858 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:23.322454 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:23.323257 32244 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:23.296555 32481 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.325163 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.335069 30858 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:23.341940 32397 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 12:22:23.344236 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:23.344599 32420 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.344976 31505 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
W20260709 12:22:23.345518 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 144237us
I20260709 12:22:23.323952 32491 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.339809 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.356269 30855 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:23.336447 32244 raft_consensus.cc:697] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:23.378595 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.380385 30858 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.364910 30899 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.382174 30899 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.383828 32244 consensus_queue.cc:237] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.349946 32408 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:22:23.387585 32408 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:23.387915 32417 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:23.345059 32368 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.389883 32276 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:23.390264 32368 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.381142 32538 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.392398 32538 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.394263 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.337431 32545 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.397866 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.327171 32272 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.356860 32558 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:23.410677 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.405442 32408 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:23.413141 32408 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:23.413503 32408 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:23.417948 32420 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:23.381628 32441 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:23.390444 32276 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.350230 32539 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.397805 32515 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:23.396981 32085 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:23.437206 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.438337 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.439908 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:23.440488 30855 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:23.441004 30858 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:23.429243 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:23.444322 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:23.461727 30855 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:23.464955 31477 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:23.422308 32408 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.468021 32276 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.468837 31505 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:23.479903 32420 raft_consensus.cc:2804] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:23.473263 30930 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.480499 32420 raft_consensus.cc:697] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:23.480803 32481 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.428732 32558 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.482373 31987 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.482908 32539 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.444128 32509 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.483771 32558 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.484433 31987 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.485116 32509 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.481618 32420 consensus_queue.cc:237] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.475023 32425 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.444643 32515 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.487260 32425 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.487439 32515 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.435453 32441 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.489673 32441 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.493548 32516 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.495909 32516 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.455627 32417 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.497640 32408 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.451989 32085 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:23.498775 32085 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.504273 32408 consensus_queue.cc:1059] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:23.505401 32408 consensus_queue.cc:1243] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 7857bffc34ce4e1db3617488701b9810 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:23.505832 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1223) took 3093 ms. Trace:
I20260709 12:22:23.430552 32383 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.493492 32272 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.518352 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:23.506423 30926 rpcz_store.cc:276] 0709 12:22:20.412757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.606056 (+1193299us) service_pool.cc:224] Handling call
0709 12:22:21.637098 (+ 31042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.966248 (+329150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.505468 (+1539220us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54000b6154. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:23.505724 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669622528}
I20260709 12:22:23.522891 32503 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.523790 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.525285 32503 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.505903 32509 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:22:23.568068 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:23.530630 32509 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:23.525326 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.674669 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:23.568086 32515 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.529400 32500 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.567761 32374 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:23.576812 32539 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:23.578039 32545 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:23.735345 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 353224us
I20260709 12:22:23.687071 32408 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.681322 32383 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.746863 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:23.681993 30853 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.007s	sys 0.015s
I20260709 12:22:23.685698 32407 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:23.681747 32272 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:23.701495 32371 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.578039 32491 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.684516 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.750242 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.750880 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.760186 30777 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.761490 30781 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:23.704958 30926 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:23.746315 31987 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:23.749847 30853 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.007s	sys 0.015s
I20260709 12:22:23.704734 32515 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:23.838146 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 267154us
I20260709 12:22:23.838723 30783 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:23.844924 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.846282 30933 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.825968 32396 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.785384 32383 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:23.810539 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.739519 32545 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.747987 32539 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.855780 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:23.857496 32581 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:22:23.870555 32515 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.873235 32491 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.784237 32509 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.749444 32408 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.880007 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.883889 30854 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:23.786083 32407 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.808175 32272 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.843250 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1235) took 1779 ms. Trace:
I20260709 12:22:23.842281 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:23.887722 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 190274us
I20260709 12:22:23.825357 32371 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.843624 31987 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.906965 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.912103 30777 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:23.912314 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.907696 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.908428 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.913339 31987 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.909026 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.907745 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.914836 30781 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:23.909814 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.915606 30926 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:23.884858 32383 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.916630 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.916877 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1005) took 1460 ms. Trace:
I20260709 12:22:23.917069 30855 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:23.909930 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.917239 30852 rpcz_store.cc:276] 0709 12:22:22.456613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.463079 (+  6466us) service_pool.cc:224] Handling call
0709 12:22:23.916694 (+1453615us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b54003bea54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:23.916820 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136594688}
I20260709 12:22:23.918303 30780 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:23.917630 32383 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:23.911369 32407 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:23.915959 32582 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:23.919677 32368 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.920212 32368 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.921306 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.921904 32409 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.922652 30781 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:23.922401 32409 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.923233 32454 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:23.923768 32454 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.924154 30783 raft_consensus.cc:1240] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.924554 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 986) took 3589 ms. Trace:
I20260709 12:22:23.924693 32409 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.880540 32396 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:23.924937 30932 rpcz_store.cc:276] 0709 12:22:20.335137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.606723 (+271586us) service_pool.cc:224] Handling call
0709 12:22:21.884982 (+1278259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.903977 (+ 18995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.924382 (+2020405us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002238d0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:23.924494 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2938660608}
I20260709 12:22:23.925998 32454 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.926265 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.922713 32423 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:23.926883 30932 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:23.927811 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.927377 32423 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.928534 32272 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.928905 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.930694 32423 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.922501 32562 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:23.931854 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.932446 31506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42836 (request call id 166) took 3493 ms. Trace:
I20260709 12:22:23.932209 32562 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:23.932842 31506 rpcz_store.cc:276] 0709 12:22:20.467659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.502143 (+ 34484us) service_pool.cc:224] Handling call
0709 12:22:20.552024 (+ 49881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.931381 (+1379357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.932179 (+2000798us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54005212d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:23.932362 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116031872}
I20260709 12:22:23.934350 32562 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:23.934764 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.935448 30784 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:23.899477 30928 rpcz_store.cc:276] 0709 12:22:22.063090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.894606 (+831516us) service_pool.cc:224] Handling call
0709 12:22:22.895098 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:22.895355 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:23.041028 (+145673us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.824568 (+783540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:23.824661 (+    93us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:23.824749 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:23.833239 (+  8490us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:23.833403 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273538,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":38,"raft.queue_time_us":2889,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":817638,"threads_started":3,"wal-append.queue_time_us":402193}
I20260709 12:22:23.937702 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.938997 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:23.940582 32590 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:22:23.926980 32396 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:23.943513 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:23.967574 30782 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:23.957116 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.952381 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:23.917477 30926 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:23.953202 30785 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:23.945354 30781 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:23.953933 30934 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
W20260709 12:22:24.032482 32577 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 12:22:24.047464 30784 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:24.047837 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.048555 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.098774 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:23.972710 30931 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:24.102257 30932 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:24.015467 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.035281 32539 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.106199 30852 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:23.922451 32368 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:24.105906 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 162482us
I20260709 12:22:23.972317 32498 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.119096 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.123464 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.124361 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:24.103331 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:24.128751 32584 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:22:24.128911 32371 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:24.132828 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.134155 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.128782 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.139317 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1253) took 1043 ms. Trace:
I20260709 12:22:24.139736 30933 rpcz_store.cc:276] 0709 12:22:23.096190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.233935 (+137745us) service_pool.cc:224] Handling call
0709 12:22:23.255669 (+ 21734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.846728 (+591059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.139003 (+292275us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54002ba554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:24.139248 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357577600}
I20260709 12:22:24.127377 32545 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.126775 32598 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.135625 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.148775 30933 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:24.149282 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1256) took 1052 ms. Trace:
I20260709 12:22:24.149535 30933 rpcz_store.cc:276] 0709 12:22:23.097152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.148221 (+1051069us) service_pool.cc:224] Handling call
0709 12:22:24.148532 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.149102 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.149242 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:24.152416 32408 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.138105 32538 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.162917 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.166743 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.163789 30784 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:24.152446 32334 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:24.162401 32469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.698s	user 0.014s	sys 0.018s
I20260709 12:22:24.205741 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.161382 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:24.241364 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.178915 32334 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:24.288733 32334 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:24.250766 32591 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:22:24.290019 32334 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:24.229851 32469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.795s	user 0.015s	sys 0.018s
I20260709 12:22:24.292224 32598 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.252051 31477 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:24.294308 30860 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:24.231642 32538 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.245689 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.340580 30783 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
W20260709 12:22:24.340799 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 45238.1us
W20260709 12:22:24.345358 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.361061 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:24.365994 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.339510 32597 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.377856 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36358 (request call id 5) took 1359 ms. Trace:
I20260709 12:22:24.381263 30935 rpcz_store.cc:276] 0709 12:22:23.016795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.019757 (+  2962us) service_pool.cc:224] Handling call
0709 12:22:24.376065 (+1356308us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400222ed4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a19853 00007f96159e760a 00007f960ef6d7d4 00007f960ef6d762 00007f960ef6d691 00007f960ef6d60c 00007f960ef6c8c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:24.376190 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411865472}
I20260709 12:22:24.378340 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.388015 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.377981 32420 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:24.361627 32538 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.381703 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1258) took 1281 ms. Trace:
I20260709 12:22:24.394129 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:24.395807 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.396277 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.399979 30927 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:24.400728 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1250) took 1338 ms. Trace:
I20260709 12:22:24.401886 32394 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:24.392648 32420 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:24.402838 32420 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.397732 32486 consensus_queue.cc:1059] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:22:24.397926 32524 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:22:24.407142 32538 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:24.421386 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 60426.3us
I20260709 12:22:24.401095 30927 rpcz_store.cc:276] 0709 12:22:23.062440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.207504 (+145064us) service_pool.cc:224] Handling call
0709 12:22:24.399536 (+1192032us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:24.399757 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.400449 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.400655 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58863488}
I20260709 12:22:24.405750 30926 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:24.410007 32085 raft_consensus.cc:3055] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:24.410144 32016 raft_consensus.cc:3055] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:24.431933 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.428632 32506 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.409287 32486 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:22:24.407902 32588 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:22:24.409825 32524 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:22:24.428242 32085 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:24.429352 32016 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:24.431486 32539 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.434943 30927 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:24.393805 30931 rpcz_store.cc:276] 0709 12:22:23.105897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.151344 (+1045447us) service_pool.cc:224] Handling call
0709 12:22:24.229457 (+ 78113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.339305 (+109848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:24.358946 (+ 19641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:24.366729 (+  7783us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:24.367727 (+   998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.371496 (+  3769us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.378976 (+  7480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:24.448079 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 994) took 1866 ms. Trace:
I20260709 12:22:24.450361 30930 rpcz_store.cc:276] 0709 12:22:22.581511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.060125 (+478614us) service_pool.cc:224] Handling call
0709 12:22:23.060482 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.480475 (+419993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.447840 (+967365us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400262fd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:24.448022 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948681088}
I20260709 12:22:24.441303 32506 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.447997 32588 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.454645 30927 raft_consensus.cc:606] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:24.468713 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.454823 32539 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:24.474407 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.475548 32408 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:24.475998 32408 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:24.476802 32408 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.477743 32420 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:24.464927 32588 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.479915 32420 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:24.464564 32085 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.481531 32085 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.483873 32486 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.484396 32486 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.488480 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:24.488826 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:24.490710 32486 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.492688 32588 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.495061 32506 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.495896 32539 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:24.498237 32469 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:24.499148 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:24.498996 32469 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.475582 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.501104 32469 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:24.498221 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:24.502803 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:24.502943 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:24.503703 32469 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:24.504150 32469 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:24.504598 32469 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.504634 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:24.501292 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.505424 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:24.509263 32113 raft_consensus.cc:1064] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
W20260709 12:22:24.509694 32113 raft_consensus.cc:1068] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Unable to promote non-voter 7857bffc34ce4e1db3617488701b9810: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:24.510826 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:24.502825 32408 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.525939 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.528343 32509 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.529453 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.550019 30780 raft_consensus.cc:2368] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5.
I20260709 12:22:24.551047 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.530041 32469 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:24.530915 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.534140 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.537693 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.511569 30926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:24.605422 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:24.652860 30781 raft_consensus.cc:3060] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.551730 30780 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:24.650542 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:24.655474 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.657249 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:24.657307 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.658959 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.659247 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.659619 30932 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:24.660085 30931 raft_consensus.cc:2410] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:24.660693 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.661002 32542 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.661489 32542 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.663625 32542 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.664131 32542 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.664753 32542 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:24.668584 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.670244 30779 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:24.673550 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.675277 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.679139 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:24.680845 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:24.684055 30779 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:24.603557 32113 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.604177 32418 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.686493 30777 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:24.693452 30780 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:22:24.711683 32538 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:24.722931 30779 raft_consensus.cc:3055] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:24.723393 30779 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:24.711942 32113 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:24.727741 32542 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.686518 32407 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:24.728461 32407 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.728880 32407 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:24.660743 32486 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:24.732293 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 63442.6us
W20260709 12:22:24.735112 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 66487.5us
I20260709 12:22:24.738529 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:24.676844 32588 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.740276 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:24.741503 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.742504 30781 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
W20260709 12:22:24.742462 30826 connection.cc:256] RPC call timeout handler was delayed by -1.1414837840002292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:22:24.745415 30826 connection.cc:256] RPC call timeout handler was delayed by -1.1135837840001841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 12:22:24.745851 30826 connection.cc:256] RPC call timeout handler was delayed by -1.1117837840001812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:22:24.690382 32408 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:24.747942 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1212) took 1478 ms. Trace:
I20260709 12:22:24.757671 30780 raft_consensus.cc:1275] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:24.730057 31508 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:24.752153 30856 rpcz_store.cc:276] 0709 12:22:23.269495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.270697 (+  1202us) service_pool.cc:224] Handling call
0709 12:22:23.271008 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:23.271457 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:23.271507 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:23.322065 (+ 50558us) log.cc:844] Serialized 52 byte log entry
0709 12:22:23.678595 (+356530us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:23.733341 (+ 54746us) log.cc:844] Serialized 14 byte log entry
0709 12:22:24.730368 (+997027us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b180035e5a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:22:24.734471 (+  4103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.734571 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:24.734628 (+    57us) raft_consensus.cc:1685] finished
0709 12:22:24.747726 (+ 13098us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.747881 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52341,"prepare.queue_time_us":55850,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2526,"raft.queue_time_us":1013727,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":204,"spinlock_wait_cycles":5128448,"thread_start_us":315663,"threads_started":1,"wal-append.queue_time_us":504537}
W20260709 12:22:24.781324 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:24.750361 32442 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:24.792671 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.786504 32558 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.787060 32500 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.721779 32602 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:22:24.756034 32554 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:24.731575 32418 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:24.781627 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 69622.6us
I20260709 12:22:24.750083 32123 consensus_queue.cc:1059] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:22:24.765111 32588 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.808408 30929 raft_consensus.cc:1275] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:24.808957 32588 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.809134 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1237) took 2745 ms. Trace:
I20260709 12:22:24.770668 32408 raft_consensus.cc:697] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:24.810101 32500 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.810621 32408 consensus_queue.cc:237] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.811550 32016 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.812254 32500 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:24.812549 32016 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:24.812801 32500 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:24.814311 32600 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:24.814708 32600 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:24.815687 30783 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:24.815536 32600 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.816700 32600 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.816864 30783 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.809585 30929 rpcz_store.cc:276] 0709 12:22:22.063694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.206241 (+1142547us) service_pool.cc:224] Handling call
0709 12:22:24.458482 (+1252241us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:24.807781 (+349299us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fae9c 00007f960d8faa5b 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:24.808010 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:24.808868 (+   858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.809074 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41655808}
I20260709 12:22:24.809511 30926 raft_consensus.cc:606] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:24.823982 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.831737 30899 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:24.751883 32486 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.755575 32601 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:22:24.834440 32539 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.836432 30899 leader_election.cc:400] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5.
I20260709 12:22:24.848359 30899 leader_election.cc:403] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:24.764062 32427 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:22:24.813330 32500 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.799135 32442 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:24.769788 32498 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:22:24.851049 30899 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:24.858767 30899 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:24.847082 32538 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:24.826969 30926 raft_consensus.cc:614] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:24.865687 32538 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.868193 32016 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:24.880940 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1214) took 1610 ms. Trace:
W20260709 12:22:24.879487 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 128042us
I20260709 12:22:24.881845 30858 rpcz_store.cc:276] 0709 12:22:23.270041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.446301 (+176260us) service_pool.cc:224] Handling call
0709 12:22:23.446682 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.446950 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:23.447329 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 12:22:24.880396 (+1433067us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:24.880511 (+   115us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:24.880585 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.880708 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.880871 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":889665,"prepare.queue_time_us":5196,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":892273,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":9080,"thread_start_us":542396,"threads_started":2,"wal-append.queue_time_us":672516}
I20260709 12:22:24.876422 32016 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.899537 32397 consensus_queue.cc:1059] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:24.900645 32198 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:24.860286 32442 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:24.900781 32616 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:24.804147 32558 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.916903 32558 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:24.907840 30929 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:24.852375 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1003) took 2396 ms. Trace:
I20260709 12:22:24.859395 32394 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:24.910719 30932 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:24.912871 32469 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:24.913599 32085 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:24.907976 32609 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:24.914302 32418 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:24.914919 32620 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.919641 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:24.903388 32554 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:24.937300 32113 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:24.946488 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48393.7us
I20260709 12:22:24.908658 32408 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:24.855440 32539 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:24.968039 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0541837840000881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 12:22:24.968617 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0473941860004743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 12:22:24.968767 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49912.5us
I20260709 12:22:24.965381 32620 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:24.948623 32609 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:24.949836 32554 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:24.944036 32394 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.008895 32394 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.011857 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.012797 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 1033) took 1078 ms. Trace:
I20260709 12:22:25.013125 30776 rpcz_store.cc:276] 0709 12:22:23.943574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.998973 (+ 55399us) service_pool.cc:224] Handling call
0709 12:22:25.011677 (+1012704us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:25.012728 (+  1051us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140722560}
I20260709 12:22:24.940960 32334 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:24.941471 32516 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:24.951718 32558 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:24.948575 32615 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:25.006093 32609 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:24.943823 32276 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.013530 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1185) took 3349 ms. Trace:
I20260709 12:22:25.017609 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.020336 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:25.021179 32394 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.046600 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.047832 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.048031 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:25.169950 30852 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.023138 30931 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:22:25.077383 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 78603.8us
I20260709 12:22:25.082340 30860 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.167678 30929 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:25.049445 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.162683 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.172925 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.183934 30857 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.184022 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.184530 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1009) took 1149 ms. Trace:
I20260709 12:22:25.184901 30785 rpcz_store.cc:276] 0709 12:22:24.035607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.040213 (+  4606us) service_pool.cc:224] Handling call
0709 12:22:25.172754 (+1132541us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:25.184467 (+ 11713us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14959872}
I20260709 12:22:25.183426 30933 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:25.187084 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1259) took 2080 ms. Trace:
I20260709 12:22:25.187434 30933 rpcz_store.cc:276] 0709 12:22:23.106442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.151263 (+1044821us) service_pool.cc:224] Handling call
0709 12:22:25.182850 (+1031587us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:25.183118 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:25.186800 (+  3682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.187027 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2845568}
I20260709 12:22:25.035260 32516 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:25.049098 32276 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.178705 32614 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:25.170771 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 122844us
I20260709 12:22:25.170153 30858 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:25.179822 32618 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:22:25.233071 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.233326 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.023679 32515 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:25.195601 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.195879 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.196799 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.196853 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.236059 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.178929 32465 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:25.236536 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.076568 32612 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:25.246361 32612 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:25.050774 32615 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.246853 32612 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:25.246953 32625 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:25.238150 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 97) took 1857 ms. Trace:
I20260709 12:22:25.239758 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.034889 32334 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.242772 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.209183 32614 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:25.253450 30854 rpcz_store.cc:276] 0709 12:22:23.380527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.892757 (+512230us) service_pool.cc:224] Handling call
0709 12:22:23.893043 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:23.893184 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:23.942983 (+ 49799us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.097162 (+1154179us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800035920. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf23a 00007f9610a29a2a
0709 12:22:25.237794 (+140632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.237857 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:25.237899 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.237972 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.238092 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49684,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":6086,"raft.queue_time_us":815,"spinlock_wait_cycles":25471872,"thread_start_us":139530,"threads_started":1}
I20260709 12:22:25.274269 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.275044 30854 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:25.239028 30929 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:25.258074 30852 raft_consensus.cc:2410] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:25.269193 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.253386 30859 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:25.276589 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.280143 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.280793 30852 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:25.281996 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.283721 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.284435 30852 raft_consensus.cc:2410] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:22:25.285073 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.285573 30852 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:25.208746 32394 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.287253 32620 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.249452 32615 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:25.289865 32500 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.291132 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:25.237066 32486 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.271869 32276 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.040141 32558 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.299599 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.296865 30857 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
W20260709 12:22:25.266537 32407 consensus_meta.cc:287] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 12:22:25.302650 30778 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.320996 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.307964 30860 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.244483 32465 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:25.297163 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:25.315994 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 61046us
W20260709 12:22:25.317505 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 77832.8us
I20260709 12:22:25.319084 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.329687 30857 raft_consensus.cc:2410] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:25.319623 30933 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:25.270021 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:25.324110 30929 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:25.279306 32614 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.252312 32515 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.320055 32615 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.330725 30854 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:25.330751 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.337011 30826 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:25.344854 32394 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.344986 30857 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:25.345616 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.346068 32276 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:25.346987 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.347276 32276 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:25.347749 32276 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:25.348181 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.348711 32276 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.350996 32016 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5.
I20260709 12:22:25.352550 32539 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:25.352780 32509 consensus_meta.cc:287] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.002s
I20260709 12:22:25.326411 32407 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.353525 30935 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:22:25.353930 30935 pending_rounds.cc:85] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 4
I20260709 12:22:25.354221 30935 pending_rounds.cc:107] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:22:25.354540 30935 raft_consensus.cc:2889] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.360153 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.360767 32508 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.361245 32508 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.361594 32508 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.361793 32554 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.362299 30826 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.362957 32554 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.363543 32276 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.363931 32465 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.365149 32465 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:25.340611 32615 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:25.366122 32615 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.366322 32500 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:25.366860 32500 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:25.367285 32500 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.367439 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.042241 30853 rpcz_store.cc:276] 0709 12:22:21.664352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:21.902380 (+238028us) service_pool.cc:224] Handling call
0709 12:22:21.917239 (+ 14859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:21.936533 (+ 19294us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:22.751413 (+814880us) log.cc:844] Serialized 14 byte log entry
0709 12:22:23.204368 (+452955us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b48000ce7d8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:22:23.845499 (+641131us) log.cc:844] Serialized 14 byte log entry
0709 12:22:24.897674 (+1052175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:24.902111 (+  4437us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:24.907335 (+  5224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.013209 (+105874us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b540012e654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:25.013278 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.013450 (+   172us) inbound_call.cc:177] Queueing success response
0709 12:22:25.015700 (+  2250us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003080e0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
Metrics: {"mutex_wait_us":916720,"prepare.queue_time_us":174177,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":920763,"raft.run_cpu_time_us":2463,"raft.run_wall_time_us":178167,"spinlock_wait_cycles":52374912,"thread_start_us":1003539,"threads_started":3,"wal-append.queue_time_us":337891,"wal-append.run_cpu_time_us":1963,"wal-append.run_wall_time_us":1782982}
I20260709 12:22:25.370805 30860 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:25.371649 30858 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
W20260709 12:22:25.356600 32600 consensus_meta.cc:287] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.539s	user 0.014s	sys 0.000s
I20260709 12:22:25.302817 32516 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.311213 32611 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:22:25.356026 32622 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.384361 32622 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.385905 32637 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:25.386381 32637 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.386727 32637 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.390116 32442 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.390717 32611 consensus_queue.cc:1243] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:25.392468 32442 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.411590 32609 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.413646 30929 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:25.417994 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.348834 30931 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:25.424288 32516 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.422354 32016 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.385537 32508 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:25.459638 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 97409.9us
I20260709 12:22:25.448935 32334 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.461575 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:25.437371 32500 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.468624 32407 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.468746 32636 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:22:25.469568 30853 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.471652 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1215) took 2201 ms. Trace:
I20260709 12:22:25.472052 30855 rpcz_store.cc:276] 0709 12:22:23.270334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:23.475982 (+205648us) service_pool.cc:224] Handling call
0709 12:22:23.916847 (+440865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:23.917523 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.471458 (+1553935us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54003bea50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:25.471591 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012867328}
I20260709 12:22:25.473117 32427 raft_consensus.cc:3055] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:25.473517 32427 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:25.474381 32427 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.475605 32427 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.475385 32600 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:25.476215 32561 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.476646 32469 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:25.475417 32615 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.479781 32500 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:25.480387 30856 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:25.480772 32515 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:25.481554 32632 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:22:25.463521 32558 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.482445 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.461360 32016 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.483817 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:24.937799 30851 rpcz_store.cc:276] 0709 12:22:22.453999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:22.714857 (+260858us) service_pool.cc:224] Handling call
0709 12:22:22.745564 (+ 30707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:22.794947 (+ 49383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:22.796677 (+  1730us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:22.805896 (+  9219us) log.cc:844] Serialized 26 byte log entry
0709 12:22:23.020480 (+214584us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:23.940974 (+920494us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b18001269a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf
0709 12:22:23.941187 (+   213us) log.cc:844] Serialized 14 byte log entry
0709 12:22:24.794362 (+853175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:24.801000 (+  6638us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:24.803027 (+  2027us) raft_consensus.cc:1685] finished
0709 12:22:24.832749 (+ 29722us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:24.850804 (+ 18055us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":905265,"prepare.queue_time_us":172755,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":857706,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":1913,"spinlock_wait_cycles":22267648,"thread_start_us":268247,"threads_started":2,"wal-append.queue_time_us":414874,"wal-append.run_cpu_time_us":2662,"wal-append.run_wall_time_us":1736879}
I20260709 12:22:25.485075 32615 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:25.485035 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.485289 30926 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:25.488364 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.494179 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:25.499046 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.499588 32545 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:25.499501 32636 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:25.465806 32334 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.489738 30779 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.503847 30779 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.513613 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.507822 32554 raft_consensus.cc:2804] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:25.503051 32545 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:25.503319 32334 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.522496 32554 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:25.538313 32554 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:25.541141 32628 log.cc:927] Time spent T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.189s	user 0.000s	sys 0.002s
I20260709 12:22:25.543864 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.534049 32334 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.545984 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:25.516444 32615 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:22:25.512718 30931 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:25.552081 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.553362 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.566332 30931 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:22:25.569471 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.570197 32509 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.570788 32509 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.514451 32198 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:22:25.555162 32609 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.506924 32600 consensus_queue.cc:1059] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:22:25.574060 32600 raft_consensus.cc:3055] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:25.509874 32442 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:22:25.574505 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:25.549491 32508 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.575601 32601 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:25.576311 32508 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:25.558774 32545 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.576651 32601 consensus_queue.cc:1059] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:25.561851 32638 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.573066 32509 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.573046 30779 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:25.575385 32609 consensus_queue.cc:1059] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:25.579160 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1021) took 1208 ms. Trace:
I20260709 12:22:25.579737 32638 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:25.579638 30779 rpcz_store.cc:276] 0709 12:22:24.370616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.722523 (+351907us) service_pool.cc:224] Handling call
0709 12:22:24.722814 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.489231 (+766417us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b4c00079140. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960eceba20 00007f960ecfca29 00007f960ecc2644 00007f960ece9f2d 00007f960ece9b93 00007f9610a1a18b 00007f9610a1acb5 00007f9610a15f30 00007f9610a177de 00007f9610a21b49 00007f9610a22416
0709 12:22:25.578847 (+ 89616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.579089 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63184640}
I20260709 12:22:25.577097 32545 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.582049 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:25.585613 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:25.586596 30780 raft_consensus.cc:606] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:25.587046 30780 raft_consensus.cc:614] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:25.588863 32609 raft_consensus.cc:3055] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:25.589350 32609 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:25.589171 32612 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.574468 32600 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:25.590618 32609 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.591182 32600 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.591881 32612 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.592190 32609 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.592499 32600 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.593221 32622 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:25.589921 32637 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.589159 32614 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.597570 32614 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.579360 32554 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.600447 32554 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:25.592938 32334 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.602943 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:25.603750 32420 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:25.604200 32420 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:25.604282 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.605011 30776 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:25.605419 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:25.605839 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.606093 30783 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.607050 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.608611 30777 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:25.609840 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.611150 30782 raft_consensus.cc:2410] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:22:25.611944 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 270660us
I20260709 12:22:25.604223 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.613688 30781 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:25.605049 30785 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:25.616984 30783 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:25.618158 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:25.618752 30931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd831e647294525a980327a839a575d"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:25.619473 30931 raft_consensus.cc:606] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:25.619891 30931 raft_consensus.cc:614] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:25.620007 32637 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.620307 30930 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:25.620926 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.621258 32638 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.622668 32638 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:25.623106 32638 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:25.623942 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.627414 30854 raft_consensus.cc:3055] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:25.627867 30854 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:25.628654 30854 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.630300 30825 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.635422 30929 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:25.638057 30825 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.523204 32016 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:25.640307 30930 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:25.640733 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.643103 30854 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.644263 30825 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:25.645375 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 63403.3us
I20260709 12:22:25.646507 30826 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.650547 32615 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:25.650840 32334 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.651086 32615 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:25.652777 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.654162 30825 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.585964 30933 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.658931 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.659632 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.660953 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.651671 32615 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.665637 32539 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:25.666347 32638 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:25.668725 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.668951 32638 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.662758 30783 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:25.669551 30783 pending_rounds.cc:85] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 1
I20260709 12:22:25.669934 30783 pending_rounds.cc:107] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:25.670287 30783 raft_consensus.cc:2889] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.671255 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1008) took 1654 ms. Trace:
I20260709 12:22:25.671686 30778 rpcz_store.cc:276] 0709 12:22:24.017287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.671286 (+653999us) service_pool.cc:224] Handling call
0709 12:22:25.302468 (+631182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.326139 (+ 23671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.671024 (+344885us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54001a6b50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:25.671185 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450686720}
I20260709 12:22:25.579506 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:25.664207 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.643852 32612 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.663173 32334 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.675129 32614 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.676867 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.678121 30931 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:25.651954 32636 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.678849 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.679004 32636 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:25.679352 30931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:25.680034 30825 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.680034 30826 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:25.680109 32515 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.576711 32508 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:25.684793 32638 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:25.685515 32508 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.685701 32638 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:25.686218 32638 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.684114 30825 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.661746 32558 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.682242 32276 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.692358 30825 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.654794 32601 raft_consensus.cc:3055] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:25.694339 30778 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:25.690930 30899 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:25.697113 32603 consensus_queue.cc:1048] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:25.695289 32637 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.702004 32607 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.701514 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.706634 30825 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.702486 32607 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:25.704286 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:25.710268 30779 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:25.696362 32558 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.695834 32601 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:25.715256 30899 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:25.716045 30825 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.718670 30852 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:25.721280 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.743235 30860 raft_consensus.cc:2410] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:25.724022 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.744765 30858 raft_consensus.cc:2393] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:25.732170 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.744948 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.745805 30855 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:25.743594 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:25.747059 30783 raft_consensus.cc:2376] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4. Re-sending same reply.
W20260709 12:22:25.752666 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.752526 30825 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.741518 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 110) took 2172 ms. Trace:
I20260709 12:22:25.756157 30935 rpcz_store.cc:276] 0709 12:22:23.569002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.388211 (+819209us) service_pool.cc:224] Handling call
0709 12:22:24.388460 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.355006 (+966546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.741146 (+386140us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54001c7fd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:25.741428 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218668800}
I20260709 12:22:25.764520 30935 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:25.772862 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.605235 32420 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.774910 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.775081 30825 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.774984 30854 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:22:25.777633 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 141810us
W20260709 12:22:25.783102 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.713670 32500 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:25.714192 32607 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.707811 32637 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.711522 32276 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.808290 32276 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.809070 32276 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:25.735498 30933 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:25.708180 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.809566 32276 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.787591 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.795389 32638 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:25.811968 32276 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.812390 32638 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:25.812562 32276 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:25.797999 32611 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:22:25.802834 30785 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:22:25.739622 32622 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:25.805709 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:25.816009 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 244387us
I20260709 12:22:25.847914 30859 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.774593 32334 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.774035 32545 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:25.799351 32500 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:25.841568 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.834061 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 46582us
I20260709 12:22:25.799026 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.776566 32558 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.774243 32588 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:22:25.813901 32637 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:25.862887 30785 pending_rounds.cc:85] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:22:25.874634 30785 pending_rounds.cc:107] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:25.875005 30785 raft_consensus.cc:2889] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.876390 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.884049 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.877246 30855 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:25.889635 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.892359 30854 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:25.893676 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.895402 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.896675 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.851009 32622 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:25.898955 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 381966us
I20260709 12:22:25.899821 30854 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:25.901409 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.902403 30854 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:25.903219 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.860641 32500 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:25.917464 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.865855 32545 raft_consensus.cc:697] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:25.924445 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:25.928129 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:25.887154 32637 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.934206 30900 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:25.933501 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:25.936349 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:25.927723 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:25.939325 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.939884 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:25.911046 32622 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:25.941073 30900 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.915172 32465 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.946017 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.951416 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:25.953994 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:25.849465 32601 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:25.955288 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:25.956218 30854 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:25.957219 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:25.953168 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 104100us
I20260709 12:22:25.957947 30854 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:25.960100 30780 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:25.960635 30780 pending_rounds.cc:85] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 1
I20260709 12:22:25.960966 30780 pending_rounds.cc:107] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:25.961510 30780 raft_consensus.cc:2889] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:25.963624 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.964682 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:25.965930 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 190950us
I20260709 12:22:25.938021 30931 raft_consensus.cc:606] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:25.960912 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:25.967738 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:25.972651 30855 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:25.913383 32407 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:22:25.981927 30854 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:25.967922 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 108384us
I20260709 12:22:25.914011 32554 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:22:25.945266 32016 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:25.969905 30859 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:25.945204 32516 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:25.941882 32509 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:25.990621 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:25.965224 32394 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:25.992688 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:26.002633 30825 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:25.958815 32506 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:25.981734 30931 raft_consensus.cc:614] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:25.964990 32198 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:25.953380 32627 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:25.942663 32442 consensus_queue.cc:1059] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:22:25.969274 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1262) took 1059 ms. Trace:
I20260709 12:22:25.970813 32561 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:26.008388 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.010397 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.011327 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.965426 32624 consensus_queue.cc:1059] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:22:26.020007 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:25.994707 32469 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.012367 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.018970 30782 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:26.017688 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:25.996419 32588 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:25.997469 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:26.022637 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 61979.7us
I20260709 12:22:26.016865 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.025681 30784 raft_consensus.cc:2410] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:26.031042 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.032119 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.032227 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.033666 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.034198 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:26.035173 32650 log.cc:927] Time spent T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:22:26.035475 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.006903 32655 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:22:26.038151 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:26.007139 32652 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.039285 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.012125 32558 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:22:26.039959 30852 raft_consensus.cc:2376] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
W20260709 12:22:26.040658 31474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.040967 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.026062 32644 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:26.042066 32644 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.043717 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.044970 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.045174 32644 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:26.036689 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.022228 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.047655 30860 raft_consensus.cc:2410] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:26.012938 32636 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.048519 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.031035 30856 raft_consensus.cc:2393] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:26.049149 30860 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 1.
I20260709 12:22:26.027724 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.049888 30852 raft_consensus.cc:2393] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:26.050066 30782 raft_consensus.cc:2410] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:26.008376 32506 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:26.012974 30927 rpcz_store.cc:276] 0709 12:22:24.903982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.905195 (+  1213us) service_pool.cc:224] Handling call
0709 12:22:25.631688 (+726493us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faeee 000000000036eb39 00007f961596e1e0 00007f9615a370c4 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:25.631922 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:25.632221 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:25.632662 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 12:22:25.916528 (+283866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:25.923855 (+  7327us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:25.928433 (+  4578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.941773 (+ 13340us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:25.963302 (+ 21529us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18023,"prepare.queue_time_us":186,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":22033,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8146,"spinlock_wait_cycles":15979904,"thread_start_us":236276,"threads_started":1}
I20260709 12:22:26.051513 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.051559 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.053905 30776 raft_consensus.cc:2393] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:26.053925 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:26.055713 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.056069 30776 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:25.996490 32465 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:22:26.066849 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.067736 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.068693 30852 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:26.064652 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.063403 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:26.074455 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 91032.5us
I20260709 12:22:26.075517 30860 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:26.031930 32123 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:26.077265 30860 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:22:26.046500 32509 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.115131 30856 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:26.067373 32600 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:26.053161 32627 raft_consensus.cc:697] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.053768 32506 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.109879 30860 pending_rounds.cc:85] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 2
I20260709 12:22:26.129184 30860 pending_rounds.cc:107] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:26.129539 30860 raft_consensus.cc:2889] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:26.060367 32588 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:26.016916 32615 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.116950 32667 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.120214 32600 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.112509 32655 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:22:26.140872 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:26.156347 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.156852 30860 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:26.186700 30860 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:26.117478 32558 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.160725 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.109481 32624 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.120358 32652 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:26.022393 32545 consensus_queue.cc:237] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:26.184528 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 62568.2us
I20260709 12:22:26.153577 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:26.207353 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 187422us
W20260709 12:22:26.184576 32663 log.cc:927] Time spent T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:22:26.183182 32600 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.213114 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:26.182544 32515 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.222782 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:26.216466 32657 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:22:26.209631 32624 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:26.234124 32659 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 12:22:26.234848 32664 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:22:26.235637 32671 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:26.242122 30777 raft_consensus.cc:1240] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:26.242406 32649 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:22:26.201138 32558 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.227029 32554 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:26.248627 32643 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:22:26.249068 32334 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.232801 32627 consensus_queue.cc:237] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.300720 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1278) took 1008 ms. Trace:
I20260709 12:22:26.301126 30934 rpcz_store.cc:276] 0709 12:22:25.292540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.567886 (+275346us) service_pool.cc:224] Handling call
0709 12:22:25.568181 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:25.568589 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:25.568618 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:25.569201 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 12:22:25.897359 (+328158us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:25.897422 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:25.898746 (+  1324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:26.300479 (+401733us) raft_consensus.cc:1685] finished
0709 12:22:26.300502 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:26.300655 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":764,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"spinlock_wait_cycles":18688,"thread_start_us":327668,"threads_started":1,"wal-append.queue_time_us":421762}
W20260709 12:22:26.250006 32508 consensus_meta.cc:287] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.564s	user 0.004s	sys 0.013s
I20260709 12:22:26.304692 32508 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.307113 32508 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:26.261425 32123 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.314456 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:26.315215 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.250252 32615 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:26.207676 32198 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.316856 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:26.317842 32198 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:26.264237 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 212738us
I20260709 12:22:26.321664 30900 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.322911 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:26.232986 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:26.227700 32516 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.323347 30855 raft_consensus.cc:1240] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:26.355690 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.215035 32652 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.362371 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.309158 32622 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.365264 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:26.366201 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 133712us
I20260709 12:22:26.370927 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:26.371922 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.374473 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.337242 32638 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.338488 32609 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.381394 32545 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.383647 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.340225 32561 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.366268 32588 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.392360 32561 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.363711 32603 consensus_queue.cc:1059] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:22:26.396432 32603 raft_consensus.cc:3055] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.396921 32603 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:26.397917 32603 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.398495 32624 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:26.399510 32603 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:26.403402 32506 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.376828 32542 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:26.404703 32542 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:26.369925 32667 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:26.405750 32542 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.378594 32678 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:26.407687 30853 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:26.410192 30857 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:22:26.413580 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.415709 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.426043 32686 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:26.414875 32667 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:26.427570 32686 consensus_queue.cc:1059] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:22:26.409322 30928 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.427703 32609 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.394668 32588 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:26.373999 32516 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.412570 32600 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.438349 32545 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:26.416344 31509 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:26.415298 32539 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.414374 32500 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:26.462901 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.435006 32607 consensus_meta.cc:287] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260709 12:22:26.425391 32506 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:26.443768 32545 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.440111 32678 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.430023 30900 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.430176 32622 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:26.433696 32588 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.433063 32652 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:26.472846 32686 raft_consensus.cc:3055] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:26.434659 32637 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.479557 32607 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:26.481281 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.477478 32644 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:26.474678 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 83168.7us
I20260709 12:22:26.435310 32624 consensus_queue.cc:1059] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:22:26.503935 30854 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:26.514468 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.523682 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.518116 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.524680 30785 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:26.525206 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.513880 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.509605 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.528017 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.528975 32624 raft_consensus.cc:3055] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:26.529378 32624 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.520396 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.589751 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.522130 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.505640 30825 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:26.675392 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 169827us
I20260709 12:22:26.520700 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:26.592934 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 61906.1us
I20260709 12:22:26.678609 30929 raft_consensus.cc:2393] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:26.497924 31474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.684355 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.685165 30929 raft_consensus.cc:2393] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:26.493943 32686 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.688500 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.652967 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.601342 32607 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:26.659047 32588 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:26.662734 32609 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:26.666965 32612 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:26.667196 32616 raft_consensus.cc:3055] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:26.582139 32624 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.497519 32545 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:26.505239 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:26.593030 32334 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.582933 32611 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:22:26.530412 32644 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:26.489521 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 63807.2us
I20260709 12:22:26.533805 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.538077 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.719494 30935 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:26.720536 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.721619 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.722692 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.723219 30935 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:26.723966 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.724968 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.728564 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.729602 32609 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.730195 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:26.731257 32609 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.731660 32609 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:26.732017 32609 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:26.731835 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:26.680509 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.686049 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.733430 30929 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:26.530241 32622 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:26.734102 32622 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.508684 32506 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:26.688194 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:26.742544 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.500245 32500 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:26.503743 32637 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:26.679580 32615 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.505388 32465 consensus_queue.cc:1059] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.194s
I20260709 12:22:26.694746 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:26.696156 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:26.703689 32612 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:26.737006 32622 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:26.744827 32612 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.746016 32612 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.745918 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.747345 30929 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:26.692116 30930 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:26.699992 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:26.748493 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:26.749042 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 49141.6us
I20260709 12:22:26.749564 32561 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.750185 32561 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.750654 32684 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.751420 30750 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:26.751434 32684 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.752574 32561 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:26.752811 32692 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:26.753351 32692 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.700084 32686 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.755525 32686 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:26.756541 32516 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:26.706686 32616 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.759650 32616 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.760901 32616 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:26.763955 32692 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.767215 32684 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:26.768237 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.748971 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.768859 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.769704 30930 raft_consensus.cc:2410] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:26.752599 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:26.769713 30929 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.778026 32561 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.501982 32600 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:26.677543 30825 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:26.532078 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:26.742202 32609 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:26.784073 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 52354.1us
I20260709 12:22:26.794327 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:26.784973 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:26.785612 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 89584.1us
I20260709 12:22:26.785918 30934 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:26.790453 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 95824.3us
I20260709 12:22:26.796499 32666 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:26.796855 30934 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:22:26.799942 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 122481us
I20260709 12:22:26.804495 30783 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:26.804929 30857 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:26.805961 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:26.807289 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.797382 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:26.807955 30860 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:26.809206 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:26.810456 30860 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:26.717029 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:26.811647 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:26.823261 32697 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:22:26.823071 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:26.823736 32498 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:26.824929 32506 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:26.813230 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:26.826828 32667 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:26.833161 32438 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:26.788180 32624 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:26.828819 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.096783 30781 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:26.834538 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:26.812356 30855 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:27.165675 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.091202 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.090865 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.107075 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 1057) took 1083 ms. Trace:
I20260709 12:22:27.170658 30784 rpcz_store.cc:276] 0709 12:22:26.023763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.051269 (+ 27506us) service_pool.cc:224] Handling call
0709 12:22:27.106442 (+1055173us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54001eafd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:27.106806 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429323136}
I20260709 12:22:27.109134 30679 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 78) took 8890 ms. Trace:
I20260709 12:22:27.172518 32598 raft_consensus.cc:3055] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:27.097136 30680 catalog_manager.cc:5697] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.154642 32662 consensus_queue.cc:1059] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:22:27.184326 32662 raft_consensus.cc:3055] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:27.181699 30680 catalog_manager.cc:5697] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 3, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.126856 30852 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:27.131037 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 249371us
I20260709 12:22:27.182583 32637 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.186518 30932 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:27.186776 32637 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:26.826965 30860 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:27.189090 30932 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:26.851167 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.190685 30926 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:26.895814 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36358 (request call id 9) took 1240 ms. Trace:
I20260709 12:22:27.191785 30931 rpcz_store.cc:276] 0709 12:22:25.655369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.679168 (+ 23799us) service_pool.cc:224] Handling call
0709 12:22:26.895564 (+1216396us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54002bbe54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a19853 00007f96159e760a 00007f960ef6d7d4 00007f960ef6d762 00007f960ef6d691 00007f960ef6d60c 00007f960ef6c8c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:26.895722 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593222016}
I20260709 12:22:26.944535 30935 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:26.845434 30929 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:27.196128 30929 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:22:27.135576 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 167184us
W20260709 12:22:26.880707 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.206132 32420 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.207566 32668 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.902555 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:22:27.142000 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.209069 32666 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.209939 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.782217 32334 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.207581 32637 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.210391 32666 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.995754 32394 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:26.846387 32438 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:26.873885 32498 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.834462 32508 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:27.196162 32705 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:22:27.237591 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:26.788400 32515 raft_consensus.cc:3055] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:27.238590 32515 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:27.239734 32558 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.240093 32515 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.241648 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:26.883498 32542 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:22:27.243534 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:27.244738 30782 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:26.892155 32609 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:26.853097 32667 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:26.881744 32675 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:22:26.498965 32678 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:26.812420 32611 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:27.314392 32611 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.314972 32611 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.317222 32603 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.318343 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:27.163439 32465 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.167575 30855 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:26.838873 30857 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.175354 32673 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.335443 32673 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.336266 32469 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.337018 32469 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.175632 32671 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.338399 32671 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.338421 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.340837 32671 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.110839 30859 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:27.178697 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1029) took 1451 ms. Trace:
I20260709 12:22:27.341463 32469 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.341641 30851 rpcz_store.cc:276] 0709 12:22:25.726729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:25.740929 (+ 14200us) service_pool.cc:224] Handling call
0709 12:22:26.834356 (+1093427us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:27.178427 (+344071us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10648960}
I20260709 12:22:27.184851 32662 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:27.345052 32662 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.135710 30927 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:22:27.346848 32711 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:27.177322 32601 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.214885 30929 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:27.213989 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1053) took 1361 ms. Trace:
I20260709 12:22:27.181994 32598 raft_consensus.cc:740] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:27.187693 32644 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.209362 30680 catalog_manager.cc:5697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.231447 30931 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:27.232308 32692 raft_consensus.cc:1064] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:22:27.208616 32668 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.355446 30780 raft_consensus.cc:1240] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:27.216244 32438 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.355960 30680 catalog_manager.cc:5697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.357120 32438 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:27.237860 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:26.892134 32588 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:27.358851 32607 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:27.241485 32515 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:27.359916 32716 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:27.320055 32465 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:27.250948 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 46370.4us
W20260709 12:22:27.361858 32690 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.760s	user 0.000s	sys 0.005s
W20260709 12:22:27.358932 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.362601 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.250106 30933 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:27.213745 32334 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.366281 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.172389 30679 rpcz_store.cc:276] 0709 12:22:18.218195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:18.221959 (+  3764us) service_pool.cc:224] Handling call
0709 12:22:27.108745 (+8886786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:18.864595 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:18.878464 (+ 13869us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:18.878507 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:22:18.878521 (+    14us) tablet.cc:662] Decoding operations
0709 12:22:18.879208 (+   687us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:18.879260 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:18.879292 (+    32us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:22:18.879834 (+   542us) tablet.cc:701] Row locks acquired
0709 12:22:18.879857 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:22:18.880009 (+   152us) write_op.cc:270] Start()
0709 12:22:18.880134 (+   125us) write_op.cc:276] Timestamp: P: 1783599738879959 usec, L: 0
0709 12:22:18.880158 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:18.964561 (+ 84403us) log.cc:844] Serialized 2068 byte log entry
0709 12:22:19.959865 (+995304us) op_driver.cc:464] REPLICATION: finished
0709 12:22:20.575056 (+615191us) write_op.cc:301] APPLY: starting
0709 12:22:20.583965 (+  8909us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:20.629480 (+ 45515us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:20.677086 (+ 47606us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:21.190596 (+513510us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:21.301437 (+110841us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:22:21.317865 (+ 16428us) write_op.cc:312] APPLY: finished
0709 12:22:21.383497 (+ 65632us) log.cc:844] Serialized 46 byte log entry
0709 12:22:22.867793 (+1484296us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f960d9150ac 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b
0709 12:22:23.033886 (+166093us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:23.038284 (+  4398us) write_op.cc:454] Released schema lock
0709 12:22:23.046844 (+  8560us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:23.062451 (+ 15607us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:23.062486 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7861,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":515631,"apply.run_cpu_time_us":27936,"apply.run_wall_time_us":2508526,"num_ops":5,"prepare.queue_time_us":13433,"prepare.run_cpu_time_us":3977,"prepare.run_wall_time_us":113251,"replication_time_us":1038213,"spinlock_wait_cycles":17067264,"thread_start_us":1939935,"threads_started":2,"wal-append.queue_time_us":1618429,"wal-append.run_cpu_time_us":1640,"wal-append.run_wall_time_us":1075376}]]}
I20260709 12:22:27.214438 32394 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.368685 30928 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:27.288480 32705 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:22:27.285887 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:27.263465 32558 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:27.370635 32614 raft_consensus.cc:3055] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:27.371153 32614 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:27.372421 32614 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.302151 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.307891 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:27.305079 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 476251us
I20260709 12:22:27.308531 32667 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.310171 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.314889 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:27.317919 32603 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:26.811089 32615 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:27.391196 30776 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:27.391607 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.392590 30778 raft_consensus.cc:2410] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:26.844303 32622 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:22:27.329178 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:27.372279 32598 consensus_queue.cc:260] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.395058 32598 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.309067 32016 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.398252 32016 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.398736 32673 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.380985 30782 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:27.381878 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.382951 32668 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.373579 32614 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.357856 30680 catalog_manager.cc:5697] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.386987 32123 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:27.388829 32394 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:27.400904 32016 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:27.432320 32123 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.451315 30776 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:22:27.421322 32666 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.451792 30776 pending_rounds.cc:85] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 1
I20260709 12:22:27.439585 30927 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:27.459895 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.457360 30776 pending_rounds.cc:107] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:27.477669 30776 raft_consensus.cc:2889] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:27.348485 30856 rpcz_store.cc:276] 0709 12:22:25.839276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.149670 (+310394us) service_pool.cc:224] Handling call
0709 12:22:26.158591 (+  8921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:26.386221 (+227630us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:26.403594 (+ 17373us) log.cc:844] Serialized 14 byte log entry
0709 12:22:26.477629 (+ 74035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:26.477691 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:26.477740 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.112156 (+634416us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800421a80. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9002a6 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419
0709 12:22:27.145132 (+ 32976us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54003796d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:27.145215 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.200502 (+ 55287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17611,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":572,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4971,"spinlock_wait_cycles":530584448,"thread_start_us":72938,"threads_started":1,"wal-append.queue_time_us":85826}
I20260709 12:22:27.450461 32334 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.478235 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.450814 32558 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.461529 30680 catalog_manager.cc:5697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:27.491341 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.498521 30778 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:22:27.503065 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 91457.7us
I20260709 12:22:27.505968 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.506108 32506 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.506973 32506 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.515626 32334 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:27.517868 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 57990.2us
I20260709 12:22:27.503281 30680 catalog_manager.cc:5697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.518800 32508 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:27.519559 32508 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.520526 30750 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:27.519968 30680 catalog_manager.cc:5697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.521184 32603 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.506201 32498 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.491596 32588 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:27.531870 32588 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.532423 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:27.532897 32719 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.501019 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.533627 32719 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.534214 30781 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:27.535696 32509 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:27.535916 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:27.536283 32719 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:27.536401 32509 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.537554 32558 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.538785 31503 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:27.540171 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:27.533982 32394 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:22:27.540756 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.541905 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 57342us
I20260709 12:22:27.540728 30680 catalog_manager.cc:5697] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.570259 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.497704 32465 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.502957 32616 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:27.576958 32710 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:22:27.578438 30857 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:27.579275 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.541922 32719 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:27.540218 32558 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.586421 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:27.581981 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:27.581707 32508 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.596107 30680 catalog_manager.cc:5697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 3, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:27.595093 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:27.608532 32717 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.249s	user 0.003s	sys 0.000s
I20260709 12:22:27.608170 30680 catalog_manager.cc:5697] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:27.610898 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:27.610512 30680 catalog_manager.cc:5697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 3 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:27.612272 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.612834 30680 catalog_manager.cc:5697] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 3, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 3 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:27.614085 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:27.614498 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 45414.5us
I20260709 12:22:27.615572 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.615778 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.616600 30930 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:27.616426 32123 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.617214 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:27.619529 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 3.015s (SENT) [suppressed 13 similar messages]
I20260709 12:22:27.621434 32719 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.622733 30856 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:27.623328 30781 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:27.625280 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.623296 30851 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:27.627697 32508 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:27.628011 32686 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:27.629011 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:27.629118 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:27.629226 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.629842 30854 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
W20260709 12:22:27.630062 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 54568.1us
I20260709 12:22:27.630388 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.630797 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.631191 30931 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:27.632148 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.632918 30933 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:27.633991 32508 raft_consensus.cc:2764] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:27.629570 32662 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.634881 31508 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:22:27.636261 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 115890us
I20260709 12:22:27.637277 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:27.639413 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:27.633602 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.646669 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:27.646811 32558 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.647758 30934 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:27.646988 32508 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:27.600308 31509 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:27.648980 30934 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:27.641830 32616 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.648983 32508 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.651257 32508 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.652474 32616 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.655254 32588 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:27.651378 30782 raft_consensus.cc:2410] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:27.650746 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:27.656664 30927 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:27.649919 32603 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:27.648396 30826 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:27.661466 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.621629 32707 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.654682 32692 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.666100 32707 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.658919 32719 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:27.668488 31503 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42838 (request call id 98) took 1634 ms (client timeout 1930 ms). Trace:
I20260709 12:22:27.668632 32334 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.659720 32645 consensus_queue.cc:1059] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:22:27.659253 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:27.658636 32498 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.672689 32686 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:27.672844 32498 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.674126 32667 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.669008 32719 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:27.676748 32611 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.677380 32667 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:27.678763 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59271.5us
I20260709 12:22:27.680702 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.681339 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.685691 32666 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:27.685060 32334 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:27.700047 32666 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:27.701288 32666 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.702193 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:27.703011 32666 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.704159 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:27.706023 32438 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:27.706437 32438 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.706800 32438 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:27.689085 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.689694 32713 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:27.690104 31477 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:27.690510 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:27.687953 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.687979 30929 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:27.688203 32615 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.688445 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:27.690933 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.693359 32506 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:27.693502 32707 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:27.687695 32638 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.694988 32603 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.695061 32123 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.686393 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.690960 32653 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:27.726313 32653 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.726720 32653 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:27.703033 31508 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:27.733546 32638 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.734002 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.734695 30778 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:27.735774 32713 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.735950 32638 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.736373 32713 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.737721 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.738674 32713 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:27.688900 32498 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:27.739670 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.725626 32508 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:27.740438 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:27.695091 32728 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:22:27.742430 32508 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.697305 30860 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:27.742872 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:27.690128 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:27.669013 31503 rpcz_store.cc:269] 0709 12:22:26.062252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.071622 (+  9370us) service_pool.cc:224] Handling call
0709 12:22:26.902286 (+830664us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b5800023498. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:27.668224 (+765938us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54004e3ed4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:27.668408 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434291328}
I20260709 12:22:27.745388 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:27.699174 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.711130 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:27.717929 32617 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:27.718746 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:27.718791 32515 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:27.719583 30785 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:27.719936 32603 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.720443 32407 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:27.722083 32615 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.679759 32509 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:27.686054 32686 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.746495 32334 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:27.754662 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 63816.1us
I20260709 12:22:27.745687 32123 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:27.756057 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.759691 30781 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:27.752146 32719 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:22:27.772924 31476 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:27.772188 30899 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:27.774082 31506 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:27.774768 30826 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.775609 32614 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:27.776321 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.776218 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.777117 32614 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:27.770870 32686 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.753043 32465 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:27.776788 32653 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:27.773054 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.777642 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:27.771379 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:27.787407 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:27.757565 32616 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:27.790112 30899 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:27.766426 32123 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:27.800480 32542 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:27.791682 32617 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:27.786073 32508 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:27.776974 32707 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:22:27.809926 32334 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:27.810648 32712 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:27.810650 32666 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:27.814442 32615 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.815557 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:27.817229 31507 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:27.787822 32465 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.790545 32407 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:27.831288 32611 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.791363 32498 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:27.791320 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1306) took 1006 ms. Trace:
I20260709 12:22:27.831714 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:27.832773 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 55244.4us
I20260709 12:22:27.823257 32542 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:27.825230 32617 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.824153 32123 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.840790 32666 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:27.844738 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:27.829041 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 56039.2us
I20260709 12:22:27.848466 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:27.827510 32508 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:27.839025 32712 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.856634 32542 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:27.865831 31507 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42838 (request call id 97) took 1873 ms (client timeout 1551 ms). Trace:
I20260709 12:22:27.858382 32617 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.846184 32465 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:27.866911 32686 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:27.878109 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:27.879956 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.880312 32661 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.847443 32407 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:27.886849 30860 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:27.883142 32611 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:27.884276 32712 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:27.887656 32666 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.889884 32407 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:27.894716 32661 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:27.883484 31507 rpcz_store.cc:269] 0709 12:22:26.013859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:26.022749 (+  8890us) service_pool.cc:224] Handling call
0709 12:22:27.856688 (+1833939us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400091d54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:27.858298 (+  1610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4067073792}
I20260709 12:22:27.918342 32615 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:27.927556 32611 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.033370 32615 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:28.034212 32615 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.946959 32719 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:27.894541 32508 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:27.889889 32334 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:28.045658 32334 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:27.890394 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:27.917906 32678 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:28.043002 32719 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.057600 32707 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:28.058403 32707 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:28.064769 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 186752us
W20260709 12:22:28.065861 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 153121us
W20260709 12:22:28.070742 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 238575us
I20260709 12:22:28.071499 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.072146 30860 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:28.072535 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.077849 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:28.078747 32738 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.079311 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.082885 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:28.083773 32738 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:28.084349 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:28.085269 32738 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.086323 32653 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.086345 30826 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:28.087311 32614 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:28.089344 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:28.089896 32438 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.090358 32614 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:28.091243 30781 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:28.091019 32123 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.091061 32614 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:28.092198 30783 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:28.092541 32614 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.093837 32738 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:28.067950 32508 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.084695 30860 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:28.098587 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:28.099179 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.096609 32615 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.109933 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:28.097715 32603 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.100008 32438 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.103324 32653 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:28.107254 32611 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.110495 32016 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:22:28.110611 32667 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:22:28.106043 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:28.119484 32506 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:28.119510 32509 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:28.119802 30931 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:28.120635 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.120184 32509 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:28.122346 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.122418 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.122817 32509 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.124105 32509 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:28.110083 32334 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:28.121131 32740 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.091s	user 0.001s	sys 0.001s
I20260709 12:22:28.130916 30860 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:28.115166 32615 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:28.120020 32506 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:28.131763 32667 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:28.124133 32558 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:28.127888 32653 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:28.142472 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.148293 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.137823 32661 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.142105 32469 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.143888 32615 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:28.136962 32506 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:28.159845 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.147953 32667 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.161532 32469 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.168118 32506 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.176666 32707 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.177130 32469 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.177806 32738 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.178309 32667 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:28.180294 32615 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.180835 32617 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.181137 32738 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.183362 32738 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.178376 30783 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:28.186638 32603 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.186872 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.167505 32719 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.187570 30781 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:27.853570 30926 rpcz_store.cc:276] 0709 12:22:26.783066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.191752 (+408686us) service_pool.cc:224] Handling call
0709 12:22:27.192308 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:27.192839 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:27.196306 (+  3467us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.635324 (+439018us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b1800419f80. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f96148f358f 00007f960d932571 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd
0709 12:22:27.732413 (+ 97089us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800419f80. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf
0709 12:22:27.732656 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 12:22:27.753141 (+ 20485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:27.757542 (+  4401us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:27.758414 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:27.767073 (+  8659us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:27.789899 (+ 22826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22022,"prepare.queue_time_us":5573,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":1182,"raft.queue_time_us":30945,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":17842,"spinlock_wait_cycles":86630528,"thread_start_us":385382,"threads_started":2,"wal-append.queue_time_us":489425}
W20260709 12:22:28.179544 32741 log.cc:927] Time spent T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:22:28.189487 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.205003 30779 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:28.207314 30825 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:28.208973 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:28.211575 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:28.169132 32123 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.212802 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:28.214453 32738 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:28.257401 32738 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.257890 32738 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.191284 32712 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.259783 30931 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:28.261327 32712 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:28.261503 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:28.262247 31509 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:28.218436 32742 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:22:28.218308 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.264226 30935 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:28.212934 32601 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:28.223647 30899 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:28.265024 32601 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.265463 32601 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.226101 32469 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:22:28.227816 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.269179 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.270105 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.270172 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.270813 31509 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:28.238837 32465 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:28.242539 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.272145 32509 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.244587 32407 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.166471 32653 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.250919 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:28.252789 32614 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.252887 32558 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:28.253636 32334 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.270903 30927 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:28.271625 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.289842 30931 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:28.271703 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.231406 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:28.272845 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.290668 30782 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.275735 30781 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:28.291618 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.291153 32334 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:28.294039 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.294813 30854 raft_consensus.cc:2393] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:28.294938 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.292814 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.296324 30935 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:28.298776 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.292661 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:28.278095 32506 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:28.310141 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.310907 30935 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:28.310322 30860 raft_consensus.cc:2376] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4. Re-sending same reply.
W20260709 12:22:28.313831 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 82573.8us
I20260709 12:22:28.303058 32614 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.303015 32506 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.303117 32603 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:28.310009 32469 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:28.295606 32509 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.322055 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.319090 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:28.323724 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.320322 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:28.339916 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.320722 30851 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:28.320626 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.340543 30781 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.302861 32558 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.343104 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:28.344610 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:28.345835 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.344497 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.346609 30860 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:28.347939 32123 raft_consensus.cc:2764] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:22:28.337446 32506 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:28.367601 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 49001.6us
I20260709 12:22:28.343168 32667 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:28.342932 32469 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:28.345014 32334 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:22:28.394155 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.393821 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.394979 30926 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:28.342563 32603 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:28.395423 32469 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.396435 32603 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.399238 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.399816 30776 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.372505 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.402191 30860 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.375408 32738 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.376135 32407 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.382750 32558 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.384102 32617 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.384485 32438 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:28.405143 32738 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.385344 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.405799 30854 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.352062 32666 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.391263 32614 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.392308 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.418792 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.419176 30931 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:28.392668 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:28.391980 32712 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:28.393020 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.393698 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.393795 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:28.394002 32667 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:28.390153 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:28.411437 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.371317 32611 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:28.428716 30927 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:28.411667 30776 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:28.414316 31506 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:28.416025 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.430398 30856 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.415958 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.416781 30855 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:22:28.422442 30782 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:28.448115 30928 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:28.448716 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.401412 32601 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.449581 30855 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:28.451022 30899 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:28.453426 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.454094 30777 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.453774 32611 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:28.461647 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 71606.3us
I20260709 12:22:28.468940 30781 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:28.469605 30859 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:28.471666 32692 consensus_queue.cc:1059] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:28.472774 32692 raft_consensus.cc:3055] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:28.473163 32692 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:28.474261 32692 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.475982 32692 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.471938 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:28.479676 32678 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:28.480227 32678 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:28.480692 32678 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:28.503533 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.507366 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.508210 30857 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
W20260709 12:22:28.502004 32542 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.006s
I20260709 12:22:28.469008 32707 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:28.501016 32686 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:28.519798 32686 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:28.520221 32686 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:28.501251 32588 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.521565 32588 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.522780 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.523409 30857 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:28.523757 32588 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.524279 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.525008 30857 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:28.506197 31507 raft_consensus.cc:2368] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4.
I20260709 12:22:28.524921 32509 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.527254 32506 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.528154 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.527935 32542 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.528795 30857 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:28.527693 30851 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:28.529636 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.530349 32667 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.533164 30857 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:28.532104 30777 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:28.534512 30929 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:28.534541 30860 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:28.537750 30854 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:28.547701 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:28.556819 30856 raft_consensus.cc:2410] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:28.560997 31477 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:28.529487 32506 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:28.571372 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.583089 30900 leader_election.cc:400] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4.
I20260709 12:22:28.583515 30900 leader_election.cc:403] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:28.584014 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 49691.8us
I20260709 12:22:28.586637 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:28.587255 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.530092 32542 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:28.530362 32707 raft_consensus.cc:697] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:28.589849 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.599802 30825 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:28.584906 32742 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:22:28.564574 32617 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:28.604518 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.603473 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.582037 32661 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:22:28.614058 32755 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:22:28.615397 32542 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.615839 32661 raft_consensus.cc:697] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:28.616073 32542 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.617249 32738 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:28.616987 32661 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.618014 32738 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.601974 32678 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.622799 30784 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:28.623764 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.624450 30776 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:28.631091 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.631758 30777 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.632083 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:28.598551 32705 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.636583 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.610421 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:28.638979 31503 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 6. Ops: []
I20260709 12:22:28.640365 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:28.641175 30785 raft_consensus.cc:2368] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7.
I20260709 12:22:28.612254 32334 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:28.649078 30854 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:28.644302 30899 leader_election.cc:400] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7.
I20260709 12:22:28.650131 30899 leader_election.cc:403] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:28.603070 32614 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:28.658179 32334 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:28.659368 32334 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.648458 32611 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:28.669451 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.677057 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.633679 32617 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:28.693775 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.694857 30854 raft_consensus.cc:2368] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:28.700189 30777 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:28.714569 30899 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:28.762491 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.765600 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.766571 30854 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:28.691985 32508 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:28.788511 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:28.795097 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.795835 30854 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:28.766355 32506 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:28.753955 32542 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.686812 32614 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:28.808120 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.809260 30854 raft_consensus.cc:2393] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:28.778285 32762 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:28.812425 30782 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
W20260709 12:22:28.810334 32758 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:22:28.799863 32123 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:28.823401 32762 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.767257 32469 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 12:22:28.836165 32753 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:22:28.836966 32759 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:22:28.864890 32686 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.833825 32123 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:28.868860 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:28.843351 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.846156 32738 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.846935 32678 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.848363 32469 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:28.852246 32603 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:28.855152 32756 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:22:28.854614 32516 consensus_queue.cc:1059] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:28.894093 32603 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.895466 32516 raft_consensus.cc:3055] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:28.895844 32516 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:28.896551 32603 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.896682 32516 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.856581 32762 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:28.806883 32508 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.812885 32617 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:28.874722 30854 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.824120 32506 raft_consensus.cc:697] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:28.779877 32707 consensus_queue.cc:237] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.890875 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:28.880985 32469 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:28.882552 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.910017 30929 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:28.876354 32123 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:28.915176 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:28.939587 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 48820.6us
I20260709 12:22:28.903645 32516 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:28.949797 30855 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:28.926590 32509 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7.
I20260709 12:22:28.941298 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.903376 32712 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49608 (request call id 71) took 5587 ms. Trace:
I20260709 12:22:28.955108 30858 raft_consensus.cc:2410] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:28.942028 32506 consensus_queue.cc:237] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.927204 32761 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:28.946276 32678 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:28.956604 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:28.959445 30855 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:28.946657 32705 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4.
I20260709 12:22:28.961639 30854 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:28.970156 32666 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:28.970054 32469 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.971480 30854 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:28.976208 30826 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:28.972985 32678 raft_consensus.cc:697] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:28.984977   305 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:28.962909 32761 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:28.978782   307 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:28.980297 32469 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:28.990139 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:28.995276 32761 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.001402 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:29.007270 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.011207 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:29.016251 32601 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.018484 31503 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:29.019781 32465 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.020171 30858 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:29.012857   309 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:29.021749 30900 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.604s (SENT)
I20260709 12:22:28.991489 32614 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.024812 30899 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:29.025799 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.032196 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.034209 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.034816 30929 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.035434 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.035925 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.033648 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.039592 30782 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:29.040000 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.041108 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.041441 30858 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.042835 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.039978 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.044278 30854 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:29.045856 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:29.048169 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.047334 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:29.052431 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.052992 30935 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.051275 30852 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:29.054471 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.056396 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.030581 32558 raft_consensus.cc:2764] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:22:29.058512 30930 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:29.044921   305 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:29.059505 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.059760 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:28.955099 32712 rpcz_store.cc:276] 0709 12:22:23.292516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:24.252476 (+959960us) service_pool.cc:224] Handling call
0709 12:22:25.595366 (+1342890us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400029520. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961099c520 00007f9610a25b42 00007f9610a24800 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54 00007f960ef61be2 00007f960ef61b11 00007f960ef61a8c 00007f960ef60d42
0709 12:22:25.700373 (+105007us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b2c000623c8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f327a0a 00007f960f327693 00007f960f327631 00007f9610a5a902 00007f9610a5a6dd 00007f9610a25f3f 00007f9610a256b3 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54
0709 12:22:26.408430 (+708057us) spinlock_profiling.cc:243] Waited 71.8 ms on lock 0x7b58007b08d0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961097b0aa 00007f96109fd447 00007f9610a1a70a 00007f9610a1b76a 00007f9610a1a91b 00007f9610a2603c 00007f9610a256b3 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54
0709 12:22:26.435073 (+ 26643us) log.cc:844] Serialized 501 byte log entry
0709 12:22:27.240315 (+805242us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b5400029520. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961099fb26 00007f961099949a 00007f9610998714 00007f9610978eaa 00007f961097fd53 00007f961097fcd9 00007f961097fc69 00007f961097fc31 00007f961097edfd 0000000000388634
0709 12:22:28.877691 (+1637376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56564,"raft.queue_time_us":1829,"raft.run_cpu_time_us":3808,"raft.run_wall_time_us":659719,"spinlock_wait_cycles":326961280,"thread_start_us":202015,"threads_started":1,"wal-append.queue_time_us":272232,"wal-append.run_cpu_time_us":2808,"wal-append.run_wall_time_us":1007767}
I20260709 12:22:29.060501 30928 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:29.060942 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.073894 32601 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:29.074508 30858 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:29.075314 30929 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:29.049823 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.022313   309 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.081451 30776 raft_consensus.cc:3055] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:29.081888 30776 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:29.082670 30776 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.083099   309 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:29.062964 31507 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:29.083773 30776 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.037521   307 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.063938 30926 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:29.086064   307 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.064280 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.086776 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.086920 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.087548 30926 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:29.088567 30932 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:29.088709 30926 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:29.089145 30935 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:29.090158 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.091019 30777 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:29.091256 32705 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.091347 30935 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:29.037091 32509 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:22:29.066040 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:29.067518 30857 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:29.069650 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:29.091358 30784 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:29.070142 30934 raft_consensus.cc:2410] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:29.070308   305 raft_consensus.cc:697] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:29.066666 30933 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:29.072247 30856 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:29.071345 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.094378   305 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.079147 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.095963 30934 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:29.095877 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.080082 32508 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:29.097934 32614 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:29.098006 32508 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:29.091825 30932 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:29.080525 31476 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:29.100764 32666 raft_consensus.cc:2804] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.101316 32666 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.101712 30680 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48042 (request call id 176) took 8759 ms. Trace:
I20260709 12:22:29.101826 32666 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.103444 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.104445 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.106515 30857 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:29.106812 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:29.107539 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.107904 30858 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:29.107961 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:29.109282 30858 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:29.109383 30852 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:22:29.109853 30857 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:29.110114 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.110482 32558 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.111037 32558 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.111413 30926 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:29.111519 30851 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:29.045272 32686 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.113191 32558 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.115116 32509 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:29.115543 32509 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:29.116494 32509 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:29.091609 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 69917.9us
W20260709 12:22:29.122821 30900 leader_election.cc:336] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.616s (SENT)
I20260709 12:22:29.123399 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.124379 30854 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:29.089434 30930 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:29.059520 32678 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.046921 32692 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.047700 32667 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.058171 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:29.139496 30860 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:29.097342 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.081022 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.128607 31477 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:29.146874 30855 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:29.147482 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:29.141309 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 44041.4us
I20260709 12:22:29.130067 30856 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:29.148403 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.145042 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.149169 30859 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:29.177675 30929 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:29.170855 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.179085 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.102303 30680 rpcz_store.cc:276] 0709 12:22:20.342389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:20.342918 (+   529us) service_pool.cc:224] Handling call
0709 12:22:29.101634 (+8758716us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:27.834665 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:27.880692 (+ 46027us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:27.880753 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:22:27.880772 (+    19us) tablet.cc:662] Decoding operations
0709 12:22:27.919274 (+ 38502us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:27.919413 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:27.919455 (+    42us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:22:27.920778 (+  1323us) tablet.cc:701] Row locks acquired
0709 12:22:27.920828 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:22:27.921007 (+   179us) write_op.cc:270] Start()
0709 12:22:27.921161 (+   154us) write_op.cc:276] Timestamp: P: 1783599747920941 usec, L: 0
0709 12:22:27.921203 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:22:27.975497 (+ 54294us) log.cc:844] Serialized 5193 byte log entry
0709 12:22:28.349683 (+374186us) op_driver.cc:464] REPLICATION: finished
0709 12:22:28.402850 (+ 53167us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1ae28 00007f9614455581 00007f9614454d58 00007f96144599f1 00007f96144599a9 00007f9614459939 00007f9614459901 00007f9614458b2d 0000000000388634 0000000000388479
0709 12:22:28.424897 (+ 22047us) write_op.cc:301] APPLY: starting
0709 12:22:28.425017 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:28.425328 (+   311us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:28.425366 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:28.518789 (+ 93423us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:28.519126 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:22:28.519185 (+    59us) write_op.cc:312] APPLY: finished
0709 12:22:28.519590 (+   405us) log.cc:844] Serialized 94 byte log entry
0709 12:22:28.519784 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:28.519933 (+   149us) write_op.cc:454] Released schema lock
0709 12:22:28.520000 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:28.520411 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:28.520439 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":594214,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":74818,"apply.run_cpu_time_us":4666,"apply.run_wall_time_us":95523,"num_ops":13,"prepare.queue_time_us":211264,"prepare.run_cpu_time_us":27339,"prepare.run_wall_time_us":568466,"raft.queue_time_us":88320,"raft.run_cpu_time_us":26672,"raft.run_wall_time_us":113374,"replication_time_us":428322,"spinlock_wait_cycles":98860928,"thread_start_us":375902,"threads_started":4,"wal-append.queue_time_us":220407}]]}
W20260709 12:22:29.160600 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.180269 30930 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:29.149555 30826 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:29.187553 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 64815.6us
I20260709 12:22:29.189018 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.178064 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.182847 30678 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 3 to 4, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), no longer has a pending config: VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.213371 30927 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:29.222245 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:29.251289 30900 leader_election.cc:336] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.700s (SENT)
W20260709 12:22:29.223078 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.251924 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:29.253525 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.213904 30826 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.251941 30782 raft_consensus.cc:2393] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:29.286572 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.285429 30777 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:29.290602 30777 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:29.265084 30929 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:29.146586 32558 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:29.301260 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.295964 30931 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:29.147778 32509 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.145089 32667 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.144949 32601 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
W20260709 12:22:29.309706 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 95896.1us
I20260709 12:22:29.309408 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.310581 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.311230 30776 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:22:29.311712 30776 pending_rounds.cc:85] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:22:29.312286 30776 pending_rounds.cc:107] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:22:29.211949 32508 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.179195 32465 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.312971 30776 raft_consensus.cc:2889] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:29.313997 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.146399 32692 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.290059 30928 raft_consensus.cc:2393] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:29.316556 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.250511 32016 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.301501 32558 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.279839 32762 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.332990 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 144627us
I20260709 12:22:29.333393 32762 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.255122 32614 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:29.275118   307 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.248765   304 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.324529 32615 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.327162 30678 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 4, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.329216 32692 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.324921 32653 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:22:29.331200 30926 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:29.331650 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.331604   305 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.345275 32558 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.309366 32712 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.319857 32738 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.344790 32614 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.343914 30927 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:29.322238 32465 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:29.363678 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.365820 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.369551 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.347039 32615 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.373107 30784 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:29.311944 32667 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.357096 32016 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.378525 32465 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.325529 32508 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.376129 32615 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.380867 30678 catalog_manager.cc:5697] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.360188   305 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:29.364073 32588 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:29.382272 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 71787us
I20260709 12:22:29.349265   307 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.377967 32614 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.394445 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:29.359280 32123 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.399425   316 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.401219 30678 catalog_manager.cc:5697] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 2 to 3, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 3 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.404115 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.380954 32407 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.364327 32334 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:22:29.387532 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:29.392925   305 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.438784 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.407125 30678 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.378873 32661 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:22:29.388103 32719 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.382174 32738 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.404754 32712 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.455323 32762 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.441941 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.456117 32738 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.456620   316 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.457267   316 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:29.457803   316 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.458963 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:29.460701   307 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.461418 32712 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.463546 32712 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.398438 32588 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.467707 32588 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:29.442708 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd65da5a34854820ae636ab77116f737 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 4)
W20260709 12:22:29.468688 30668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 87985.6us
I20260709 12:22:29.387251 32692 consensus_queue.cc:1059] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:22:29.406188   304 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.402766 32761 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.406179 32407 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.470356 32761 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.471881 32407 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.472548 32761 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.474802 32661 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:29.475449 32661 raft_consensus.cc:697] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:29.476540 32661 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:29.477262 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.480456 30927 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:29.397501 32016 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.483923 32016 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.448719   310 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:29.448726   312 log.cc:927] Time spent T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:22:29.469689 32469 raft_consensus.cc:3055] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:29.488984 30678 catalog_manager.cc:5697] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 3 to 4, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.494902 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:29.485018 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 81863.8us
I20260709 12:22:29.495831 30782 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:29.487409 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.487725 30826 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.492647 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.492789 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:29.500713 30927 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:29.500563 30678 catalog_manager.cc:5697] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 3 to 4, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:29.505626 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 97570.2us
I20260709 12:22:29.507331 31477 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:29.510118 32762 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:29.510845 32762 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.511672 32762 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.505437 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.515736 32123 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.516373 32738 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.516566 30785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "145501f8904547999755a27a5d421157"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:29.517470 30785 raft_consensus.cc:606] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:29.517879 30785 raft_consensus.cc:614] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:29.517993 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.515754 30826 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:29.520012   318 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 12:22:29.519917 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:29.527439 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.527758 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.517277 32614 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.493598 32469 raft_consensus.cc:740] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:29.488945   310 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:29.500183   304 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.547045 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.547972 30778 raft_consensus.cc:2410] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:22:29.533041 32516 consensus_meta.cc:287] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.578s	user 0.002s	sys 0.009s
I20260709 12:22:29.552860 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.545725 30678 catalog_manager.cc:5697] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 3 to 4, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.551525 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.490906 32719 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.493014 32653 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:22:29.562050 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.535065   300 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:29.563210   300 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.563632   300 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:29.565102   320 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:22:29.570098 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.558789 30778 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:29.528898 32738 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.558768 32558 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.560400 30857 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:29.560624 32614 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.493227 32334 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:22:29.583021 32611 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.575269 30900 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.534245 32542 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.535429   310 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.581977 30781 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:29.582156   305 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.582757 32719 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.550603   304 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.553696 32508 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.587121 30678 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: config changed from index 3 to 2, leader changed from <none> to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:29.633800 30778 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:29.561641 32469 consensus_queue.cc:260] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.603195 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.635329   316 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.639833   319 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:22:29.642952   316 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.643239   304 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:29.652920 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.661655 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.662379 30785 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:29.659426 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.667158 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.667915 30781 raft_consensus.cc:2393] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:29.598714 32542 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.666749 30853 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:29.638392 30678 catalog_manager.cc:5697] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 4, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 4 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:29.601033   300 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.653921 32719 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.662375 32469 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:29.689899 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 162214us
I20260709 12:22:29.691636 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:29.680435 32666 consensus_meta.cc:287] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 12:22:29.686079 32438 consensus_queue.cc:1059] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:22:29.678390 32738 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.659943   304 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:22:29.699642 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.703974   329 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.705255 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.707063 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.706190 32334 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:29.695470 32666 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.712041 32666 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.713393 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.714099 30851 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.717432 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:29.723790 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 120654us
I20260709 12:22:29.727638 30784 raft_consensus.cc:1275] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:29.727224 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.707120 32712 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:29.715380 32509 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:22:29.732169 30785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c32de69a76624466ad038a06e78980dd"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:29.732800 30785 raft_consensus.cc:606] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:29.733162 30785 raft_consensus.cc:614] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:29.720053 32123 raft_consensus.cc:3055] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:29.737915 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.722905 32334 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.725582 32611 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:29.722628   322 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.737826 32123 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:29.744488 30825 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:29.746456 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.715924 32761 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:22:29.714255 32738 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.751892 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.752493 30784 raft_consensus.cc:3060] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:29.752533 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.723400 32508 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:22:29.754225 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.741745 32016 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:29.742481 32334 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.759275 30785 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:29.734671 32407 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:22:29.761955 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.760893 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.738013 32465 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:29.777912 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.742139   316 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:22:29.764338 30860 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:29.791958 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:29.792191 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 71401.6us
I20260709 12:22:29.754199 32558 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.800652 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.802587 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:29.799739 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.758942   305 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.745309 32615 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.777346 32719 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.750360 32712 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:22:29.827685 30851 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:29.794317   300 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.833595 30784 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:29.835312 31476 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:29.836524   319 raft_consensus.cc:2804] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:29.837064   319 raft_consensus.cc:697] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:29.838191   319 consensus_queue.cc:237] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.812141 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:29.813067 32542 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:29.815574   327 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:22:29.816460   323 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:22:29.818495 32738 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:29.763845   309 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:22:29.749348   322 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.753674   301 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:22:29.764557 32611 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:29.791771 32334 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.807650 32509 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.866525 30926 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:29.827353 32705 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:29.865340 32761 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:29.821185 32516 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:22:29.804759 32123 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.878252   304 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.865206 32508 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:29.898774 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 139424us
W20260709 12:22:29.899408 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.869602 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.875818   336 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.881409 32558 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.879832 32611 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:29.887637   334 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 12:22:29.906659   325 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.269s	user 0.001s	sys 0.002s
I20260709 12:22:29.885355 32705 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:29.888881 32761 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.875265 32016 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 12:22:29.916698 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:29.918867 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 49370.5us
I20260709 12:22:29.927358 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:29.901666 32661 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.921923 32558 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.916682 32712 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.926028 32123 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:29.926240 32667 consensus_meta.cc:287] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.002s
I20260709 12:22:29.966130 32667 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.927944 32016 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:29.920099 32615 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.916581 32705 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:29.931185   322 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.932690 32465 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:29.912792   336 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.905449 32611 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:29.972332   336 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.934389 32761 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:29.980757 32705 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.913497 32508 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:29.936534   330 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:22:29.953148 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:29.984725 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.957329 30900 leader_election.cc:400] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:29.960314 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.985077 30851 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.960826 32506 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:29.962464 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:29.986871 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:29.907616 32601 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:22:29.985555 30776 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:29.988404 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.989384 30783 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:29.985669 30900 leader_election.cc:403] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:22:29.984441 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 84741us
I20260709 12:22:29.987478 30778 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:29.954571 32614 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:29.991900 32614 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:29.962071 32661 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:29.997416 32661 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.998021 32508 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:29.998430   329 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:29.955036 32666 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 12:22:30.002848 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.003686 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.005458 30928 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:30.015362 30851 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:30.016083 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.016971 31477 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:30.017277 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:29.936714   310 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:30.022341 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 221771us
I20260709 12:22:30.024864 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.026737 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:30.027077 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:30.027659 30857 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:30.030980 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:30.033910 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:30.012341 32712 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:29.982925 32762 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.051959 30929 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:30.048607 30777 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:30.045583 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:30.053165 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.058475 30783 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.053396 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.054459 30926 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:30.054162 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.061074 30928 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:30.052858 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.062554 30934 raft_consensus.cc:2393] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:30.035346 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:30.063016 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:30.063730 30851 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:30.063944 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:30.064952 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 107792us
I20260709 12:22:30.066234 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.074412 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.075568 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.076426 30931 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 1.
I20260709 12:22:30.008371 32516 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:22:30.079862 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.080406 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:30.081413 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.082191 30933 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:30.080539 30930 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:30.037237 32601 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:30.046432 32678 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.088722 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.065644 32653 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.074079 32506 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.019454   340 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:22:30.046895   344 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:30.104838 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.106232 32601 raft_consensus.cc:697] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:30.106596   345 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.106941 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:30.107218   345 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.107367 32601 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.107933 30851 raft_consensus.cc:3055] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:30.037055 32438 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:22:30.093396   319 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:30.109547   345 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.106261 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.091174 32678 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.109648 32542 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:30.128346 32678 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.128664   344 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:30.118520   309 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:30.128044 30851 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:30.111155   304 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.118090 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:30.129738 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.130788 30851 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.132019 30929 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:30.132113   336 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.133183 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.112708 32506 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:30.134341 32506 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.133742 30929 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:30.133729   344 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.132166 30851 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.149466 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:30.178026 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 85582.1us
W20260709 12:22:30.146757   327 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:30.178810 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:30.180713 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:30.182222 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.187542 30784 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:30.145738 32558 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.192289 32719 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.220976 32719 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.221530 32719 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.127909   319 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.236240   341 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:30.237636   349 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:22:30.238838 32762 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.150966 32588 consensus_queue.cc:1059] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:22:30.239404 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.240185 30785 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:30.240115 32588 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:30.240542 32588 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:30.241144 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:30.242693 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.243119 32611 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.252820 30778 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:30.255246 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:30.257656 30778 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.191221   336 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.217139 32407 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:30.274418 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.279949 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.282346 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.283334 30851 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:22:30.283967 30851 pending_rounds.cc:85] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 5
I20260709 12:22:30.284509 30851 pending_rounds.cc:107] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:22:30.286695 30851 raft_consensus.cc:2889] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:30.261680   323 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:22:30.290844 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:30.290724 32653 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:30.186308 32334 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:30.301260 30778 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:30.303216 30825 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:30.241402 32588 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.293278 31506 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:30.297066   309 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:30.291957 32615 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.289520   336 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.309425 32614 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:30.314683 32469 consensus_meta.cc:287] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
I20260709 12:22:30.315532   310 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.335582 30780 raft_consensus.cc:606] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:30.336047 30780 raft_consensus.cc:614] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:30.315353 32611 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:30.328817   350 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:22:30.311192 32506 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.318130 32761 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.350805 32667 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:30.326076 32615 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.356276 30857 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:22:30.359126   357 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:22:30.362414 32678 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.363336   336 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.363854 30934 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:30.347507   339 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:30.364624   339 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:30.364800 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.365677   339 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.366618 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.367300 30934 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.371560 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:30.381047 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:30.381871 30860 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:30.381596 30932 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 3: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:30.427110 30783 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:30.426594 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.418594 31477 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:30.428892 30778 raft_consensus.cc:2410] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:30.361531 32334 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:22:30.464673 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:30.432667 32666 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:30.434459 32509 consensus_meta.cc:287] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.004s
I20260709 12:22:30.476111 32509 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.417009 32661 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:22:30.479265 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.438617 30934 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:30.480777 32334 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.481025 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.481284 32588 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.481774 30934 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
W20260709 12:22:30.439723   367 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:22:30.453451 32761 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:30.455763 32615 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:30.457772 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.381402 32762 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:22:30.371436   309 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.492669 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:30.460642 32766 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:30.493779 31508 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:30.494004 32766 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:30.486414   339 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:22:30.461747   319 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.496920 32506 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:30.497674 31506 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:30.467502 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.499497 30935 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:30.499666 32506 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:30.469781 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.500763 30929 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:30.470189 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.467651 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.503021 30933 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:30.471496   369 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.471872 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.507022 30926 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:30.472142 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.507411 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:30.466655 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.474408 32678 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.474274 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.512915 30928 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:30.475328 32666 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:30.507820 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:30.519127 30778 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.513453 30777 raft_consensus.cc:1275] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:22:30.520388 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.525146 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.527446 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.530344 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.482883   345 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:22:30.495610 32766 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.538616 30778 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:30.522246 32666 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.558681   361 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:30.559285   361 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:30.560230   361 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.534571 32611 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.518750 32761 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.530581   304 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:30.562927   304 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:30.563324   304 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:30.565222 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.541625 30929 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:30.528184 32615 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:30.546446 32766 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.549237   369 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:30.549875 32705 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:30.551000 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:30.552729 32614 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:30.500185 32506 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.523172 32509 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:22:30.557175   359 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:30.531121   301 consensus_queue.cc:1048] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:22:30.574008 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:30.570289 30899 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:30.579258 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48995us
I20260709 12:22:30.592101 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.593722 30826 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.587289 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:30.602212 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:30.610724 30826 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.580792 32614 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:30.611675 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:30.612334 32615 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.612108 32614 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.613166 32615 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:30.613601 32615 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.613983 32615 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.612150 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.620738   359 raft_consensus.cc:3055] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:30.620956 32611 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:30.621230   359 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:30.621531 32611 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:30.621869 32614 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.622089 32611 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.622352   359 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.624009   359 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.625484 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.626474   339 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:30.626677   360 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.402s	user 0.004s	sys 0.000s
I20260709 12:22:30.578954   345 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:30.629478   339 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:30.617559 32506 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:30.630127   339 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.580363   369 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.575484   341 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:30.632717   369 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:30.638696 30826 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.640664 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:30.640875 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 71092.2us
I20260709 12:22:30.612659 31506 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.646984   345 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:30.665738   345 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.666311   345 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.633322   341 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.648039   369 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:30.649959 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.650925 32614 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:30.670842 32614 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.651708 30778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:22:30.674158 30778 raft_consensus.cc:606] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:22:30.673839 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:30.651798 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.675064 31508 raft_consensus.cc:2393] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:30.676777 32614 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:30.584131 32603 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:30.657187 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.678228   369 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:30.679304   369 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.680534 32603 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:30.681923 32603 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:30.683540   356 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.450s	user 0.004s	sys 0.000s
I20260709 12:22:30.683404 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:30.618263 30784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
W20260709 12:22:30.694854 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.694480 30784 raft_consensus.cc:606] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:30.695557 30784 raft_consensus.cc:614] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:30.660912   339 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:30.698755 30776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:22:30.699584 30776 raft_consensus.cc:606] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:22:30.701028 32334 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:30.702190 30781 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:22:30.704334 30678 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 176) took 11666 ms (client timeout 15000 ms). Trace:
I20260709 12:22:30.637588   304 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:30.710017 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 69479.2us
I20260709 12:22:30.711005 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.717535 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:30.704942 30678 rpcz_store.cc:269] 0709 12:22:19.067139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:19.071969 (+  4830us) service_pool.cc:224] Handling call
0709 12:22:19.855265 (+783296us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b54002b0110. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8fb0b2 00007f9616874759 00007f961680ca76 00007f96167ddd58 00007f96168dc04e 00007f9614d9d2a4 00007f9614d9d232 00007f9614d9d161 00007f9614d9d0dc
0709 12:22:21.774807 (+1919542us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610989090 00007f9610a27f3a 00007f96167dde9c 00007f96168dc04e 00007f9614d9d2a4 00007f9614d9d232 00007f9614d9d161 00007f9614d9d0dc 00007f9614d9c392 00007f960ed5a48c 00007f960ed598c6
0709 12:22:30.704249 (+8929442us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:29.835512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:29.836437 (+   925us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:29.836497 (+    60us) write_op.cc:435] Acquired schema lock
0709 12:22:29.836528 (+    31us) tablet.cc:662] Decoding operations
0709 12:22:29.839572 (+  3044us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:29.839679 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:29.839710 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:22:29.840710 (+  1000us) tablet.cc:701] Row locks acquired
0709 12:22:29.840729 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:22:29.840897 (+   168us) write_op.cc:270] Start()
0709 12:22:29.841027 (+   130us) write_op.cc:276] Timestamp: P: 1783599749840845 usec, L: 0
0709 12:22:29.841050 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:22:29.842017 (+   967us) log.cc:844] Serialized 4400 byte log entry
0709 12:22:30.147276 (+305259us) op_driver.cc:464] REPLICATION: finished
0709 12:22:30.285615 (+138339us) write_op.cc:301] APPLY: starting
0709 12:22:30.285730 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:30.335266 (+ 49536us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:30.357033 (+ 21767us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:30.472486 (+115453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:30.472741 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:22:30.472791 (+    50us) write_op.cc:312] APPLY: finished
0709 12:22:30.473099 (+   308us) log.cc:844] Serialized 76 byte log entry
0709 12:22:30.473282 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.473427 (+   145us) write_op.cc:454] Released schema lock
0709 12:22:30.473480 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:30.500393 (+ 26913us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:30.506940 (+  6547us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1852,"reported_tablets":37,"spinlock_wait_cycles":1327679232,"child_traces":[["op",{"apply.queue_time_us":134103,"apply.run_cpu_time_us":4476,"apply.run_wall_time_us":188262,"num_ops":10,"prepare.queue_time_us":78208,"prepare.run_cpu_time_us":33828,"prepare.run_wall_time_us":55293,"raft.queue_time_us":127969,"raft.run_cpu_time_us":13143,"raft.run_wall_time_us":206640,"replication_time_us":271554,"thread_start_us":303963,"threads_started":4,"wal-append.queue_time_us":57086}]]}
I20260709 12:22:30.715854 30899 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:30.689687   336 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:30.728459 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.664453 32611 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.731885 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:30.732411 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 553629us
W20260709 12:22:30.735208 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.742343 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.745668 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.716337 32334 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.728467   336 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.754592   336 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.748246 32509 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.755209 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:30.758814 32438 consensus_queue.cc:1059] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:30.759883 32438 raft_consensus.cc:3055] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:30.760211 32438 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:30.764000 30857 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 6. Ops: []
I20260709 12:22:30.723776   339 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:30.722679 30679 catalog_manager.cc:5697] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 4 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:30.771497 30856 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:30.764400 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
W20260709 12:22:30.741284 32719 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 12:22:30.774108 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:30.774781 30860 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:30.772109 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.775926 30929 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:30.777874 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.778069 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.778647 30929 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.778867 30927 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.709563 32615 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.749940 32508 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:30.767383 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:30.748481 32614 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:30.788192 30859 raft_consensus.cc:1240] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:30.790323 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:30.792097 30930 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:30.761106 32438 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:30.772584 30782 raft_consensus.cc:606] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:30.783715 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.796463 30852 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:30.797132 30932 raft_consensus.cc:2368] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5.
I20260709 12:22:30.784058 30851 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:30.716192 32601 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:22:30.773022   339 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.798255   339 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:30.799341 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:30.788244 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:30.801191 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:30.801383 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 55850.3us
I20260709 12:22:30.802191 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:30.802145 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:30.809919 30929 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:30.775296 30679 catalog_manager.cc:5697] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 3, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.811250 30858 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:30.816110 30927 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:30.811455 30679 catalog_manager.cc:5697] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 5, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.822760 30679 catalog_manager.cc:5697] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.789047 32508 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.789944 32614 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.830093 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:30.836798 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.837038 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:30.837713 30859 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.800972   359 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:30.800745 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:30.868422 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:30.825017 30679 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 2 to 3, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 2 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:30.782258 32719 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:30.839258 32508 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:30.937784 30860 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
W20260709 12:22:30.942554 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 140492us
I20260709 12:22:30.944144 30933 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:22:30.944677 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.902763 30679 catalog_manager.cc:5697] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 3, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:30.946496 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 87799.1us
I20260709 12:22:30.838766 32614 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:30.949522 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:30.967722 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:30.948771 30679 catalog_manager.cc:5697] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 5, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:30.996109 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49378.2us
I20260709 12:22:30.861594 32661 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:30.998697 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.011063 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:31.011720 30930 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.001411 30679 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:31.011835 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:31.024920 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:31.026598 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:30.951045 32123 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:30.945115   391 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:31.003383 32438 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.996608 31506 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
W20260709 12:22:31.065043 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:31.005851   362 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:22:30.951810 32666 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:31.032943   363 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.025110   310 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:22:31.069600   341 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:31.100742 31507 raft_consensus.cc:1240] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:31.079406 32686 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.025391 32661 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:31.072638   381 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.076313   393 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.088501 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:31.073340   345 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.069916 32123 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:31.102557   341 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:31.266656 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.206663 30667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 361153us
I20260709 12:22:31.295428 32666 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.355891   391 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:31.357313   391 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:31.374209 30826 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:31.376202 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:31.191967 31503 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:31.199723   390 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:22:31.456072 30930 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:31.132958 32611 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.285082   403 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.287119   393 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:31.198594 32766 consensus_meta.cc:287] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
W20260709 12:22:31.177943   388 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 12:22:31.177379   387 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 12:22:31.178496   380 log.cc:927] Time spent T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
W20260709 12:22:31.286537 32334 consensus_meta.cc:287] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.004s
W20260709 12:22:31.445158 30859 consensus_meta.cc:287] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.004s
I20260709 12:22:31.645484 30859 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
W20260709 12:22:31.461445 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.384940 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 358425us
W20260709 12:22:31.471318 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.648993 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.649520 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:31.475358 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 97687.2us
I20260709 12:22:31.256882   399 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:31.312542   400 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:22:31.150447 32615 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.306476 32661 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.200191 32719 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:31.385186   339 consensus_meta.cc:287] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.586s	user 0.014s	sys 0.000s
W20260709 12:22:31.363361 32558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.001s	sys 0.018s
I20260709 12:22:31.365087   341 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.137020 32686 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.446053   307 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.384543   407 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:31.146956   395 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:31.168756   396 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:31.207952   336 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.520635   409 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.520790   368 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.661669 32469 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:22:31.654256 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.637924   403 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.655236 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:31.645040 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 365851us
I20260709 12:22:31.660310 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.710006 30859 raft_consensus.cc:2393] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 2: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:31.661553 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:31.711476 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 50002.3us
I20260709 12:22:31.663421 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.712670 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:31.713224 30858 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:31.523255 32614 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.666589 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.658209 32334 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:31.706364 32508 consensus_meta.cc:287] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.776s	user 0.019s	sys 0.002s
W20260709 12:22:31.681799   405 log.cc:927] Time spent T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 12:22:31.665092   399 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:31.684464   383 log.cc:927] Time spent T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.734s	user 0.000s	sys 0.004s
I20260709 12:22:31.684801   307 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.686309 30929 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:22:31.686795 31508 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 237) took 1010 ms. Trace:
I20260709 12:22:31.667073   391 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:31.636525   393 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:31.617900 32509 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.862s	user 0.014s	sys 0.000s
I20260709 12:22:31.654958 30931 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 12:22:31.710413 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.709336 32469 consensus_queue.cc:1243] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 764ebfd36ce64b2a86e6d290ae92e276 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:31.661800   363 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:22:31.672727   339 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.719795 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:31.701561 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 149) took 1345 ms. Trace:
I20260709 12:22:31.723001 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.749186 30859 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:31.731432 30860 raft_consensus.cc:2368] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:31.732316 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.714665 30851 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:31.750933 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.751627 30851 raft_consensus.cc:2368] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:31.737284 30852 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:31.715590 32692 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.718057   409 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.698833   407 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.765002   407 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.765854   402 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:31.766181 30857 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:31.767246   420 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:31.767503   402 consensus_queue.cc:1059] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:22:31.768157 30900 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.567s (SENT)
I20260709 12:22:31.768702 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:31.699962   395 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.769304 32692 raft_consensus.cc:3055] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:31.769876 32692 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:31.771265   395 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.771027 32692 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.773036   369 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.774047 30858 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 1.
I20260709 12:22:31.776301 32712 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.776489   369 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.776834 32712 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.777184   369 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.748662   422 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.780757   422 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.783159   393 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.783309   422 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.730523 31508 rpcz_store.cc:276] 0709 12:22:30.676392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.687261 (+ 10869us) service_pool.cc:224] Handling call
0709 12:22:30.687666 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.688163 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.688199 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.688791 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.805410 (+116619us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:30.827134 (+ 21724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.838304 (+ 11170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.674339 (+836035us) raft_consensus.cc:1685] finished
0709 12:22:31.674359 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.686713 (+ 12354us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":91690,"threads_started":1,"wal-append.queue_time_us":147705}
I20260709 12:22:31.738699   345 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.760026   403 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.784523   369 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:31.747313 30853 rpcz_store.cc:276] 0709 12:22:30.356145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.358237 (+  2092us) service_pool.cc:224] Handling call
0709 12:22:30.367347 (+  9110us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faeee 000000000036eb39 00007f961596e1e0 00007f9615a370c4 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:30.367546 (+   199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.368377 (+   831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.368421 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.368987 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.747561 (+378574us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:30.752091 (+  4530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.767499 (+ 15408us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.690064 (+922565us) raft_consensus.cc:1685] finished
0709 12:22:31.690095 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.701481 (+ 11386us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":271,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":62,"spinlock_wait_cycles":14462336,"thread_start_us":351371,"threads_started":1,"wal-append.queue_time_us":457270}
I20260709 12:22:31.785861 32686 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.786855 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:31.787468 30853 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:22:31.789904 32438 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.724s	user 0.014s	sys 0.000s
I20260709 12:22:31.790460 30782 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:31.791496 30777 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:31.792763   336 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.739112 32509 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:31.794912 32614 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.722885 32766 consensus_queue.cc:1059] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:22:31.796284 32766 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.797117 32712 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:31.709021   368 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.762492   409 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.706164   396 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.798851   307 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:31.799032   368 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:31.799600   363 raft_consensus.cc:3055] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:31.799813 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:31.794656   377 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:31.800045   363 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:31.726852 32508 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.803122 30856 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:31.804006 32508 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.804380 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1298) took 1031 ms. Trace:
I20260709 12:22:31.804904 30856 rpcz_store.cc:276] 0709 12:22:30.773117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.773878 (+   761us) service_pool.cc:224] Handling call
0709 12:22:31.804144 (+1030266us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003a89d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:31.804311 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364462976}
I20260709 12:22:31.806448 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:31.807402 30856 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:31.761452 32123 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:31.760460   339 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.755018 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:31.817498 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:31.810181 30900 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.606s (SENT)
I20260709 12:22:31.818146 30852 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:31.818352 30856 raft_consensus.cc:2393] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:31.818312 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:31.818933 30859 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:31.796777 32766 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:31.813504   425 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:31.814235 32508 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.776547 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.820685 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:31.801070   363 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.823329 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:31.825699 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.799959   396 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.841375 30858 raft_consensus.cc:2393] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
W20260709 12:22:31.846061 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 87065.3us
I20260709 12:22:31.825374 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:31.847151 30856 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.785063   399 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.844746 30852 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.858780   363 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.843644   425 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:31.863889   425 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:31.825315   409 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.865826   409 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.868863 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.869846 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 166) took 1209 ms. Trace:
I20260709 12:22:31.869975 30860 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:31.871023 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.870240 30780 rpcz_store.cc:276] 0709 12:22:30.642395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.642974 (+   579us) service_pool.cc:224] Handling call
0709 12:22:30.643482 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.644011 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.644069 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.644714 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 12:22:30.796273 (+151559us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:30.796320 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:30.797865 (+  1545us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:31.683825 (+885960us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:31.844126 (+160301us) raft_consensus.cc:1685] finished
0709 12:22:31.844150 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:31.851240 (+  7090us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3759,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":24895360,"thread_start_us":149250,"threads_started":1,"wal-append.queue_time_us":216985}
I20260709 12:22:31.871618 30860 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:31.872540 30856 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:31.873299 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.873461 30859 raft_consensus.cc:1275] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:31.857489 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:31.877039 30860 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:31.879418 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:31.881176 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:31.825340   368 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:31.874805 31477 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:31.887523 30900 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:31.889075 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.895308 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:31.892675   307 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:31.897625 30900 leader_election.cc:400] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:31.898219 30900 leader_election.cc:403] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:31.895644 30858 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:31.899801 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:31.903837 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:31.904896 30780 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:31.907490 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:31.915134 30782 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:31.896656 32686 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:22:31.901150 32509 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.916266 32509 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:31.916810 32509 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.914852   428 consensus_queue.cc:1059] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:31.845746 32508 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.925405 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:31.891273 32016 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:31.929749 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:31.931265 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:31.907107   369 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:31.936273 30776 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:31.937489 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:31.910965   339 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:31.908114   425 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:31.943354 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:31.955242 30860 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:31.918371 32617 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:31.944815 32766 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:31.946663   409 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:31.938467   369 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:31.948944   418 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:22:31.920581   368 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:31.918344   424 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.950673 30851 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:31.985464 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:31.966604 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 51758.1us
I20260709 12:22:31.969462 30853 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:31.987939 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:31.986186 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:31.989629 30935 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:31.991966 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:31.992600 30860 raft_consensus.cc:1240] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:31.982462   409 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:31.982515 32617 raft_consensus.cc:697] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:31.999814   409 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.000469 32617 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:31.957618   425 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:32.002887 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.003888   425 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:32.004045 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.004491 32016 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:31.984741 32438 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:32.004776 30785 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:32.005285 32438 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:31.984436   368 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:32.005985   368 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:32.006225 32438 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.007707 32438 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.004590   359 raft_consensus.cc:3055] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:32.011332 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.011499 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:32.012171 30928 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 2: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:32.012310 30785 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.012887 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.005151 32016 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:31.983472   369 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:31.950263   339 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.016923 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.018518 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:32.016592 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.022496   428 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:22:31.987156   401 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:22:32.026435 32123 consensus_queue.cc:1059] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:32.023401 30935 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:31.991328   396 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.024540 30931 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:32.028738 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:31.994382 32614 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.010648   336 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.015177   359 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:32.024716 30851 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:32.046334 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.067260 30932 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:32.050617 30825 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:32.024272 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.048384 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1363) took 1252 ms. Trace:
I20260709 12:22:32.057190 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:32.063020 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 78651us
I20260709 12:22:32.071002 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:32.074831 30935 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:32.078715 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.068495 30930 rpcz_store.cc:276] 0709 12:22:30.796468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.611557 (+815089us) service_pool.cc:224] Handling call
0709 12:22:31.640638 (+ 29081us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:31.702730 (+ 62092us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:31.813941 (+111211us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.919069 (+105128us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:31.933273 (+ 14204us) log.cc:844] Serialized 52 byte log entry
0709 12:22:31.933469 (+   196us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:31.938694 (+  5225us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.048014 (+109320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.048095 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.048142 (+    47us) raft_consensus.cc:1685] finished
0709 12:22:32.048159 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.048320 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12154,"prepare.queue_time_us":119795,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":88440,"raft.run_cpu_time_us":481,"raft.run_wall_time_us":24129,"thread_start_us":340973,"threads_started":4,"wal-append.queue_time_us":191841}
I20260709 12:22:32.091938 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.092948 30935 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:32.094101 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.094861 30935 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:32.095994 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.096752 30935 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:32.098896 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:32.100190 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:32.102993 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.101740 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.047129   401 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:32.112334 30900 leader_election.cc:400] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:32.118650 30900 leader_election.cc:403] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:32.077407   408 log.cc:927] Time spent T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:22:32.048483 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:32.034600 32686 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:32.123261 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.124713 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:32.124708 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.126024 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:32.133275 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:32.133841 31509 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:32.117965   429 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:32.092391   409 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.147260   359 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.148367   359 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.099445   393 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:32.150595   393 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.151026   393 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.151754   339 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.089995 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:32.155606   307 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:32.117532 32469 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:32.156311   307 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:32.156411 32469 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.157106   307 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:32.157474   307 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.046955   396 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.159005 32469 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.141444 32123 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:32.160135   396 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.139602   401 raft_consensus.cc:697] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:32.160287 32123 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.131541 32719 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:32.162470 32123 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.163268 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.163936 30928 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:32.164855 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.165432 30928 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:32.167529 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.168669 32016 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.165961   429 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:32.170243 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.172581 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:32.144564   435 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:32.174150   435 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:32.062543   345 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:22:32.174008 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.170429 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:32.143846 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.173485 31509 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
W20260709 12:22:32.177313 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.172504 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.179672 30785 raft_consensus.cc:2410] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:32.176201 32508 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.198107 30780 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:32.181398   341 consensus_meta.cc:287] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.005s
I20260709 12:22:32.181995 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.170634   429 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:32.202538 30930 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:32.049089 32614 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.137153 32509 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.137282   368 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.222896 32614 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.223345   368 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.186398 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:32.223481   341 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.224290 30859 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:32.225031 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.225276 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:32.226104 30859 raft_consensus.cc:2393] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 5: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:32.228775   402 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:32.175359 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:32.229563   402 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.232503   402 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.232694 32719 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:32.233264   402 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:32.233515   429 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.234033   402 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:32.237497   402 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:32.240371 30857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1294) took 1473 ms (client timeout 1598 ms). Trace:
W20260709 12:22:32.240809 30857 rpcz_store.cc:269] 0709 12:22:30.767004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.767152 (+   148us) service_pool.cc:224] Handling call
0709 12:22:32.240131 (+1472979us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54003273d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:32.240307 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254350592}
I20260709 12:22:32.203107 32016 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.242133 30776 raft_consensus.cc:2410] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:32.242102 32016 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.243305 30857 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:32.244273 32016 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.252050 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:32.253551 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.254503 30777 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:32.254937 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.255462 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.255702 30776 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:32.255505 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.261503 32509 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.140992 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.191264 30852 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:32.187510 30781 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:32.161499   401 consensus_queue.cc:237] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:32.211495   385 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.135s	user 0.009s	sys 0.000s
I20260709 12:22:32.175359   435 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:32.213941   363 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.290588   363 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.214699   369 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.216154 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:32.293689 30851 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:32.209704 30778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54636
I20260709 12:22:32.296011 30851 raft_consensus.cc:1240] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:32.245532 30857 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:22:32.330817 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 204854us
I20260709 12:22:32.340049 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.306068 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.294711 30930 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:32.329134 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:32.883690 30930 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:32.885166 30930 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:32.339305 32686 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:32.304200 32712 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:32.892585 32712 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.292903   304 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.193048   307 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:32.362555   369 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.368541   393 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.351783   413 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:32.225615   341 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.333567   363 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.384121   429 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.917336   429 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.392094 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:32.542375   359 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.578516 30785 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:32.612172 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:32.919752 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.612974 30781 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:22:32.614888 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.615823 30780 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:32.921532 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:32.629874 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.922509 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.923182 30780 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
W20260709 12:22:32.923444 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:32.656113 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:32.660559   414 log.cc:927] Time spent T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 1.041s	user 0.002s	sys 0.001s
W20260709 12:22:32.668629   410 log.cc:927] Time spent T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.064s	user 0.002s	sys 0.004s
I20260709 12:22:32.676333 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:32.929600 30858 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:22:32.677906   424 consensus_meta.cc:287] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.666s	user 0.014s	sys 0.000s
I20260709 12:22:32.692957   435 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.693058   455 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:32.705214   406 log.cc:927] Time spent T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.179s	user 0.006s	sys 0.000s
I20260709 12:22:32.710913 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 153) took 1922 ms. Trace:
I20260709 12:22:32.719141 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:32.721916 30778 raft_consensus.cc:606] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 12:22:32.942188 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 155) took 2139 ms. Trace:
I20260709 12:22:32.944288 30778 raft_consensus.cc:614] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:32.943836 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:32.729112 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:32.734163 32719 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:32.929979   389 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:32.762463 30899 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:32.950481 30679 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 203) took 5066 ms. Trace:
W20260709 12:22:32.950594 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 188224us
I20260709 12:22:32.782891 32509 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:32.819573 31507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 234) took 2327 ms. Trace:
W20260709 12:22:32.820926   377 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.013s	sys 0.004s
W20260709 12:22:32.824442   412 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.142s	user 0.000s	sys 0.008s
W20260709 12:22:32.835390 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.028s	sys 0.036s
I20260709 12:22:32.838420 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1115) took 1170 ms. Trace:
W20260709 12:22:32.844698 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 660081us
I20260709 12:22:32.942200   424 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6.
I20260709 12:22:32.957175 30856 rpcz_store.cc:276] 0709 12:22:31.668613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.882303 (+213690us) service_pool.cc:224] Handling call
0709 12:22:31.882718 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:31.901280 (+ 18562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:31.901318 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:31.920573 (+ 19255us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.050272 (+129699us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:32.117480 (+ 67208us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.261521 (+144041us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b48000ce7d8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:22:32.836533 (+575012us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b180041f800. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:22:32.837989 (+  1456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.838115 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.838167 (+    52us) raft_consensus.cc:1685] finished
0709 12:22:32.838185 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.838348 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":751045,"prepare.queue_time_us":85999,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":763492,"raft.run_cpu_time_us":2305,"raft.run_wall_time_us":350400,"spinlock_wait_cycles":32177280,"thread_start_us":106921,"threads_started":1,"wal-append.queue_time_us":184771}
I20260709 12:22:32.851130 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:32.853576 30929 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:32.857247 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 160) took 1018 ms. Trace:
I20260709 12:22:32.859455 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1123) took 1115 ms. Trace:
I20260709 12:22:32.961496 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.867197 30851 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:22:32.964915 30851 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 12:22:32.964977 30856 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:32.867683   382 raft_consensus.cc:3055] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:32.871520 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1131) took 1045 ms. Trace:
I20260709 12:22:32.967296 30857 rpcz_store.cc:276] 0709 12:22:31.825944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.244962 (+419018us) service_pool.cc:224] Handling call
0709 12:22:32.245247 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.869701 (+624454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.871446 (+  1745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:32.875739   315 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:32.877064   384 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:32.878017 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:32.879289   368 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:32.880158 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:32.880498 30926 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:32.883785 30928 raft_consensus.cc:2393] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:32.333616 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 266263us
I20260709 12:22:32.886193 30931 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:33.005141 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.887878 32686 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.891196 30932 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:33.007874 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:33.009065 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:32.891378 30927 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:32.897547 32712 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.905378   393 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.906903   307 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.012625 30930 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:33.013748   307 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.909567 32692 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.015878 30926 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:32.932997 30858 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:32.933135 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1122) took 1189 ms. Trace:
I20260709 12:22:33.017099 30860 rpcz_store.cc:276] 0709 12:22:31.743629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.998898 (+255269us) service_pool.cc:224] Handling call
0709 12:22:32.025274 (+ 26376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.025533 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:32.118174 (+ 92641us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.866334 (+748160us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.932782 (+ 66448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.932841 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:32.932899 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.932968 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.933078 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567052,"prepare.queue_time_us":17769,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":81,"raft.queue_time_us":588839,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":7926,"thread_start_us":344484,"threads_started":3,"wal-append.queue_time_us":238803}
I20260709 12:22:32.942641 30854 rpcz_store.cc:276] 0709 12:22:30.789006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.789273 (+   267us) service_pool.cc:224] Handling call
0709 12:22:30.789656 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:31.012897 (+223241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:31.012929 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:31.013923 (+   994us) log.cc:844] Serialized 26 byte log entry
0709 12:22:32.271108 (+1257185us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b1800232300. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf0d1 00007f96109daa0f
0709 12:22:32.351336 (+ 80228us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:32.351404 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.352316 (+   912us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.710498 (+358182us) raft_consensus.cc:1685] finished
0709 12:22:32.710523 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.710838 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4050,"raft.queue_time_us":263233,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":9933,"spinlock_wait_cycles":6369024,"thread_start_us":298554,"threads_started":2,"wal-append.queue_time_us":1338557}
I20260709 12:22:32.737855   442 consensus_queue.cc:1059] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:32.934346 32508 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.020926 32508 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.023183 32508 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:32.951468 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:33.024121 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 72712us
I20260709 12:22:33.024858 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.026278 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.027050   409 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:32.943281   435 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:32.920711   359 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.027765   409 raft_consensus.cc:697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:33.028110 30935 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.029206   359 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.029376   393 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:32.954479   304 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:32.944324   403 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.954836   369 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:32.848567 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1121) took 1107 ms. Trace:
I20260709 12:22:33.030297   369 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.030784   369 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.030458 30853 rpcz_store.cc:276] 0709 12:22:31.741627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.996694 (+255067us) service_pool.cc:224] Handling call
0709 12:22:31.997093 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.997348 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:32.027619 (+ 30271us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.848203 (+820584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.848256 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:32.848296 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.848375 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.848503 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":726721,"prepare.queue_time_us":25284,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":753467,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":93421,"threads_started":1,"wal-append.queue_time_us":156546}
I20260709 12:22:32.955935 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 152) took 2169 ms. Trace:
I20260709 12:22:32.943198   411 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.030324   403 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.034363   411 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:33.036517   411 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:33.037009   393 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:32.955758   389 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:33.037595   393 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.039376   389 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:32.971354 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:33.039870   393 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.040123 30929 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:33.040619   442 raft_consensus.cc:3055] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:33.041208   442 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:33.033896 30855 rpcz_store.cc:276] 0709 12:22:30.786131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.786279 (+   148us) service_pool.cc:224] Handling call
0709 12:22:30.786596 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.858476 (+ 71880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.858506 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.878542 (+ 20036us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.269791 (+391249us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:31.449602 (+179811us) log.cc:844] Serialized 14 byte log entry
0709 12:22:31.659786 (+210184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.660181 (+   395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.659935 (+999754us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:32.955465 (+295530us) raft_consensus.cc:1685] finished
0709 12:22:32.955629 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.955822 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38086,"prepare.queue_time_us":389340,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":423787,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":33480,"spinlock_wait_cycles":128926080,"thread_start_us":593541,"threads_started":4,"wal-append.queue_time_us":461397}
W20260709 12:22:32.971451 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 93522.1us
I20260709 12:22:33.042217   442 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.043483   442 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.043967   453 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:22:32.970173 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.029s	sys 0.036s
I20260709 12:22:32.960654 30852 rpcz_store.cc:276] 0709 12:22:31.840993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.271128 (+430135us) service_pool.cc:224] Handling call
0709 12:22:32.271427 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.271627 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:32.295276 (+ 23649us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.856830 (+561554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.856912 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:32.856981 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.857059 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.857184 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":561277,"prepare.queue_time_us":23467,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":579768,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":49}
I20260709 12:22:32.961714 30859 rpcz_store.cc:276] 0709 12:22:31.743916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.226689 (+482773us) service_pool.cc:224] Handling call
0709 12:22:32.226979 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:32.257970 (+ 30991us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:32.258297 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 12:22:32.859075 (+600778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:32.859127 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:32.859173 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.859246 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.859380 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":519535,"prepare.queue_time_us":4805,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":535948,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":80808,"threads_started":1,"wal-append.queue_time_us":98529}
W20260709 12:22:32.956771   377 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.014s	sys 0.005s
I20260709 12:22:33.029206   435 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:33.049012 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:32.971174 30825 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:32.954263 31507 rpcz_store.cc:276] 0709 12:22:30.492638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.506807 (+ 14169us) service_pool.cc:224] Handling call
0709 12:22:30.562132 (+ 55325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:31.132489 (+570357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:32.819298 (+1686809us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540068ea54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:32.819488 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235079040}
W20260709 12:22:33.050127 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 79019us
I20260709 12:22:32.970238   382 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:32.982550   466 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:32.977878   315 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:32.950920 30679 rpcz_store.cc:276] 0709 12:22:27.879220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:27.890342 (+ 11122us) service_pool.cc:224] Handling call
0709 12:22:28.206988 (+316646us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610989090 00007f9610a27f3a 00007f96167dde9c 00007f96168dc04e 00007f9614d9d2a4 00007f9614d9d232 00007f9614d9d161 00007f9614d9d0dc 00007f9614d9c392 00007f960ed5a48c 00007f960ed598c6
0709 12:22:32.945130 (+4738142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:31.286425 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:31.300032 (+ 13607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:31.300082 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:22:31.300106 (+    24us) tablet.cc:662] Decoding operations
0709 12:22:31.301184 (+  1078us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:31.301259 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:31.301296 (+    37us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:22:31.302072 (+   776us) tablet.cc:701] Row locks acquired
0709 12:22:31.302089 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:22:31.302262 (+   173us) write_op.cc:270] Start()
0709 12:22:31.302388 (+   126us) write_op.cc:276] Timestamp: P: 1783599751302207 usec, L: 0
0709 12:22:31.302407 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:22:31.303190 (+   783us) log.cc:844] Serialized 3561 byte log entry
0709 12:22:31.807649 (+504459us) op_driver.cc:464] REPLICATION: finished
0709 12:22:32.102409 (+294760us) write_op.cc:301] APPLY: starting
0709 12:22:32.117001 (+ 14592us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:32.134635 (+ 17634us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:32.134746 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:32.136122 (+  1376us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:32.136359 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:22:32.136420 (+    61us) write_op.cc:312] APPLY: finished
0709 12:22:32.136730 (+   310us) log.cc:844] Serialized 64 byte log entry
0709 12:22:32.136916 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:32.137055 (+   139us) write_op.cc:454] Released schema lock
0709 12:22:32.137106 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:32.137470 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:32.137504 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":329,"reported_tablets":31,"spinlock_wait_cycles":32655104,"child_traces":[["op",{"apply.queue_time_us":255032,"apply.run_cpu_time_us":3270,"apply.run_wall_time_us":45501,"num_ops":8,"prepare.queue_time_us":189088,"prepare.run_cpu_time_us":4513,"prepare.run_wall_time_us":24932,"replication_time_us":505091,"thread_start_us":214656,"threads_started":2}]]}
I20260709 12:22:32.982797 30682 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.027400 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.066974   315 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.066610 30682 catalog_manager.cc:5697] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 2 to 4, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 4 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.068522   389 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:32.975483 32661 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:32.943465   455 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.065512 30750 leader_election.cc:400] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5.
I20260709 12:22:33.069258 32661 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.069478 30750 leader_election.cc:403] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:32.958593 32719 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.071067   455 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.984385 30857 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:22:32.995169 30730 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5e7509fe1be74f179626fb4fcb4b4e65 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:33.071934 30730 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:22:33.071992 32719 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:32.959219 32509 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:33.029798   392 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:33.072810   392 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.073220   392 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.068063 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.075485 32509 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:33.076686   389 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:33.076954 32469 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5.
I20260709 12:22:33.036468   403 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.051501   393 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:33.051746   382 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.078236 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:33.078662 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:33.078847   393 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.078573   382 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.068920 30682 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.080569 32469 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:33.081202 32469 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:33.082348 32469 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.028848   409 consensus_queue.cc:237] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.079293   393 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.050806 30825 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:33.086659 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:33.087149 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.088528   340 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:33.088732 30825 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.089349   340 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:33.091225 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.093451 30783 raft_consensus.cc:2393] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:33.062083   341 raft_consensus.cc:2764] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:33.093989   403 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:33.068614 30935 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:33.069815 32661 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.059876 30855 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:22:33.072366 30730 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:22:33.095631   363 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:32.992866 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1359) took 2200 ms. Trace:
I20260709 12:22:33.098059 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:33.098711 30783 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.098316 30934 rpcz_store.cc:276] 0709 12:22:30.792275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:30.793050 (+   775us) service_pool.cc:224] Handling call
0709 12:22:30.793417 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:30.820946 (+ 27529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:30.820999 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:30.831115 (+ 10116us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.270830 (+439715us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:31.270872 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.270946 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.823809 (+1552863us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:32.992474 (+168665us) raft_consensus.cc:1685] finished
0709 12:22:32.992496 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.992761 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":885,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9436,"spinlock_wait_cycles":11069312,"thread_start_us":266670,"threads_started":1,"wal-append.queue_time_us":757159}
I20260709 12:22:32.944294 30933 rpcz_store.cc:276] 0709 12:22:30.794769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:31.023898 (+229129us) service_pool.cc:224] Handling call
0709 12:22:31.057475 (+ 33577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:31.070354 (+ 12879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:31.070397 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:31.070988 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:22:31.260637 (+189649us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:31.260772 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:31.261098 (+   326us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:32.668044 (+1406946us) spinlock_profiling.cc:243] Waited 80.2 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:32.930594 (+262550us) raft_consensus.cc:1685] finished
0709 12:22:32.930615 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:32.934543 (+  3928us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3003,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7705,"spinlock_wait_cycles":184349056,"thread_start_us":127682,"threads_started":1,"wal-append.queue_time_us":291084}
I20260709 12:22:32.997993 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:33.090000   411 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:33.102190   411 raft_consensus.cc:697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:33.091907 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.090924   340 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.103379 30784 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:33.092558 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.095026 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.094370 30785 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:33.105347 30785 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:33.103096   411 consensus_queue.cc:237] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.106173 30785 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:33.107086 30785 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:33.052559 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 63957.3us
I20260709 12:22:33.109251 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:33.109540 32719 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:33.103044 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:33.111176 32719 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:33.111562 32719 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.111913 32719 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.114145 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.094930   403 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:33.117537 30779 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.120217 32719 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.122929 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:33.123785   363 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.124295 30779 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:33.124682   341 raft_consensus.cc:3055] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.125074   341 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:33.126106   341 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.129691 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.129873 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1113) took 1123 ms. Trace:
I20260709 12:22:33.130262 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.129873   392 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.131021 30780 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:33.131568   341 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.131880 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 1148) took 1129 ms. Trace:
I20260709 12:22:33.130963 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.132339 30779 rpcz_store.cc:276] 0709 12:22:32.002106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.010847 (+  8741us) service_pool.cc:224] Handling call
0709 12:22:32.175166 (+164319us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:33.131739 (+956573us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540008c5d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:33.131829 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045440128}
I20260709 12:22:33.137109 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:33.138265 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.113399 32661 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:33.148093 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:33.149287   363 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:33.149381 30783 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:33.152228 30785 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:22:33.189164 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.233112 30785 pending_rounds.cc:85] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:22:33.168046 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:33.207690 30825 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:33.150969 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.165235 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:33.233604 30785 pending_rounds.cc:107] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:33.187780 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:33.235045 30785 raft_consensus.cc:2889] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:33.189253 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.166320 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 286224us
I20260709 12:22:33.158994 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:33.237169 30782 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:33.217082 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 69086.5us
I20260709 12:22:33.195361 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.188913 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.238662 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:33.234788 30931 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.188053 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.238278 30825 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:33.239804 30851 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:33.229012 30899 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:33.130317 30935 rpcz_store.cc:276] 0709 12:22:32.006435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.720485 (+714050us) service_pool.cc:224] Handling call
0709 12:22:32.721124 (+   639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:33.129113 (+407989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:33.129644 (+   531us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540027c754. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:33.129816 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705652096}
I20260709 12:22:33.255584 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.257211 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.266677 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:33.267196 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 116325us
I20260709 12:22:33.268472 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:33.263829 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 95871.5us
I20260709 12:22:33.269621 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.259070 30750 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:33.290967 30931 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:33.293629 30782 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:33.225131 32615 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.206274   304 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.206552   389 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.171586 32661 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.305490 30851 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:33.149921   363 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.278864   384 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:33.383764 30713 debug-util.cc:398] Leaking SignalData structure 0x7b0800091700 after lost signal to thread 29612
I20260709 12:22:33.389806   363 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.265053   455 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.125s
I20260709 12:22:33.293941   442 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:33.258631 32509 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:33.390336 30713 debug-util.cc:398] Leaking SignalData structure 0x7b0800091de0 after lost signal to thread 30716
I20260709 12:22:33.390959 32509 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:33.277602   396 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.391780 32509 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.279901   307 consensus_queue.cc:1059] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
W20260709 12:22:33.329290 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.278462   409 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:33.279531   339 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:33.280516   368 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.259877   399 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:33.280671 32766 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:33.258818 32692 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:33.392112 30713 debug-util.cc:398] Leaking SignalData structure 0x7b080017dca0 after lost signal to thread 30809
W20260709 12:22:33.398440 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 126672us
I20260709 12:22:33.276731   466 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:33.280910   398 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:33.151824   415 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.208s
I20260709 12:22:33.394075   304 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.417984 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bb0278198af4c1aba82199de860057a"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:33.424721 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:33.426357 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 150547us
I20260709 12:22:33.254659   369 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.278311   340 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.130s
W20260709 12:22:33.438887 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 162496us
I20260709 12:22:33.393646   389 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:33.434537 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 175311us
I20260709 12:22:33.396519 32615 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.419979   399 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.616966 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.426506 32692 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.691571 32692 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:33.501276 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.693975 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:33.443208 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:33.627758 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 210655us
I20260709 12:22:33.706898 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:33.636005 30928 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:33.431906   368 raft_consensus.cc:697] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:33.507444 32719 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:33.433653   392 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.422394   396 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.202s
I20260709 12:22:33.442833   466 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:33.419693   409 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:33.702306 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 86293.7us
I20260709 12:22:33.742830 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.744146 30826 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.745383 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:33.702847   472 log.cc:927] Time spent T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
I20260709 12:22:33.684664   413 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.703524   304 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.703681 32614 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:33.725852 30713 debug-util.cc:398] Leaking SignalData structure 0x7b080035b780 after lost signal to thread 30884
I20260709 12:22:33.714978   442 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:33.694325   399 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.735757   396 consensus_queue.cc:1243] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:22:33.734942   416 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:33.709194   368 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:33.713371   468 raft_consensus.cc:3055] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:33.774135 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 327248us
I20260709 12:22:33.773491 30826 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:33.792829 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 174926us
I20260709 12:22:33.751940   392 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:33.796994 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:33.804697 30780 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:33.746057   466 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:33.742457 32469 consensus_queue.cc:1059] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:22:33.740816 32686 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:22:33.816143 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.749552 32766 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:22:33.823549 30780 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:33.786828   304 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:33.826176 30782 raft_consensus.cc:606] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:33.827934 30782 raft_consensus.cc:614] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:33.773177   487 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:33.790848   468 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:33.829514 30784 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:33.833720 30900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.002s	sys 0.014s
I20260709 12:22:33.764030   413 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:33.834743 30900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.002s	sys 0.015s
I20260709 12:22:33.840623 30776 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:22:33.845538 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.847141 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:33.826601   341 consensus_meta.cc:287] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 12:22:33.806883 32614 raft_consensus.cc:697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:33.815366   345 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:33.831140 30713 debug-util.cc:398] Leaking SignalData structure 0x7b0800118880 after lost signal to thread 30959
I20260709 12:22:33.817955   455 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:33.877274 30852 raft_consensus.cc:2955] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:33.831244   416 raft_consensus.cc:697] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
W20260709 12:22:33.824950 30750 connection.cc:256] RPC call timeout handler was delayed by -1.6009789059999093s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 12:22:33.862293 30853 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:33.862807 30778 raft_consensus.cc:2410] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:33.863624 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:33.864377 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:33.865145 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:33.865666 30858 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:33.827473   411 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:33.871069 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:33.831535   392 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:33.884063 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:33.886359 30854 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:33.886713 30856 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:33.885758 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:33.886374 30859 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:33.888813 30860 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:33.890033 30857 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
W20260709 12:22:33.915966 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:33.890501 30776 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:33.925964 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 109936us
I20260709 12:22:33.935065 30854 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:33.937414 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.947110 30860 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:33.874572   429 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:33.951766 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 80548.8us
I20260709 12:22:33.952169 30858 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:33.952657 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:33.953145 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:33.917701   484 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:33.958700 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:33.869261 30713 debug-util.cc:398] Leaking SignalData structure 0x7b0800347ee0 after lost signal to thread 30960
I20260709 12:22:33.885601   488 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:33.932106   482 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:34.007546 30859 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:33.934520   369 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:33.876268   345 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:33.880328 32692 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:33.862937   409 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:34.013478   476 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 12:22:34.010736   389 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.016709   484 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.060541 30856 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:33.954466   411 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 12:22:34.030764   479 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.346s	user 0.000s	sys 0.003s
I20260709 12:22:34.011052 32615 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:33.886299   442 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.955643   485 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.895288   455 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.031735   304 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:33.889995   487 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
W20260709 12:22:34.062479 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 109871us
I20260709 12:22:34.053534   495 raft_consensus.cc:3055] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:34.051203 32686 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:34.062686   490 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:34.100322 30713 debug-util.cc:398] Leaking SignalData structure 0x7b080033fe40 after lost signal to thread 31535
I20260709 12:22:34.102027   497 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:33.975508   429 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:33.946774 32614 consensus_queue.cc:237] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.049661   498 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:34.100034   475 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 12:22:34.163729 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 206600us
I20260709 12:22:34.185246 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:34.047434   396 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:34.167192 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 62351us
I20260709 12:22:33.947839   468 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.160775   424 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:34.177976 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 164253us
I20260709 12:22:34.186609 30826 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:34.170492 30713 debug-util.cc:398] Leaking SignalData structure 0x7b080015b460 after lost signal to thread 31536
W20260709 12:22:34.172220   393 consensus_meta.cc:287] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 1.086s	user 0.012s	sys 0.000s
I20260709 12:22:34.054853   307 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:34.161290   495 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.023483   482 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.022811   488 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.160631 32686 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.082062   389 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:22:34.102312   416 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.178467   497 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:34.190333   481 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260709 12:22:34.219775 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:34.219638 30929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.001s	sys 0.009s
W20260709 12:22:34.274837 30929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.002s	sys 0.009s
I20260709 12:22:34.220801 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:34.221213 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.221453 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.222093 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.275730 30934 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:34.276286 30927 raft_consensus.cc:2410] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:34.222251 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.165292   304 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:34.160459   494 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:34.155154   485 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.239128 30779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:34.284807 30779 raft_consensus.cc:606] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:34.220669   359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.003s	sys 0.009s
I20260709 12:22:34.239926   424 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:34.239948   415 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:34.252213 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.053885   392 raft_consensus.cc:697] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:34.260289 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.250455 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.216131   503 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.225656   396 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.268443 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.192893   498 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.275758 30926 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
W20260709 12:22:34.293229   359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.004s	sys 0.010s
I20260709 12:22:34.313146 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:34.277406 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 81164.5us
I20260709 12:22:34.274569 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.242493   413 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.225378   484 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.321491 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 164) took 1262 ms. Trace:
I20260709 12:22:34.322060   424 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.322880 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.321923 30929 rpcz_store.cc:276] 0709 12:22:33.058896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.061430 (+  2534us) service_pool.cc:224] Handling call
0709 12:22:33.134884 (+ 73454us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b54001c7e28. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f96159c3ebc 00007f96159f908c 00007f96159e393b 00007f96159e33d2 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c
0709 12:22:33.134993 (+   109us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:33.135374 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:33.135411 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:33.136101 (+   690us) log.cc:844] Serialized 52 byte log entry
0709 12:22:33.405109 (+269008us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:33.441986 (+ 36877us) log.cc:844] Serialized 14 byte log entry
0709 12:22:33.584608 (+142622us) log.cc:844] Serialized 14 byte log entry
0709 12:22:34.275206 (+690598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.275296 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:34.321285 (+ 45989us) raft_consensus.cc:1685] finished
0709 12:22:34.321307 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:34.321438 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169942,"prepare.queue_time_us":146642,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":1618,"raft.queue_time_us":543527,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":19078,"spinlock_wait_cycles":84363264,"thread_start_us":958928,"threads_started":2,"wal-append.queue_time_us":615891}
I20260709 12:22:34.319479 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.324496   304 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.297685 30933 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:34.298789 30931 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:34.301523 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.326478 30930 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:34.326964   429 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.328565   482 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.264467   493 consensus_queue.cc:1059] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:22:34.329221 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.329574 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.276376   511 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.253307   393 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.275583 30932 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.308882 30859 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:34.175215   490 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.266631   341 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:22:34.260301   307 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.265784 32766 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:22:34.225145 30928 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:34.329001   507 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:34.316756 30858 raft_consensus.cc:2393] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:34.319425   504 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:22:34.311623   495 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.354692   495 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.319794 31509 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:34.358227 30935 raft_consensus.cc:2410] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:34.294863   494 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.342731   511 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.361455   494 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:34.333914 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 116161us
I20260709 12:22:34.330607 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.392318 30776 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:34.341212 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.394119 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.394985 30859 raft_consensus.cc:2393] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:34.395795 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.396355 30859 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.312798   489 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.314919 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.345841 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.401118 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:34.321063   497 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.309098   415 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.329895   513 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:22:34.335546   413 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:34.364885   493 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:34.367058   392 consensus_queue.cc:237] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.359272 32692 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.367278   485 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.359323   490 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.337086 32686 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.371675   498 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.369866   455 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.379233 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.381907 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:34.378592 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.398648 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.404331 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:34.392827 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:34.406142 30932 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:34.410506 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:34.457082 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.418831 30859 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
W20260709 12:22:34.471367 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.413058 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:34.534637 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 130363us
I20260709 12:22:34.413869 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.398828   398 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.535072 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.541901 30899 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.537853   511 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:34.537541   466 consensus_meta.cc:287] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.002s
I20260709 12:22:34.543042   510 raft_consensus.cc:3055] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:34.556037 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.555706   466 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.556293 30933 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:34.556603 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.557286 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.557688 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.410948   516 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.558130 30851 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:34.558895   514 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:34.558501   516 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.559271 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.535439 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.560784   515 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:34.539788 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.540629 30854 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.559543   514 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.548480 31507 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:34.561569 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.561443   515 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.562489   514 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.563048 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.563848 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:34.564252 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.564530   498 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.519285   413 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.565011 30931 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:34.565105   498 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:34.549275   502 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.295s	user 0.002s	sys 0.000s
I20260709 12:22:34.566756   413 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.462453 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:22:34.552853 32509 consensus_meta.cc:287] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.160s	user 0.011s	sys 0.000s
I20260709 12:22:34.567742 31503 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEARNER]: Advancing to term 6
I20260709 12:22:34.568157 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.567974 32509 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.569401 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.578780 30852 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.535485 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:34.580410 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.581041   511 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:34.581642   511 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.553944   398 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.582477   413 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.561264   516 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.583894   511 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.584333   398 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.570094   498 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.585003 30854 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:34.477275   525 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:34.552183   488 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.546757   307 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.547534 32508 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:34.587702 30780 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:34.587764 32508 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.556046   510 raft_consensus.cc:740] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.561609 30932 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:34.589797 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.570801 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:34.573606 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 180842us
I20260709 12:22:34.600947 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:34.574368   508 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:22:34.544189   363 consensus_meta.cc:287] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.132s	user 0.009s	sys 0.005s
I20260709 12:22:34.548295   415 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.571877 32509 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.577360   497 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.578100   341 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:34.545223   530 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:22:34.587183 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.550513 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.590240 30854 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:34.590404 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.590981 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:34.631703 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.631901 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:34.561288 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:34.460806   399 consensus_meta.cc:287] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.002s
I20260709 12:22:34.571873 30930 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:34.594664 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.564214   515 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:34.580987 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 45590.7us
I20260709 12:22:34.597724 30784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:34.535472 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:34.654330 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:34.554303 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.605495 30852 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:34.588425 32508 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.655611 30826 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:34.414409   396 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:34.620184 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.623234 30926 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:34.626194 30933 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:34.621109   307 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:22:34.639038 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48710.7us
I20260709 12:22:34.660013 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.521647   482 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 12:22:34.639707   495 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:34.625741   341 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:34.621482   497 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:34.621699   363 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.642154   508 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:34.646946 30782 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:34.634416   510 consensus_queue.cc:260] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.634193 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.650910 30859 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.595983 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.655045 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:34.654338 30784 raft_consensus.cc:606] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:34.461985   520 raft_consensus.cc:3055] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:34.411875   489 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.398743   507 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.661953   398 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:34.668557 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.637490 31503 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:34.670809 32692 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.672676 30826 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:34.681810 30784 raft_consensus.cc:614] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:34.682057 30931 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:34.675307   503 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.664924   413 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.670437   424 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:34.691663 30854 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:34.733592 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.733952   507 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.724627   363 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.675307 30926 raft_consensus.cc:1240] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:34.612082   525 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.667140   411 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:34.695245 30859 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:34.654210   399 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.670248   490 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:34.667393   495 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:34.743461   495 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.676954   497 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.747226   525 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.749900   399 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.661507   396 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.750581   396 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.732424   510 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:34.751991   468 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.698812 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.741523   411 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.755090 30931 raft_consensus.cc:1240] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:34.756421   411 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.756666 30931 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:34.677172   466 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.690677   398 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:34.758198   398 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.749966 30927 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:34.715860   518 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:34.700322 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.693601   493 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.719190 30932 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 6. Ops: []
I20260709 12:22:34.669956 32614 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:22:34.685081   520 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.723645   489 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.696058   509 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:22:34.726267 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.774258 30784 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:34.774374   509 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:34.774899   509 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.775875 30930 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:34.695168   508 consensus_queue.cc:1243] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:34.700358 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:34.692024 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:34.735581 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.732299   413 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.699122 32692 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:34.686510   514 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:22:34.738842 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.725025   511 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:34.783772 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:34.739447   424 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.741931   490 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.742753 30926 raft_consensus.cc:1240] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:34.673254   341 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.761796 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:34.763334 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 63220.9us
I20260709 12:22:34.762698 30931 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:22:34.766238   493 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.765189   363 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.770375   520 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.773578   382 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:34.781205 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 82519.2us
I20260709 12:22:34.796568 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:34.797915 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:34.785804 32692 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.784493 30854 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:34.740736 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.790957 30933 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:34.791282 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.804847 30935 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:34.789579 30779 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:34.805116 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.763741   411 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:34.805002 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:34.785905 32614 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:34.806043 30859 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:34.783190   413 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.820164   393 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:34.822747 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.553s (SENT) [suppressed 5 similar messages]
I20260709 12:22:34.827289   490 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.827461 32686 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:34.829448 32614 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:34.830561 32614 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.788129   500 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.802881   511 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:34.776050   509 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.847213 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.849099 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:34.850008 30926 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.793202   363 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.814787   424 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.838217 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.839234 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.874421 30930 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.799103   382 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.843729 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.844681 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.886353 30858 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:34.844877   493 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.808708   484 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.852238 30933 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:34.855837 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.856823   497 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.858022 30899 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.783425 32508 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.866052 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.863837   511 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:34.894184 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.910318 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.910351 30858 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:34.817613   345 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.904439   509 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.900183   498 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.926074   498 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:34.927404 31508 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEARNER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:34.909152   435 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:34.930347 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:34.931502 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:34.890328   359 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:22:34.837177   411 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.934273   359 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:34.934701   359 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.885140   515 consensus_queue.cc:1059] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:22:34.935695   411 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.935487   359 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.936753   359 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.937083   411 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:34.906939 30899 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.937359 30857 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:34.938169 30851 raft_consensus.cc:2393] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:34.930372 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:34.917868 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.939262 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:34.939996   493 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:34.940356   493 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:34.940851   493 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.941962   340 raft_consensus.cc:2764] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:34.925096 30784 raft_consensus.cc:2410] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:34.944168 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:34.951701   497 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:34.952147   340 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:34.952636   340 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:34.864672   363 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.924157 30779 pending_rounds.cc:85] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 1
I20260709 12:22:34.954746 30779 pending_rounds.cc:107] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:22:34.955013 30779 raft_consensus.cc:2889] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:34.956235 30857 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:34.958038 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1330) took 1090 ms. Trace:
I20260709 12:22:34.958834 30857 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:22:34.958534 30856 rpcz_store.cc:276] 0709 12:22:33.867955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.925744 (+ 57789us) service_pool.cc:224] Handling call
0709 12:22:33.926206 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:34.060980 (+134774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:34.957748 (+896768us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400327dd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:34.957968 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308490496}
I20260709 12:22:34.959983 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.933631 32508 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.961392 32508 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.952999   340 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.961941 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:34.962520 30857 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:34.900302   524 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:34.965242   524 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.965461   382 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.966832   382 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:34.967916   524 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:34.884212   514 consensus_queue.cc:1059] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:22:34.969399   514 raft_consensus.cc:3055] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:34.969816   514 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.928864   498 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:34.760049   503 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.975104 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.981714 30856 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:34.982887 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.984230 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.975924 30777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:34.971617 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:34.979518 30825 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:34.986804 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.987792 30780 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:34.935927   515 raft_consensus.cc:3055] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:22:34.990651 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 83784.1us
W20260709 12:22:34.992251 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 48159.8us
I20260709 12:22:34.992393 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:34.993150 30780 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:34.998117 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 175405us
I20260709 12:22:34.998634 30899 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:34.970870   514 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:34.921196   511 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.015249 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.016213 30859 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:35.017807 30854 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.000072 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.024682 30857 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:35.025538 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:35.028550 30926 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:35.028769 30928 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
W20260709 12:22:35.031143 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.035979 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.043211 30780 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:34.991430   515 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:34.990522   435 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:35.047369 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.058240 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 1166) took 1869 ms. Trace:
I20260709 12:22:35.023136 32719 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:35.048980 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 50417.8us
I20260709 12:22:35.014065   369 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:35.020303   345 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:35.081249 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 55587us
I20260709 12:22:35.061882 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:35.047624 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.024792   508 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.064591 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:34.961943 32508 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.065083 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.058719 30778 rpcz_store.cc:276] 0709 12:22:33.188794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:33.188907 (+   113us) service_pool.cc:224] Handling call
0709 12:22:35.058009 (+1869102us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b540008cad4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:35.058168 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446233472}
I20260709 12:22:35.106935 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:35.053864 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:35.068434   516 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:35.020576   498 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:22:35.024307   510 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:22:35.099449 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.045549 32766 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:22:35.053215   413 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.053663   545 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:35.110351 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:35.097504 30858 raft_consensus.cc:1217] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 4.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 12:22:35.135767 30858 raft_consensus.cc:1240] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:22:35.070641   514 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.115798 30778 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:35.067701   369 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:35.116750   411 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.121053   516 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:35.147887 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:35.148736 30778 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.109885   508 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:35.117909 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.101523   345 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.123588 30859 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:35.152547   411 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.166611 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.167665 30859 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:35.129935 30928 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:35.068255   497 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:22:35.116811   525 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.170162   525 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:35.074302 32719 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.139422 32614 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.152453 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.121888 30855 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:22:35.163686 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 81604.2us
I20260709 12:22:35.147115   369 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.119179   396 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.179543 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:35.094686 30854 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:35.180325 30778 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:35.202646 30780 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:35.150274   516 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.219018 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.221414 30778 raft_consensus.cc:2410] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:22:35.219538 30860 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:35.221961 30856 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:35.143193   435 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.222724 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.122334   515 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.226271 30780 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:35.228086 30778 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:35.174381   341 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:35.232003 30860 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:35.181942   495 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.221453 32766 consensus_queue.cc:1059] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:22:35.265373 30776 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:35.266741   341 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:35.202195 32614 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.243197   508 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:35.234424   549 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:22:35.273360 32692 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.198161   554 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:22:35.276127   511 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.259681   515 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.316306 30860 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:22:35.257265 32508 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:35.302718   398 consensus_meta.cc:287] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.003s
I20260709 12:22:35.270977   503 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.239687   495 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.309213 30777 raft_consensus.cc:606] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:35.310425 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.233816   525 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:35.260746   498 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:35.320022 30777 raft_consensus.cc:614] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:35.245339   493 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.321038 30783 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:35.322453   498 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.325903 32766 raft_consensus.cc:3055] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:35.326402 32766 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:35.327373 32766 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:35.328759 32766 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:35.328379   369 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.323988   558 consensus_queue.cc:1059] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:22:35.333452 30853 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:35.342922 30778 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
W20260709 12:22:35.336452   468 consensus_meta.cc:287] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.001s
I20260709 12:22:35.319201   560 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:35.331210   411 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.338342   413 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.352823 30933 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:22:35.320601   398 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:35.344339   524 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:35.379132 30784 raft_consensus.cc:2410] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:35.374239   493 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.364316 32719 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:35.366065 32692 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.380281 30852 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:35.354755   345 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.366688   498 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.380541   398 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:35.367305   396 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.384614   363 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.352169   560 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:35.386498   560 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.393402 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.370674   519 raft_consensus.cc:3055] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:35.374253   413 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:35.345901   563 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:35.377938 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:35.378104 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.379376   524 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.360354   511 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.368512   520 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.397212 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.404430 30782 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:35.398599   519 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:35.408365   516 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.401325   413 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.410588 32614 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.412446   413 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.414944   363 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:35.418520 32686 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.590s	user 0.014s	sys 0.000s
I20260709 12:22:35.419628 30781 raft_consensus.cc:2410] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:35.420987   516 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:35.399245   563 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:35.441090 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 214028us
I20260709 12:22:35.445940 32686 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:35.446856   363 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:35.447265   363 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:35.447129   563 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.448262   363 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.431384   340 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.448731   563 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.451884 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:35.456668 30785 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:35.458720 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:35.463158 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.463208 30782 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:35.453516   363 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.463361 30780 raft_consensus.cc:1275] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:35.453564   498 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:22:35.464190 30779 raft_consensus.cc:2410] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:35.472323 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:35.475209   514 raft_consensus.cc:2764] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:35.472893   510 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:35.452183 32686 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:22:35.480254 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:35.460210 32692 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:35.487188 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.493804 30855 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:35.494148 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.487968 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:35.490227 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.476831   510 raft_consensus.cc:697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:35.495918 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.496219 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.494854 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.494839 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.449167   560 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.498273 30825 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:35.464001   369 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:35.500819 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.501077   413 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:35.501688   560 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.501994 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.502044 30825 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:35.502295   560 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.499975 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:35.503064   413 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:35.507100   509 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:35.507144   413 raft_consensus.cc:697] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:35.507532 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:35.507704   509 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:35.503058   560 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.508421   413 consensus_queue.cc:237] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.454245   569 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:22:35.510396 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.510665 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:35.508625   509 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:35.514232 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:35.515027   339 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:35.515563   339 raft_consensus.cc:697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:35.516404   339 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.522022   570 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.524633 32614 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:35.526930 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.527875 30784 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:35.531561 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.503625 30853 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:35.493609 32692 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:35.600184 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:35.601042 30784 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.601570 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.601348   510 consensus_queue.cc:237] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.602022   560 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.602810 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:35.610834 30784 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:35.598030 32692 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.614114 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:35.615899   340 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.620071 30781 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:35.619258 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 77136.2us
I20260709 12:22:35.600276 32686 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.639925 30855 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:35.621424   514 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:22:35.650228 30779 raft_consensus.cc:2410] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:35.641672   382 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:35.639345   563 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:22:35.645644   340 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:35.665320 30855 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:35.655855   382 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.662434   340 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.687603   340 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.688836 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1163) took 1016 ms. Trace:
I20260709 12:22:35.689312 30851 rpcz_store.cc:276] 0709 12:22:34.671989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.843481 (+171492us) service_pool.cc:224] Handling call
0709 12:22:35.688651 (+845170us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54004380d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:35.688775 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119376128}
I20260709 12:22:35.699759   524 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:35.704748 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 84798.4us
I20260709 12:22:35.707831 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.709494 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:35.720559   541 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.649s	user 0.003s	sys 0.000s
I20260709 12:22:35.713233   524 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:22:35.898731   427 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:35.890635   550 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.783s	user 0.003s	sys 0.006s
I20260709 12:22:35.891520 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.916687   427 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:35.917853 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.918476 30853 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:35.919001 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1388) took 1520 ms. Trace:
I20260709 12:22:35.920529   427 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.919416 30929 rpcz_store.cc:276] 0709 12:22:34.398678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.660248 (+261570us) service_pool.cc:224] Handling call
0709 12:22:34.803811 (+143563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:34.835459 (+ 31648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:34.835493 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:34.836017 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:22:35.068598 (+232581us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:35.068655 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.068733 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:35.889598 (+820865us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:35.917503 (+ 27905us) raft_consensus.cc:1685] finished
0709 12:22:35.917523 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:35.918844 (+  1321us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400222ed0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:35.918942 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23134,"raft.queue_time_us":4552,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":34172,"spinlock_wait_cycles":347675776,"thread_start_us":144795,"threads_started":1,"wal-append.queue_time_us":208352}
I20260709 12:22:35.888062 31509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42836 (request call id 193) took 1646 ms. Trace:
I20260709 12:22:35.796515 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.922441 31509 rpcz_store.cc:276] 0709 12:22:34.241114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.251185 (+ 10071us) service_pool.cc:224] Handling call
0709 12:22:34.305829 (+ 54644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:34.356425 (+ 50596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.887621 (+1531196us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b540006b154. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:35.887922 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11890432}
I20260709 12:22:35.921633 30860 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:35.764938 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 173) took 1193 ms. Trace:
I20260709 12:22:35.923683 30931 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:35.924072 30852 rpcz_store.cc:276] 0709 12:22:34.571391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.659184 (+ 87793us) service_pool.cc:224] Handling call
0709 12:22:34.659551 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.380759 (+721208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.764555 (+383796us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400436cd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:35.764839 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657000704}
I20260709 12:22:35.924646 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1404) took 1382 ms. Trace:
I20260709 12:22:35.812704   562 raft_consensus.cc:3055] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:35.925426 30931 rpcz_store.cc:276] 0709 12:22:34.542437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.846383 (+303946us) service_pool.cc:224] Handling call
0709 12:22:35.923165 (+1076782us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:35.923390 (+   225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.924347 (+   957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.924576 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14371712}
I20260709 12:22:35.926292   562 raft_consensus.cc:740] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:35.927202   562 consensus_queue.cc:260] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.928210   562 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:35.734329   382 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:35.738797 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.864866 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1384) took 1484 ms. Trace:
I20260709 12:22:35.935173 30932 rpcz_store.cc:276] 0709 12:22:34.380565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.599677 (+219112us) service_pool.cc:224] Handling call
0709 12:22:34.600004 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:34.764422 (+164418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.864427 (+1100005us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002247d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:35.864748 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273623808}
I20260709 12:22:35.946293 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1164) took 1142 ms. Trace:
I20260709 12:22:35.946769 30854 rpcz_store.cc:276] 0709 12:22:34.803840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.837931 (+ 34091us) service_pool.cc:224] Handling call
0709 12:22:35.946101 (+1108170us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54003bea54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:35.946222 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":343931136}
I20260709 12:22:35.949616   389 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:35.951205   543 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:35.951593   543 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:35.952540   543 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.953032 30825 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:35.953732   543 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:35.954018 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1200) took 1367 ms. Trace:
I20260709 12:22:35.954463 30776 rpcz_store.cc:276] 0709 12:22:34.586431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.586570 (+   139us) service_pool.cc:224] Handling call
0709 12:22:34.586899 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.265908 (+679009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:35.953780 (+687872us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54001a6b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:35.953955 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559788928}
I20260709 12:22:35.884591 32692 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.955976 30784 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:35.955935 30776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:35.956835 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:35.957084 32692 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:35.911398 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:35.958462 30780 raft_consensus.cc:2410] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:35.904116 30777 pending_rounds.cc:85] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 1
I20260709 12:22:35.963052 30777 pending_rounds.cc:107] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:22:35.963348 30777 raft_consensus.cc:2889] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:35.963559 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.967144   574 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:35.967762   415 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:35.968783   574 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:35.969161   574 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
W20260709 12:22:35.801533 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.971144 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.804788 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.971838 30854 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:35.836452 30781 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:35.957084 30776 raft_consensus.cc:606] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:35.971165 30826 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:35.974887 30776 raft_consensus.cc:614] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:35.974016 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:35.850950 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:35.970032   574 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:35.978199 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:35.980047 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:35.982087 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:35.978240   574 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:35.986281 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1344) took 1020 ms. Trace:
I20260709 12:22:35.986831 30856 rpcz_store.cc:276] 0709 12:22:34.965687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.061505 (+ 95818us) service_pool.cc:224] Handling call
0709 12:22:35.986073 (+924568us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540003edd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:35.986215 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290039680}
I20260709 12:22:35.987614   511 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:35.988446   399 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:35.988885   399 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:35.989277   399 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:35.994024   416 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:35.994270 30825 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:35.994562   416 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:35.994943   416 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:35.995355   543 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:35.996173   543 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:35.996757   543 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:35.997859 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.997700   543 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:35.999027 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.999207 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:35.999806 30851 raft_consensus.cc:2393] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:36.000433 31509 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:36.000532 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:36.000662 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:35.983063 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.001448 30851 raft_consensus.cc:2376] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:22:36.005256 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:36.001740 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:36.019874 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:36.007489 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:35.822955   576 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
W20260709 12:22:36.016265 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.022100 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:36.025862 30857 raft_consensus.cc:2376] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5. Re-sending same reply.
I20260709 12:22:36.024045 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:36.027846   574 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:36.028272   562 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:36.057659 30860 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:36.059890 30781 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:22:36.061151 30781 pending_rounds.cc:85] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:22:36.062333 30781 pending_rounds.cc:107] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:22:36.063274 30781 raft_consensus.cc:2889] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.079466   382 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.079936 32614 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:22:36.080098   382 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.082151   382 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.027241 32692 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:36.092089 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 69833.6us
W20260709 12:22:36.094954 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.097011 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:36.099236 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:36.100212 30855 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:36.090687 32692 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.056476   547 consensus_queue.cc:1059] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:22:36.125741 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1168) took 1205 ms. Trace:
I20260709 12:22:36.126399 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1408) took 1120 ms. Trace:
I20260709 12:22:36.126880 30930 rpcz_store.cc:276] 0709 12:22:35.005685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.006460 (+   775us) service_pool.cc:224] Handling call
0709 12:22:35.013403 (+  6943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.013613 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:35.128902 (+115289us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.125901 (+996999us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b180041ae80. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:22:36.126061 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:36.126108 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:36.126160 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.126229 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.126335 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3014,"prepare.queue_time_us":127449,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":36249856,"thread_start_us":127651,"threads_started":2,"wal-append.queue_time_us":99507}
I20260709 12:22:36.129343 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:36.115594 32692 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.126264 30858 rpcz_store.cc:276] 0709 12:22:34.920312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.922598 (+  2286us) service_pool.cc:224] Handling call
0709 12:22:35.097354 (+174756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:35.136219 (+ 38865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.125494 (+989275us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400076f50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:36.125669 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320940800}
W20260709 12:22:36.141541   590 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:22:36.163093 30777 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:36.139792   304 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:36.142817   398 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:36.168244 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1398) took 1706 ms. Trace:
I20260709 12:22:36.174367   398 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.178675   398 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.123800   416 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:36.185506 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:36.196158 30899 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:36.216814 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.217869 30932 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:36.219449 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.219736 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.220116 30932 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.220978 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.222349 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.224815 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.225128 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.218271 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.227651 30933 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:36.230479 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.230667 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.231034 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.231303 30931 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:36.231628   368 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.232306 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.232224   368 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.233863 30929 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:36.234372 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.235040 30934 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:36.235332 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.235968 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.236583 30934 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:36.231158 30926 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:36.238495   368 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:36.182466   304 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:36.241438   304 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:36.244278 30933 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:36.253379 30931 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:36.198664   525 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.225841 30930 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:36.257912 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.273403 30932 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:36.274941 30930 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:36.274871 30926 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
W20260709 12:22:36.276276 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 80254.2us
W20260709 12:22:36.284227 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 115578us
W20260709 12:22:36.287381 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.238987 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:36.326618 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 196562us
I20260709 12:22:36.213461   547 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:22:36.257328   369 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:36.330233 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 47047.4us
I20260709 12:22:36.333346 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:36.277601   411 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.323664   435 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:36.342410 30926 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:36.347718 30930 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:22:36.343109 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.348722 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.346730 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.349951 30932 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.360499 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:36.361536 30928 raft_consensus.cc:2393] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:36.362936 30932 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:36.365934 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.366873 30932 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:36.319335   413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.013s	sys 0.002s
I20260709 12:22:36.329838   482 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.278203   525 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.385872 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.387475 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.383703 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:36.409274 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 67059.1us
W20260709 12:22:36.411446 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 51061.6us
I20260709 12:22:36.339018   526 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.347339   563 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:36.414992 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:36.359251   508 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.416050 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.411281 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.430877 30928 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:36.389820   413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.014s	sys 0.003s
I20260709 12:22:36.417281 30932 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:36.339435   468 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 12:22:36.435947 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 107657us
I20260709 12:22:36.422569 30899 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:36.369648   435 raft_consensus.cc:697] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:36.341269   369 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.431347 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.348606   411 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.434495 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:36.434859 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.418762 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:36.438124 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.522593 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.523200 30932 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:36.509033 31477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.524230 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.525179 30926 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:36.418848   497 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:36.486613 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.526293 30928 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.527073 30926 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:36.408560 32469 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:36.528053   525 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:36.527866 32469 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.486759   547 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:36.529944   547 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.520340 30930 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:36.433017   516 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:36.519559 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 88667.7us
I20260709 12:22:36.528738   525 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:36.424445   505 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:22:36.409351   482 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.425671   526 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:36.518599 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 101687us
I20260709 12:22:36.557446 30926 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:36.436599 32719 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:22:36.435683   563 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:36.438920   508 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.533577   416 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.536947   525 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.531986 32469 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.534479 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:36.582477   602 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:22:36.583830   517 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:36.581410 30928 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:36.588683 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:36.590205 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:36.559715 30932 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:36.596293 30780 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:36.572151   455 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:36.596570 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:36.591960 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 57586.9us
I20260709 12:22:36.599720 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:36.601173 30932 raft_consensus.cc:2410] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:36.603818 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:36.604633 30928 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.599556 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:36.578787   547 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.583650   508 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:36.591663   525 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:36.612550 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:36.615967 30682 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 79) took 7556 ms. Trace:
I20260709 12:22:36.633527 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:36.619498   519 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:36.596662   468 raft_consensus.cc:2764] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:22:36.621603 32614 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:36.600785   435 consensus_queue.cc:237] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.606742   606 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:22:36.585837   497 consensus_queue.cc:1059] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:22:36.624029   369 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:36.631616 30928 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:36.595975   505 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.627846   610 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:36.634569   563 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:36.633443 30682 rpcz_store.cc:276] 0709 12:22:29.059242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:29.060060 (+   818us) service_pool.cc:224] Handling call
0709 12:22:36.615867 (+7555807us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:33.442615 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:33.817428 (+374813us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:33.824137 (+  6709us) write_op.cc:435] Acquired schema lock
0709 12:22:33.826954 (+  2817us) tablet.cc:662] Decoding operations
0709 12:22:34.010305 (+183351us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:34.014430 (+  4125us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:34.016128 (+  1698us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:22:34.107509 (+ 91381us) tablet.cc:701] Row locks acquired
0709 12:22:34.154282 (+ 46773us) write_op.cc:260] PREPARE: finished
0709 12:22:34.177082 (+ 22800us) write_op.cc:270] Start()
0709 12:22:34.188216 (+ 11134us) write_op.cc:276] Timestamp: P: 1783599754172743 usec, L: 0
0709 12:22:34.194956 (+  6740us) op_driver.cc:348] REPLICATION: starting
0709 12:22:34.317205 (+122249us) log.cc:844] Serialized 1301 byte log entry
0709 12:22:34.559684 (+242479us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1ae28 00007f9614455581 00007f9614454d58 00007f96144599f1 00007f96144599a9 00007f9614459939 00007f9614459901 00007f9614458b2d 0000000000388634 0000000000388479
0709 12:22:34.861988 (+302304us) op_driver.cc:464] REPLICATION: finished
0709 12:22:35.112157 (+250169us) write_op.cc:301] APPLY: starting
0709 12:22:35.121209 (+  9052us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:35.140675 (+ 19466us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:35.144189 (+  3514us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:35.246583 (+102394us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:35.257221 (+ 10638us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:22:35.257275 (+    54us) write_op.cc:312] APPLY: finished
0709 12:22:35.257598 (+   323us) log.cc:844] Serialized 34 byte log entry
0709 12:22:35.257814 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:35.257929 (+   115us) write_op.cc:454] Released schema lock
0709 12:22:35.257977 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:35.258416 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:35.258443 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62760,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":222936,"apply.run_cpu_time_us":3026,"apply.run_wall_time_us":160022,"num_ops":3,"prepare.queue_time_us":313124,"prepare.run_cpu_time_us":18591,"prepare.run_wall_time_us":1144043,"raft.queue_time_us":101886,"raft.run_cpu_time_us":25476,"raft.run_wall_time_us":191692,"replication_time_us":649540,"spinlock_wait_cycles":20441088,"thread_start_us":408051,"threads_started":4,"wal-append.queue_time_us":136590,"wal-append.run_cpu_time_us":9911,"wal-append.run_wall_time_us":1811044}]]}
I20260709 12:22:36.651773   611 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:36.665143   399 consensus_meta.cc:287] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.671s	user 0.014s	sys 0.000s
I20260709 12:22:36.663861   517 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:36.684072   596 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:22:36.685560   610 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.718883 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:36.739048   482 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.760815 32469 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:36.761266 32469 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:36.761603 32469 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:36.739694   411 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.740654   526 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:36.678273   505 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:36.764940   505 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:36.706910   604 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:22:36.656376 32614 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:36.768602 32614 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:36.770437 31506 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEARNER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:36.793589 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:36.794265   563 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.795042   563 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.793494   613 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:36.825249   613 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:36.826448   613 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.831096 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:36.832489 32692 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.690s	user 0.013s	sys 0.000s
I20260709 12:22:36.832965 32614 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:36.833576 32614 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.835119 30853 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:36.837257 32614 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.838322 30853 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:22:36.839849 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:36.840476 30853 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:36.842383 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.843115   558 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:36.843724 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.841692   498 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.838097   519 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.844755 30928 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:36.844607   498 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.845820 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:36.846969   498 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.849949 32692 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:36.831156 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 218681us
I20260709 12:22:36.874162   498 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.874712   498 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:36.875217 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:36.876976   498 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:36.855499 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:36.878765   573 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.365s	user 0.003s	sys 0.008s
I20260709 12:22:36.878877   488 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.883239 30926 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:22:36.887516   600 log.cc:927] Time spent T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.453s	user 0.002s	sys 0.000s
I20260709 12:22:36.877744 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:36.858546 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:36.864120 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1218) took 1701 ms. Trace:
I20260709 12:22:36.867448   510 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:36.853025   613 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.851697   429 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:36.877488   498 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:36.891211 30778 rpcz_store.cc:276] 0709 12:22:35.163124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.233129 (+ 70005us) service_pool.cc:224] Handling call
0709 12:22:35.233319 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:35.343769 (+110450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.863867 (+1520098us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540014e1d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:36.864048 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251639680}
I20260709 12:22:36.939898 30856 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
W20260709 12:22:36.940857 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 63122us
I20260709 12:22:36.717065   399 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:36.955468 30926 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:22:36.987113 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 144696us
I20260709 12:22:36.963907 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:36.957329 30931 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:22:36.967703 30783 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:36.988358 30931 pending_rounds.cc:85] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 4
I20260709 12:22:36.988632 30931 pending_rounds.cc:107] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:22:36.988857 30931 raft_consensus.cc:2889] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:36.989033 30926 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:36.958241 30928 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:36.945909   620 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:22:36.858007   563 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.965600   488 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:36.951895   513 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:36.951170   610 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.980902 32692 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:36.986362 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:36.955556   510 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:37.002061 30926 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:36.974265   626 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:36.975854   429 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.008972 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:37.009843 30852 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:37.011804 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:36.986034   498 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.018628   488 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:37.019109   488 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:37.019506   488 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:36.985602   611 consensus_queue.cc:1059] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:22:37.029322   399 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.026726   513 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:22:37.029841   429 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:37.010725   435 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:22:37.029193   340 raft_consensus.cc:993] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: : Instructing follower 764ebfd36ce64b2a86e6d290ae92e276 to start an election
I20260709 12:22:37.035054 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.056823 30783 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 2.
I20260709 12:22:37.026117   510 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.039693   614 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:37.041074 32469 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.018042   626 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.068903   614 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.042011   399 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:36.168677 30935 rpcz_store.cc:276] 0709 12:22:34.462066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:34.805636 (+343570us) service_pool.cc:224] Handling call
0709 12:22:34.806955 (+  1319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:34.807291 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:35.004496 (+197205us) log.cc:844] Serialized 14 byte log entry
0709 12:22:35.765392 (+760896us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b180041aee0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf23a
0709 12:22:36.167880 (+402488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:36.167932 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:36.167984 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.168045 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:36.168170 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":402215,"prepare.queue_time_us":304519,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4554,"raft.queue_time_us":402385,"spinlock_wait_cycles":4040960,"thread_start_us":260797,"threads_started":2,"wal-append.queue_time_us":167657}
I20260709 12:22:37.047986   525 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:37.055255 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.088804 30899 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:37.089736 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:37.091408 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.071519 32692 raft_consensus.cc:1081] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Signalling peer 764ebfd36ce64b2a86e6d290ae92e276 to start an election
I20260709 12:22:37.092821 32692 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:37.093532   509 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.576s	user 0.022s	sys 0.000s
I20260709 12:22:37.093384 32692 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:37.093922   509 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.576s	user 0.022s	sys 0.000s
I20260709 12:22:37.096385 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:37.064335 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.080811   626 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:37.081979   594 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.789s	user 0.000s	sys 0.006s
I20260709 12:22:37.069710   435 consensus_queue.cc:1243] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:37.083024 32469 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.090157 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.073310   399 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.068017   611 raft_consensus.cc:3055] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:37.167861 30930 raft_consensus.cc:1275] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:37.103556 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:37.169258 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 65779.7us
I20260709 12:22:37.170025 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.106727 30777 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:37.107686 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.171105 30785 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:37.109768 30776 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:22:37.110183   345 raft_consensus.cc:3055] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:37.113219 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.188998 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.119123 30779 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:37.190884 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.120677 30784 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:37.192356 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:37.192742 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.127660 30778 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:22:37.133874 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.195196 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.195839 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.195256 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.196419 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.197034 30782 raft_consensus.cc:2393] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:37.138057 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 50928.8us
W20260709 12:22:37.079615   609 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.374s	user 0.002s	sys 0.000s
W20260709 12:22:37.178316 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 81992.7us
I20260709 12:22:37.199154 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:37.199714 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.196556 30935 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:37.236943 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.239058 30932 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:37.073912   614 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:37.241339 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 50377.5us
W20260709 12:22:37.242731 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 44244.5us
I20260709 12:22:37.246568 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.117489   510 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.111547   563 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:37.256491 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 57449.8us
I20260709 12:22:37.278839 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:37.270394 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.263195 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:37.071775   488 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:37.328426 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 78795.2us
W20260709 12:22:37.332139 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 69030.1us
I20260709 12:22:37.192771   435 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:37.336102 31476 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:37.242013 32469 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:37.192063   611 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:37.188675   345 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:37.349434 30784 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:37.237994   628 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:37.246403   626 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.236019   392 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:37.247241   509 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:37.277688   563 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.330736   513 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:37.343315   435 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:37.385438   505 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:37.418687 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1419) took 1198 ms. Trace:
I20260709 12:22:37.348852   606 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.386993   396 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:37.436295 30927 rpcz_store.cc:276] 0709 12:22:36.220020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.220214 (+   194us) service_pool.cc:224] Handling call
0709 12:22:36.220547 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:36.324452 (+103905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.324486 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:36.325020 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:22:36.571851 (+246831us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:36.571912 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:36.572030 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.079045 (+507015us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:37.394360 (+315315us) raft_consensus.cc:1685] finished
0709 12:22:37.394384 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.418573 (+ 24189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103476,"raft.queue_time_us":103749,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":10431,"spinlock_wait_cycles":259193728,"thread_start_us":180657,"threads_started":1,"wal-append.queue_time_us":259053}
W20260709 12:22:37.453791 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 282712us
W20260709 12:22:37.476725   482 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.035s	sys 0.053s
W20260709 12:22:37.489185   482 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.036s	sys 0.053s
I20260709 12:22:37.349965 32614 consensus_queue.cc:1059] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:22:37.394183 32469 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:37.434607   435 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:37.412386   632 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:37.425359   368 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.428371   626 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.492458   633 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:37.499650 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:37.490667   345 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.522823   345 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.430972   563 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.427079   509 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:37.435564   624 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.392756   392 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.485613   513 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:37.535136   625 log.cc:927] Time spent T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.487s	user 0.001s	sys 0.000s
W20260709 12:22:37.537066   601 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.998s	user 0.002s	sys 0.001s
I20260709 12:22:37.493992   396 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.534343   626 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.546103   509 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:37.553658   525 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:37.491990   611 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.551488   624 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.581625   611 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:37.591251   624 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.592507   626 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:37.619973 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:37.470899 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 273162us
W20260709 12:22:37.626664 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.627300 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:37.634336 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.641358 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:37.642915 30860 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:37.647975 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.648344 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:37.649830 30927 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:37.651782 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 372885us
I20260709 12:22:37.652923 31509 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:37.653968 32719 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:37.657226 32508 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.543226 32692 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.658443 32508 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:37.659411 32692 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.549724 32614 raft_consensus.cc:3055] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:37.661072 32614 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:37.534060   368 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:22:37.662995 32614 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.664161 30935 raft_consensus.cc:1275] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:37.664772   488 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:37.668516 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:37.669394   416 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.685009 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:37.685886   399 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:37.687511   392 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:37.688720   519 consensus_queue.cc:1175] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:37.690135   396 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:37.692209 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 65429.2us
I20260709 12:22:37.698370   649 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.699618   649 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.703696 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:37.706965 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.708320   643 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.709266   643 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.712703   643 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.724970 30776 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 4. (term mismatch)
I20260709 12:22:37.726130 30776 pending_rounds.cc:85] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 3
I20260709 12:22:37.688781   641 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.726578 30776 pending_rounds.cc:107] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 12:22:37.727353 30776 raft_consensus.cc:2917] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 12:22:37.727082   641 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.728579 30776 raft_consensus.cc:2889] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:37.730011 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.730660   610 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:37.730815 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:54636 (request call id 70) took 5530 ms. Trace:
I20260709 12:22:37.729522 32508 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.731482   610 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.734354 30851 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 2.
I20260709 12:22:37.561911   498 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:37.741021 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:37.743374   610 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:37.755010 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1165) took 1409 ms. Trace:
I20260709 12:22:37.755538 30932 rpcz_store.cc:276] 0709 12:22:36.345675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.604976 (+259301us) service_pool.cc:224] Handling call
0709 12:22:36.605243 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:37.239620 (+634377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.754450 (+514830us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54002bb454. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:37.754813 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1457054464}
I20260709 12:22:37.759858   513 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.760987 32719 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:37.761590 32719 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.770889   525 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:22:37.771432 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.771744   525 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:37.772328 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:37.735554   416 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.776633   416 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.777400   368 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:37.779318   508 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:37.779814   508 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:37.780702 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 127272us
I20260709 12:22:37.781919 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:37.787796 30927 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:37.782294 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:37.785929 30852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1175) took 1752 ms (client timeout 1643 ms). Trace:
W20260709 12:22:37.790766 30852 rpcz_store.cc:269] 0709 12:22:35.993843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:35.997548 (+  3705us) service_pool.cc:224] Handling call
0709 12:22:37.745400 (+1747852us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003a7fd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:37.745858 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2324898560}
I20260709 12:22:37.781370   508 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.782371 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.773351   525 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.803894 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.805274   517 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:37.788822   639 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.819254 30860 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:37.796949   649 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:37.830257 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.836045   558 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:37.836565   558 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:37.837035   558 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:37.838917   626 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:22:37.840890   617 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.874s	user 0.002s	sys 0.011s
W20260709 12:22:37.843082   619 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.176s	user 0.009s	sys 0.004s
I20260709 12:22:37.843603   468 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.849097 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1422) took 1626 ms. Trace:
I20260709 12:22:37.852253 30934 rpcz_store.cc:276] 0709 12:22:36.220915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.243560 (+ 22645us) service_pool.cc:224] Handling call
0709 12:22:36.243968 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:36.577087 (+333119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.577139 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:36.578016 (+   877us) log.cc:844] Serialized 52 byte log entry
0709 12:22:36.608115 (+ 30099us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:36.830333 (+222218us) log.cc:844] Serialized 14 byte log entry
0709 12:22:36.830656 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.423642 (+592986us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54002a2454. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:37.423714 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.842089 (+418375us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:37.847414 (+  5325us) raft_consensus.cc:1685] finished
0709 12:22:37.847436 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.847734 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":746,"prepare.queue_time_us":229728,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":92468,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":24118,"spinlock_wait_cycles":858385536,"thread_start_us":299544,"threads_started":3,"wal-append.queue_time_us":68216}
I20260709 12:22:37.733706 30776 rpcz_store.cc:276] 0709 12:22:32.208751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:32.208932 (+   181us) service_pool.cc:224] Handling call
0709 12:22:32.576826 (+367894us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b540018a9a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961099c520 00007f9610a25b42 00007f9610a24800 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54 00007f960ef61be2 00007f960ef61b11 00007f960ef61a8c 00007f960ef60d42
0709 12:22:32.921523 (+344697us) log.cc:844] Serialized 501 byte log entry
0709 12:22:33.011305 (+ 89782us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b540018a9a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610998142 00007f9610978eaa 00007f961097fd53 00007f961097fcd9 00007f961097fc69 00007f961097fc31 00007f961097edfd 0000000000388634 0000000000388479 00007f960d932475
0709 12:22:37.730654 (+4719349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":594,"raft.run_cpu_time_us":2321,"raft.run_wall_time_us":56982,"spinlock_wait_cycles":51024512,"thread_start_us":52081,"threads_started":1,"wal-append.queue_time_us":203135,"wal-append.run_cpu_time_us":1882,"wal-append.run_wall_time_us":1001893}
I20260709 12:22:37.859200 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:37.846728   641 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:37.862262 30926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.003s	sys 0.007s
W20260709 12:22:37.883426 30926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.004s	sys 0.008s
W20260709 12:22:37.890564 30667 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:22:37.851039   639 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.878144   508 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:37.906324   603 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:37.907325   603 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:37.917479   640 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:22:37.920539 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1421) took 1698 ms. Trace:
I20260709 12:22:37.921033 30929 rpcz_store.cc:276] 0709 12:22:36.220651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.236539 (+ 15888us) service_pool.cc:224] Handling call
0709 12:22:36.236947 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:36.244527 (+  7580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:36.244580 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:37.354240 (+1109660us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b2c000623c8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2
0709 12:22:37.377726 (+ 23486us) log.cc:844] Serialized 52 byte log entry
0709 12:22:37.636869 (+259143us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:37.636980 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:37.637137 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:37.909869 (+272732us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b5400242aa0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610994dbe 00007f961099f930 00007f961099f8d8 00007f961099f858 00007f961099f813 00007f961099ea9c 00007f961688a2f6 00007f9616884aa8 00007f96109db7cb 00007f96109de2c0
0709 12:22:37.912005 (+  2136us) raft_consensus.cc:1685] finished
0709 12:22:37.912038 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:37.917731 (+  5693us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46561,"raft.queue_time_us":17291,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":16998,"spinlock_wait_cycles":235884544,"thread_start_us":154397,"threads_started":1,"wal-append.queue_time_us":194270}
I20260709 12:22:37.905418 32614 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:37.924736 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 121106us
W20260709 12:22:37.923616 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 91308.8us
I20260709 12:22:37.908972   603 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:37.928539   435 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.935537 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.936204 30777 raft_consensus.cc:1275] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:22:37.957101   652 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:22:37.958047   639 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:37.960556 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:37.961149   606 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:37.962224 30781 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:37.963254 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:37.963747 30825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.022s	sys 0.013s
W20260709 12:22:37.978776 30825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.022s	sys 0.013s
W20260709 12:22:37.982007 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 123092us
W20260709 12:22:37.985796   613 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.943s	user 0.014s	sys 0.002s
I20260709 12:22:37.987035 30930 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:37.990099   455 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:37.990932 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:37.990792   455 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:37.993211   626 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:37.993836   626 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:37.995111   626 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:38.005023   510 consensus_meta.cc:287] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.011s
W20260709 12:22:38.007529 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 672413us
I20260709 12:22:38.007745   639 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:38.009089   413 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:37.993527 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:38.038520 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:38.037068   652 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:22:38.045379 30784 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:38.048204 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:38.018607   455 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:37.984798 32719 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:38.060312 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.036795   613 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:22:38.068403 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:38.069061 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 105990us
I20260709 12:22:38.073171 30935 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
W20260709 12:22:38.078651   563 consensus_meta.cc:287] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.006s
I20260709 12:22:38.079277   563 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.080724 30780 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:22:38.081015 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.081670 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.080470   558 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.083691   563 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.098821 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.097698 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 186) took 1009 ms. Trace:
W20260709 12:22:38.102334 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.105080 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 111845us
I20260709 12:22:38.100977   558 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.100700 30926 rpcz_store.cc:276] 0709 12:22:37.088132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.089535 (+  1403us) service_pool.cc:224] Handling call
0709 12:22:37.089867 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:37.095937 (+  6070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:37.095969 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:37.110866 (+ 14897us) log.cc:844] Serialized 26 byte log entry
0709 12:22:37.913633 (+802767us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:38.045885 (+132252us) log.cc:844] Serialized 14 byte log entry
0709 12:22:38.090415 (+ 44530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.096711 (+  6296us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:38.097460 (+   749us) raft_consensus.cc:1685] finished
0709 12:22:38.097477 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:38.097634 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95637,"prepare.queue_time_us":126526,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":61222,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":31918,"spinlock_wait_cycles":16640,"thread_start_us":837872,"threads_started":2,"wal-append.queue_time_us":718960}
I20260709 12:22:38.106961 30825 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:38.117570 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:38.113631   631 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:38.109436   413 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:38.118450   497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.369s	user 0.021s	sys 0.021s
W20260709 12:22:38.125545 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 109595us
I20260709 12:22:38.127594   389 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.127750   641 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:38.128357   389 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.117455 32614 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:38.130424 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:38.132587 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:38.127326   497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.021s	sys 0.021s
I20260709 12:22:38.136793 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:38.137449 30784 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:22:38.138293 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.124189   435 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:38.131691   631 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:38.141043   389 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.138608 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:38.146531   631 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.132129   641 raft_consensus.cc:697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:38.163173 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 69581.5us
I20260709 12:22:38.142768   603 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:38.186410 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 47931us
I20260709 12:22:38.187422 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:38.188653   498 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:38.177371 30784 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:38.189514   641 consensus_queue.cc:237] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.198086   628 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:38.199240   498 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:38.167853 32614 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.167281 32719 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:38.170514   603 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.165957   558 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.200452   498 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.210976   603 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.209410   563 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:38.171049   413 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.235705 32614 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.237661 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:38.251634 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1221) took 1134 ms. Trace:
W20260709 12:22:38.253435 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.259262 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 83379.8us
I20260709 12:22:38.252292 30780 rpcz_store.cc:276] 0709 12:22:37.104392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:37.112257 (+  7865us) service_pool.cc:224] Handling call
0709 12:22:37.112551 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:38.081246 (+968695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:38.226701 (+145455us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54001eb4d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:38.238617 (+ 11916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225598336}
I20260709 12:22:38.266728 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:38.258217   563 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:38.268751   563 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.274204   413 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.260295   626 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:22:38.275421 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 49979.5us
I20260709 12:22:38.276507 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.277352   340 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:38.277894   340 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:38.278425   340 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:38.280716   661 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:22:38.286988   411 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:38.277676   659 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:22:38.294765 30899 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:38.296283 30899 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:38.297163   631 consensus_queue.cc:1059] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:38.297825   368 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:38.298331   368 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.298449   631 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:38.298765   368 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.298998   369 raft_consensus.cc:3055] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:38.299636   369 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:38.299705   508 raft_consensus.cc:3055] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:38.300276   508 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:38.300958   369 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:38.301396   508 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.302960   508 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.299093   631 raft_consensus.cc:697] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:38.306080 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:38.306730   631 consensus_queue.cc:237] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.308902   660 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.310925 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:38.316512 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.317868 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.318249 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.319796 30776 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:38.319970 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.319890 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.321026 30784 raft_consensus.cc:2368] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:38.321038   628 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:38.321813   628 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:38.322232   628 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.326422 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.327400   369 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.328965 30785 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:38.331221   626 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:38.331920   626 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.332244 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.345018 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.345742   455 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:38.307293 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.320924 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 54453.3us
W20260709 12:22:38.357050 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 46299.4us
I20260709 12:22:38.373850 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.374276   411 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.375052   411 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.375523 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.375979 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.376956 30776 raft_consensus.cc:2410] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:38.377100   398 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.377892 32508 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:38.378120   413 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:38.376943 30826 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.380641   655 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:38.377662   398 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:38.392863 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 44720.8us
I20260709 12:22:38.382851   603 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:38.447754   603 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.448882   628 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.452560 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:38.455602 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:38.456482 30930 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.458559 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.458940 31506 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:38.459096 30679 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 6, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.457778 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.460956 30778 raft_consensus.cc:2393] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:38.463320 30825 leader_election.cc:400] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:38.463687 30825 leader_election.cc:403] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:38.464923   543 consensus_queue.cc:1059] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:38.465896   543 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:22:38.467576 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 90718.8us
I20260709 12:22:38.468678 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:38.468966   509 consensus_meta.cc:287] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.662s	user 0.015s	sys 0.000s
I20260709 12:22:38.469573   411 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:38.470484   649 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.470705   509 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.465907   605 consensus_queue.cc:1059] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:22:38.472776 30780 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:38.473294   509 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.469961 32508 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:38.474057 32508 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:38.475240 32508 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.476771 32508 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.482219 30926 raft_consensus.cc:3055] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:38.482646 30926 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:38.483398 30926 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:38.484745 30926 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.456691 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:38.478789   628 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.488132   605 raft_consensus.cc:3055] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:38.490013   605 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:38.489542 30851 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:22:38.490931 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 75174.9us
W20260709 12:22:38.492339 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.494666 30785 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:22:38.495225 30785 pending_rounds.cc:85] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 3
I20260709 12:22:38.499445 30785 pending_rounds.cc:107] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:38.499974 30785 raft_consensus.cc:2889] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:38.509260 30780 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:38.512070 31509 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:22:38.514331   606 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:38.463335   398 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.516543 31503 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:38.517820   340 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.519326 30783 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:38.520555   340 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.522403   605 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.523815   605 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.498958   626 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.461200 30679 catalog_manager.cc:5697] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 4 to 6, term changed from 4 to 5, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68), VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted, no longer has a pending config: VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 5 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:38.534406   369 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:22:38.543455   369 consensus_queue.cc:1243] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:38.544036   369 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:38.543911 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.544515   369 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:38.510270   368 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.554383   369 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.550088   660 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:22:38.553465 30679 catalog_manager.cc:5697] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:38.563357 30785 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:38.565315   543 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3.
I20260709 12:22:38.568235 30679 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 3, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 3 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.583346   368 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:38.584923   488 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:38.586017 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48246.7us
I20260709 12:22:38.586580   488 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.586982 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.591384 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.593840 30780 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:38.589370 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:38.594513 30783 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:38.577057 30900 leader_election.cc:336] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.643s (SENT)
I20260709 12:22:38.566262   510 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:38.599622 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.577457   369 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:38.603188 30900 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:38.595397 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 236460us
I20260709 12:22:38.616232 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.612802 30679 catalog_manager.cc:5697] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 4, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 4 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.624603   424 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:22:38.625033   669 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:22:38.612390   641 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:38.637614 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.614060   488 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:38.655928 30679 catalog_manager.cc:5697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 5, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 5 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:38.637701   641 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:38.631047   543 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.604300   631 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:22:38.627426   368 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.642171   413 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:22:38.644526   649 consensus_queue.cc:1059] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 12:22:38.733155   666 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:22:38.734206   641 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:38.743933 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 157052us
W20260709 12:22:38.750324   672 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:22:38.751425 30926 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:38.767611 30826 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.771977   510 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:38.772611   510 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:38.759480   424 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.773473   424 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.775688   424 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:38.792727   416 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:38.794469 30781 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:22:38.794986 30781 pending_rounds.cc:85] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:22:38.795275 30781 pending_rounds.cc:107] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:38.795588 30781 raft_consensus.cc:2889] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:38.801645   368 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.812536 30930 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:38.815833   649 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:38.816149 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48701.4us
I20260709 12:22:38.816385   649 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:38.817139 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.817505   649 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.819384   649 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:38.820250 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:38.819954   411 consensus_queue.cc:1059] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:22:38.819306   655 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.822842   398 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:38.822875   655 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:38.823053 32614 raft_consensus.cc:3055] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:38.824743 32614 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:38.826104 32614 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.826448 30679 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.830624   413 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:38.831135   413 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:38.831394   411 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:38.832515   411 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:38.835381 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:38.838883   671 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:22:38.832265   413 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:38.843941 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 278723us
I20260709 12:22:38.806715 30783 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:38.849248 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:38.852366 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:38.828209 30679 catalog_manager.cc:5697] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.860278 30777 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:38.864871 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:38.865516 30679 catalog_manager.cc:5697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.869297   424 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:22:38.870929 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:38.871721 30851 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:38.875206   641 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:38.861315   606 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:38.878973   606 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:38.880105   606 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:38.870613 30679 catalog_manager.cc:5697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.888903 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:38.889580 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:38.890275 30929 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:38.891353 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:38.892131 31503 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:38.894275 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:38.894220 30679 catalog_manager.cc:5697] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 4, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 4 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:38.895063 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:38.895257 30856 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:38.895697 30853 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:38.895884 30679 catalog_manager.cc:5697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:38.896660 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:38.897408 30854 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:38.897706 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:38.898285 30858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c"
dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:42858
I20260709 12:22:38.898416 30860 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:38.898775 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:38.898972 30858 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:38.899434 30858 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.899466 30859 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:38.901680 30782 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:38.902338 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:38.903571 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:38.904031 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:38.904842 30857 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:38.901500 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:38.904348 30933 raft_consensus.cc:2410] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:38.905834 30851 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:38.983641 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:39.002846 30929 raft_consensus.cc:2410] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:38.990424 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:39.008798 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 97452.7us
I20260709 12:22:38.909422 30679 catalog_manager.cc:5697] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:39.015089 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:39.016463 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 196359us
I20260709 12:22:39.017923 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:38.862600 32614 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:38.863452   563 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.008311   369 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:38.959539   413 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:39.024818 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:39.007647   411 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:38.906410   641 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:39.025851 30679 catalog_manager.cc:5697] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 4, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 4 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:39.027369 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:38.958269   513 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.035182 30858 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:39.039197 30783 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:39.040580 30679 catalog_manager.cc:5697] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 5, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 5 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:39.047422 30679 catalog_manager.cc:5697] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 5, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 5 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:39.043952   660 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:22:39.048923 30679 catalog_manager.cc:5697] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:39.053722 30679 catalog_manager.cc:5697] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 4, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:39.055935 30679 catalog_manager.cc:5697] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 4, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 4 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:39.058058 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:39.058738 30856 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:39.021701   368 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:39.061125 30679 catalog_manager.cc:5697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:39.070938 30853 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:39.079228 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:39.114661 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.118491 30858 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:39.113306 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:39.039635   369 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:39.063539   513 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:39.128811 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 85561.9us
I20260709 12:22:39.115918 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21608c221fae4caf8e15b6588f457432"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:39.135144 30782 raft_consensus.cc:606] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:39.135639 30782 raft_consensus.cc:614] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:39.040146   563 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:39.137246 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:39.139907 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:39.140328 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:39.140717 30927 raft_consensus.cc:2393] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:39.140937 30853 raft_consensus.cc:2410] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:39.141614 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:39.141820 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:39.149667 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:39.149950 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:39.151062 30928 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:39.149928 30929 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:39.147553 30679 catalog_manager.cc:5697] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 3, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:39.163655   513 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:39.164640 30859 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:39.167196 30856 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
W20260709 12:22:39.177377 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.174669 30679 catalog_manager.cc:5697] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:39.198596   693 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:22:39.199159 30931 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:39.200877   563 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:39.201330   684 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.387s	user 0.001s	sys 0.001s
W20260709 12:22:39.184291   688 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:22:39.204728 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:39.178707   681 log.cc:927] Time spent T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.338s	user 0.002s	sys 0.002s
I20260709 12:22:39.204501 30899 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:39.209259 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:39.216948 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:39.217679 30780 raft_consensus.cc:606] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:39.218061 30780 raft_consensus.cc:614] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:39.222030 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:39.224350 30931 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:39.221503 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:39.225543 30899 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:39.228274   674 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.439s	user 0.003s	sys 0.000s
I20260709 12:22:39.172226   510 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:39.232064   510 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:39.234998 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.236718 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:39.237299 30780 raft_consensus.cc:606] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:39.237920   424 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:39.238368 30928 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:39.239356 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:39.239985 30928 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:39.240535 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:39.241293 30780 raft_consensus.cc:606] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:39.241670 30780 raft_consensus.cc:614] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:39.244639 30780 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:39.247272 30780 raft_consensus.cc:606] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:39.247695 30780 raft_consensus.cc:614] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:39.217142   641 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:39.251163 30931 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:39.262535 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:39.270673   649 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:39.271042 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:39.273947 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:39.274653 30932 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
W20260709 12:22:39.275633   694 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:39.294454 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:39.303951   660 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:39.258385   424 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:39.307343 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:22:39.397346 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.294391   509 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:39.467578 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:39.468916 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 211907us
I20260709 12:22:39.303069   558 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:39.280328 30931 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:39.461390 30934 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:39.492811 30856 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:22:39.478703 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 263356us
I20260709 12:22:39.475303 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:39.499648 30930 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:39.500850 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:39.457724 30928 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:39.467303 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:39.472893 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:39.522308 30784 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:39.522431 30853 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:39.522764 30784 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:39.469949 30667 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e7509fe1be74f179626fb4fcb4b4e65 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:39.503391 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:39.508239 30782 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:39.524501 30935 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:39.528407 30784 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:39.529433 30784 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:39.529603   631 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.530138   631 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:39.493324   563 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.532122   631 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:39.532377   563 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:39.533864   398 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.534906 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.534538   398 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:39.536763   563 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:39.537089   398 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:39.537899   696 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.538480   696 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:39.539064 30858 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:39.540692   696 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:39.472779   660 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:39.473888   488 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.493228   679 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.473546   424 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:39.858438 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.025396 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:39.524281 30667 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 54381us
I20260709 12:22:39.652611 30852 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
W20260709 12:22:40.023756 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:39.551220 30856 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:39.547611 30784 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
W20260709 12:22:40.024262 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 554648us
I20260709 12:22:39.543747 30853 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
W20260709 12:22:39.669977 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 179584us
I20260709 12:22:39.658350 30931 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:39.475169   513 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.496095   369 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:40.037025 32614 consensus_meta.cc:287] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 1.010s	user 0.009s	sys 0.008s
I20260709 12:22:39.489531   509 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:39.883162 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.522s (SENT) [suppressed 8 similar messages]
I20260709 12:22:39.476538   698 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.003144   413 consensus_meta.cc:287] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.963s	user 0.012s	sys 0.004s
W20260709 12:22:40.047433 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 486531us
I20260709 12:22:39.878319   641 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:39.610453   563 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:39.711887   683 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.035393   660 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:40.033874   678 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.066824   678 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:40.069453   678 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:39.987862   631 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:40.059965 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.046670   513 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.066013   563 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.049288   509 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:39.580025   398 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.475s
I20260709 12:22:40.039090   488 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.073834   678 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.074409 31474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.007s
I20260709 12:22:40.039222   679 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:40.074898   700 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.583s	user 0.000s	sys 0.002s
I20260709 12:22:40.072682   683 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.071902 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.049669   369 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:40.070119   453 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.006s	sys 0.005s
I20260709 12:22:40.050734   649 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.089308 30857 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
W20260709 12:22:40.110674 31474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.004s	sys 0.008s
I20260709 12:22:40.114748 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:40.124137 30927 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:40.051826   641 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.106793   413 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:40.119335   453 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.006s	sys 0.005s
I20260709 12:22:40.052474   698 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:40.146215 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 420561us
W20260709 12:22:40.146586 30825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.023s
W20260709 12:22:40.147030 30825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.005s	sys 0.023s
W20260709 12:22:40.147442 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 600045us
I20260709 12:22:40.106249   631 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.107823   563 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.159694   558 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:40.124989   649 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.139868   682 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:40.123324   369 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.163442 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1402) took 1028 ms. Trace:
I20260709 12:22:40.161563   723 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:22:40.166487   686 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:40.167352   513 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.177134 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.217260 30784 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
W20260709 12:22:40.125629 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 53817.8us
I20260709 12:22:40.115708   678 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.211916 30857 rpcz_store.cc:276] 0709 12:22:39.138729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.138854 (+   125us) service_pool.cc:224] Handling call
0709 12:22:40.163262 (+1024408us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b5400377dd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:40.163377 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2074100096}
I20260709 12:22:40.202064   682 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.250180   631 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.247586 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:40.253567 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 224296us
I20260709 12:22:40.258291 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.168169   413 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.209061   720 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.250216   509 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.201810   558 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.256309   682 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:40.372565 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 489390us
W20260709 12:22:40.380623 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 232413us
W20260709 12:22:40.401419 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 185342us
I20260709 12:22:40.402166   488 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.260043   726 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.397413 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.231976   717 consensus_queue.cc:1059] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:22:40.402204 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:40.410583 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 153050us
I20260709 12:22:40.414913 30784 raft_consensus.cc:1275] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:40.278298   720 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.414534 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.443295 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.443984 30784 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
W20260709 12:22:40.415580 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.406894   368 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.455861 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:40.457551 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 334308us
I20260709 12:22:40.406723   726 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:40.469455 30784 raft_consensus.cc:1240] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:40.449834   701 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.472779 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:40.471942 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 191198us
I20260709 12:22:40.460345   723 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:40.456856   724 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:40.485189   708 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:22:40.462313   683 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.489373   683 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.471544   424 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:40.490334   509 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.490254   424 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.490998   509 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:40.491500   509 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.493637   369 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.471964   679 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.494655   679 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:40.495328   679 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:40.497679   721 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:22:40.472005   368 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.499874   368 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.478524   701 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.501390   701 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.465617   726 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.493001   424 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.510816   641 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.512079   649 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.489398   413 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.517812 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.493471   509 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:40.520968 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 44557.4us
W20260709 12:22:40.518162   719 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.267s	user 0.001s	sys 0.004s
I20260709 12:22:40.525130   679 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.533020   701 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:40.534011   698 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.607017 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.607332 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.607786 30777 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:40.537750 31509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 252) took 1287 ms. Trace:
I20260709 12:22:40.538450   737 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:40.543057   720 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.543646   678 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:40.546459 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.519163   723 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:40.549227   733 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:40.549290 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:40.550995   413 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:40.552094   574 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:40.536402   660 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.554349   739 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:40.555181 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 76669.5us
I20260709 12:22:40.514788   683 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:40.558034 32614 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.560353   641 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.568149   696 raft_consensus.cc:3055] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:40.572942 30853 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:40.573691   563 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:40.585171 30900 leader_election.cc:336] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.853s (SENT)
I20260709 12:22:40.589340 30930 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:40.607893 30782 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:40.553524   558 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:40.641618 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.656508 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:40.656944 30853 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:40.609645 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:40.659874 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.661803 32614 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.662163   739 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:40.665158 32614 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.665244   683 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.667111   574 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:40.670572 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 121335us
I20260709 12:22:40.670949   733 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.671540   733 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:40.672089   733 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.672268   641 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.674590   723 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.675810   641 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.518529   724 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:40.656917   696 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:40.680066   724 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:40.679363   696 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:40.621031   701 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.613721 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.672099 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:40.692435 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.692798   413 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.693552 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.694499 30826 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:40.694448   679 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:40.696099   413 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:40.696192 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.696578   679 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.525452   424 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:40.697157   679 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:40.698062   727 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:40.697849   424 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.698769   727 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:40.700165 30899 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:40.699860   727 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.700902   424 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.701632   424 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.697638   679 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.701989   558 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:40.702036   737 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:40.702232   424 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.702700   558 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:40.702956   737 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:40.703272   368 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:40.703809   558 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.703882   368 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.711943   368 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.705719   701 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:22:40.715327 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:40.717686 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:40.704874   698 consensus_queue.cc:1048] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:40.718181 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:40.705266   558 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.706241   696 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.595165   682 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.724102   682 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.706987 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.725395 30782 raft_consensus.cc:2410] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:40.707423   574 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.708173 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.726536   413 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:22:40.727046 30779 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:40.709030 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.709115   660 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:40.709847   488 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:40.728951   488 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.729358   488 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.665170   739 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:40.716001 30930 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.732882 30933 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:40.735296 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:40.741341 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:40.737702   733 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.719204 30852 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:40.684976 30853 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:40.721453 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:40.742251 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 157205us
I20260709 12:22:40.744338 30781 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:40.762336 30930 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:40.752324 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:40.763862 30931 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:40.740095 30933 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:40.744299 30853 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:40.746114 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.743711 30899 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:40.772914 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:40.778328 31477 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:40.782430 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:40.791289 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:40.792207 30781 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.795024 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.786886 30899 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:40.797120 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 101030us
I20260709 12:22:40.798173 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:40.798319 30900 leader_election.cc:336] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.877s (SENT)
I20260709 12:22:40.801097 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:40.658188 31509 rpcz_store.cc:276] 0709 12:22:39.429064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.458062 (+ 28998us) service_pool.cc:224] Handling call
0709 12:22:39.458516 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:39.459007 (+   491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:39.459042 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:39.459630 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 12:22:39.687669 (+228039us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:39.716755 (+ 29086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:39.768132 (+ 51377us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:40.537466 (+769334us) raft_consensus.cc:1685] finished
0709 12:22:40.537487 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:40.537659 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":531,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":203113,"threads_started":1,"wal-append.queue_time_us":846686}
I20260709 12:22:40.802861 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:40.803294   660 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:40.803893   660 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.804282   660 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:40.804886   558 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:40.805501   558 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:40.806516   683 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.806593   558 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.804188 30899 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:40.809484 30899 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:40.797183   416 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:40.810177   416 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:40.810573   713 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.811004   713 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.811326   713 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.811939   725 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:40.813881   725 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:40.740289   413 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:40.814265   725 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:40.814599   413 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:40.815006   413 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:40.815395   369 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:40.815917   369 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:40.812686 30785 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:40.817920 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.817993   712 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:40.818571   712 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:40.742251   737 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:40.799137 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:40.819684 30932 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:40.742610   698 consensus_queue.cc:1059] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 12:22:40.818930   712 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:22:40.842370 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:40.888908 30900 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:40.742437   368 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:40.749467   424 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:40.890604 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 69625.3us
I20260709 12:22:40.743944   733 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:40.799482   701 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:40.901981 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.904676 30853 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:22:40.905418 30853 pending_rounds.cc:85] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 6
I20260709 12:22:40.902763 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.810582   416 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:40.928764 30853 pending_rounds.cc:107] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:22:40.929265 30853 raft_consensus.cc:2889] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:40.739812   679 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.895524   739 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:40.946035 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:40.940286 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:40.748195   726 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:40.907382   682 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.101s
I20260709 12:22:40.952942 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:41.005417 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 223462us
I20260709 12:22:41.020879 30778 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:40.931474   701 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:41.083034 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:41.084147 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.084160 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.085417 30932 raft_consensus.cc:2410] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:22:41.086113 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:41.086925 30779 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:40.909024   740 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.147s
I20260709 12:22:41.089269 30777 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:41.093215 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.097698 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.103370 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:41.091197 30784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.024s	sys 0.043s
W20260709 12:22:41.104723 30784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.025s	sys 0.043s
I20260709 12:22:40.952135   563 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:41.005038 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:41.103694 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:40.966261   678 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.190s
I20260709 12:22:40.969118   453 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
W20260709 12:22:41.395560 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.107414 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:41.372226 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.137105 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:41.397713 30779 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:41.397195 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.398880 30782 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:41.399842 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.398236   641 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:41.134655   369 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:41.211467 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.400727   641 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:41.192420   424 raft_consensus.cc:3055] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:41.401634   424 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:41.252576 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.163481   733 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:41.104043 30785 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
W20260709 12:22:41.403795 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.404148 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:41.403795 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.155982 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:41.031773   368 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:41.097029   631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.008s	sys 0.016s
I20260709 12:22:40.966846   683 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:41.455814 30778 raft_consensus.cc:2393] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:41.397454   488 consensus_meta.cc:287] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.663s	user 0.005s	sys 0.005s
W20260709 12:22:41.396530 30826 connection.cc:256] RPC call timeout handler was delayed by -1.898395674999847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 12:22:41.472599 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:41.455091   563 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:41.403110   641 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:41.471170   369 consensus_queue.cc:1059] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:22:41.099287   727 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:41.488394   631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.019s	sys 0.022s
I20260709 12:22:41.397293   682 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:41.490090 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:41.535406 30934 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:41.491149 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:41.492589 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.495419 30899 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:41.411494   718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.000s	sys 0.040s
I20260709 12:22:41.502707 30776 raft_consensus.cc:2410] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:22:41.503070 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 550203us
I20260709 12:22:41.454283   723 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.508169 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:41.186396 32614 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.508653 30930 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:41.532764 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:41.537021 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.545902 30853 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:41.541000 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 46136.7us
I20260709 12:22:41.543183 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.539031 30779 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:41.547546 30926 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:41.548561 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.549330 30926 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:41.550465 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.485302   733 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:41.564635 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:41.556974 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:41.557359 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.566365 30852 raft_consensus.cc:2368] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5.
I20260709 12:22:41.560461 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.566991 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.541453   727 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:41.567656 30935 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:41.488616   698 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 12:22:41.540526   736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.027s
W20260709 12:22:41.540169   558 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.002s	sys 0.030s
W20260709 12:22:41.540729   718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.000s	sys 0.041s
I20260709 12:22:41.575959 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:41.409865   701 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:41.543562   739 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.014s	sys 0.019s
I20260709 12:22:41.550944   679 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:41.573246   742 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.462s	user 0.000s	sys 0.001s
I20260709 12:22:41.542008   737 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:41.557679   368 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:41.589466 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:41.597309 30852 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:41.506994   488 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:41.586453 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:41.600983 30935 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:41.574461   682 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:41.506875   424 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:41.581872   736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.006s	sys 0.027s
W20260709 12:22:41.582629   558 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.002s	sys 0.030s
I20260709 12:22:41.563778 32614 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:41.613433 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.615505 30928 raft_consensus.cc:2368] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5.
I20260709 12:22:41.624075 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:41.625082 30852 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:41.597105   368 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.570422   723 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:41.581612   369 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:22:41.642159 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.583890   739 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:41.637301 30900 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.006s	sys 0.022s
I20260709 12:22:41.659788 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:41.662943 30900 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.022s
W20260709 12:22:41.663547 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 591147us
W20260709 12:22:41.667169 30781 consensus_meta.cc:287] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.004s
I20260709 12:22:41.667922 30781 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
W20260709 12:22:41.671056 30900 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.996s (SENT)
I20260709 12:22:41.677977 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:41.615440   726 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:41.639358   368 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:41.684718 30927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.004s	sys 0.016s
I20260709 12:22:41.686597 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:41.687179 30784 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.010s	sys 0.007s
W20260709 12:22:41.688953 30784 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.010s	sys 0.007s
W20260709 12:22:41.689556 30927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.004s	sys 0.016s
I20260709 12:22:41.689599 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1289) took 1210 ms. Trace:
I20260709 12:22:41.693532 30784 rpcz_store.cc:276] 0709 12:22:40.479281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.479603 (+   322us) service_pool.cc:224] Handling call
0709 12:22:40.480162 (+   559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.480436 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:40.524444 (+ 44008us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.689253 (+1164809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.689303 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:41.689348 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.689420 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:41.689544 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45354,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":396476,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":19505,"spinlock_wait_cycles":10615168,"thread_start_us":1164333,"threads_started":2,"wal-append.queue_time_us":836424}
I20260709 12:22:41.702137   424 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:41.722630 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:41.729620 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 168162us
W20260709 12:22:41.730798 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 180270us
W20260709 12:22:41.715967   696 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.978s	user 0.010s	sys 0.002s
I20260709 12:22:41.704474   509 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:41.745400 30667 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e7509fe1be74f179626fb4fcb4b4e65 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:41.747331 30859 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:41.760071 30853 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:22:41.659981   563 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:41.761325 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 85397.6us
I20260709 12:22:41.783056 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:41.753947   751 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:41.835803 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 71502.9us
I20260709 12:22:41.742178   736 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:22:41.766520   749 log.cc:927] Time spent T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:22:41.688175   727 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:41.848330 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 174171us
W20260709 12:22:41.858839 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 194025us
I20260709 12:22:41.863237 30853 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:41.724633   682 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:41.846868   453 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:41.849308   736 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:41.873315 30851 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:22:41.886343 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.867542   631 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:41.915633 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:41.921082 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.915170   767 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.879760   723 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:41.954368 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:41.841893   739 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:41.959010 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:41.917563   631 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:41.947798 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:22:41.957397 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 215070us
W20260709 12:22:41.968760   748 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 12:22:41.952299 32614 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:41.915825   453 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:41.970815 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:42.325227   762 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.374s	user 0.000s	sys 0.000s
I20260709 12:22:42.333001 30852 raft_consensus.cc:1275] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:22:42.023627 30900 leader_election.cc:336] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.522s (SENT)
I20260709 12:22:42.334956 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:41.975538 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:41.971306 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
W20260709 12:22:42.091061 30934 consensus_meta.cc:287] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 12:22:42.326779 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1267) took 1423 ms. Trace:
I20260709 12:22:42.337558 30782 raft_consensus.cc:606] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.337585 30934 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:41.974799 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.340433 30853 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
W20260709 12:22:42.056054 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.326814 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1307) took 1243 ms. Trace:
I20260709 12:22:41.955050   751 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.352406   453 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.337806 30783 rpcz_store.cc:276] 0709 12:22:40.903545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.080351 (+176806us) service_pool.cc:224] Handling call
0709 12:22:41.080749 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:41.090632 (+  9883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.090679 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:41.104542 (+ 13863us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.678799 (+574257us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:41.678842 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.678921 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.326565 (+647644us) raft_consensus.cc:1685] finished
0709 12:22:42.326588 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.326712 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9399,"raft.queue_time_us":371268,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":34526,"thread_start_us":472530,"threads_started":1,"wal-append.queue_time_us":680866}
I20260709 12:22:42.339736 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1206) took 1182 ms. Trace:
W20260709 12:22:42.050714   750 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
W20260709 12:22:42.105511   747 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.434s	user 0.003s	sys 0.000s
I20260709 12:22:42.092060   766 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.344841 30780 rpcz_store.cc:276] 0709 12:22:41.083115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.083245 (+   130us) service_pool.cc:224] Handling call
0709 12:22:41.083594 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:41.532367 (+448773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:41.533892 (+  1525us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:41.534546 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.742951 (+208405us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:41.742997 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.743079 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.326578 (+583499us) raft_consensus.cc:1685] finished
0709 12:22:42.326600 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.326751 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10142,"raft.queue_time_us":369220,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":25915,"thread_start_us":579968,"threads_started":2,"wal-append.queue_time_us":729098}
I20260709 12:22:42.123723   682 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.965960   488 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:41.959424   767 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.358019   765 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:42.394140   765 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.396522   765 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:42.359253   698 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:42.359944   416 consensus_meta.cc:287] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 1.409s	user 0.012s	sys 0.001s
I20260709 12:22:42.397333   698 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.397473   416 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.397995   682 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.398484 31506 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:42.399603   698 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:42.360150 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 220) took 1907 ms. Trace:
W20260709 12:22:42.401302 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.346345 30825 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:42.402143 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 56103.2us
I20260709 12:22:42.401930   766 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.402835 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:42.402508   736 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.403956   736 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.362669 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:42.404855 31509 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.364303 30934 rpcz_store.cc:276] 0709 12:22:41.157006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.455628 (+298622us) service_pool.cc:224] Handling call
0709 12:22:42.339639 (+884011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:42.355834 30928 raft_consensus.cc:2393] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:42.209132   752 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
W20260709 12:22:42.377708 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.355558   751 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.404235   766 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:42.356860 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 333275us
I20260709 12:22:42.309962   778 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:42.355655   753 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.505s	user 0.000s	sys 0.001s
W20260709 12:22:42.410701 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.400465 30927 rpcz_store.cc:276] 0709 12:22:40.452736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.452929 (+   193us) service_pool.cc:224] Handling call
0709 12:22:40.470791 (+ 17862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:40.682069 (+211278us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:40.949629 (+267560us) log.cc:844] Serialized 14 byte log entry
0709 12:22:41.762191 (+812562us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:41.762273 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:41.762341 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:42.359925 (+597584us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54000ea1d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:42.359969 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.360093 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74079,"prepare.queue_time_us":816108,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":32517,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6960,"spinlock_wait_cycles":485212032,"thread_start_us":1079095,"threads_started":3,"wal-append.queue_time_us":916574}
W20260709 12:22:42.416157   413 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 1.601s	user 0.009s	sys 0.005s
I20260709 12:22:42.368113   777 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:42.290191   723 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.439075 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:42.431324 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:42.462350   416 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.463773   751 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:42.460217   778 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:42.466300   759 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 12:22:42.433324 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.400180   698 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.416363   563 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.416512   726 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:42.415568   765 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:42.429416 32614 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:42.487483 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.499511 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.500211 30859 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
W20260709 12:22:42.467571   725 consensus_meta.cc:287] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.653s	user 0.011s	sys 0.003s
I20260709 12:22:42.209616   631 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.506467   631 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.482997   723 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.511655   723 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.512077   733 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.495538 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:42.499938   766 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:42.514153 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:42.514321   766 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.514861 30782 raft_consensus.cc:606] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:42.515308 30782 raft_consensus.cc:614] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:42.516810   766 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:42.514321 30928 raft_consensus.cc:2393] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:42.495469 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:42.518599 30934 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.429035   641 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:42.429008   764 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:42.497951 30900 leader_election.cc:336] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.589s (SENT)
I20260709 12:22:42.494864 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:42.487008 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 82628.9us
I20260709 12:22:42.501091 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 230) took 1750 ms. Trace:
I20260709 12:22:42.524648 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:42.503372 30852 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:42.505007 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:42.522454 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
W20260709 12:22:42.523177 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4404631270003847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 12:22:42.526172 30782 raft_consensus.cc:606] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.501664 30931 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:42.525219 30929 rpcz_store.cc:276] 0709 12:22:40.750160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.750296 (+   136us) service_pool.cc:224] Handling call
0709 12:22:40.750647 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:40.751037 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:40.751068 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:40.751574 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:22:41.160440 (+408866us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:41.160482 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:41.160559 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:42.500811 (+1340252us) raft_consensus.cc:1685] finished
0709 12:22:42.500831 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:42.501008 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69904,"raft.queue_time_us":23485,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12400,"thread_start_us":408478,"threads_started":1,"wal-append.queue_time_us":846221}
I20260709 12:22:42.529282 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:42.529858   712 consensus_meta.cc:287] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.605s	user 0.014s	sys 0.000s
I20260709 12:22:42.530040   778 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.530167 30929 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
W20260709 12:22:42.526240 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4107631270003367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 12:22:42.531503 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3990631270003178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 12:22:42.531870 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3720631270002741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:22:42.532234 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3333631270002115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260709 12:22:42.532519 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2820631270001286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:22:42.532845 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2739631270001155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 12:22:42.533165 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2208631270004844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:22:42.533432 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1281631270003345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 12:22:42.533705 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1119631270003083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:22:42.534004 30750 connection.cc:256] RPC call timeout handler was delayed by -1.0732631270002457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 12:22:42.530352   712 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.498840 32614 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.471966   413 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.530915   767 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.541810 30934 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
W20260709 12:22:42.543578 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 45666.5us
I20260709 12:22:42.557964 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:42.559098 30900 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.599s (SENT)
W20260709 12:22:42.540558   743 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.002s	user 0.007s	sys 0.006s
I20260709 12:22:42.524477   641 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.502099   488 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:42.559563 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.479791   777 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:42.623035 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46510.9us
I20260709 12:22:42.559561 30934 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:42.538358   720 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.573802 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:42.576216 30926 raft_consensus.cc:2410] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:42.497892   765 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:42.555402   713 consensus_meta.cc:287] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.744s	user 0.010s	sys 0.005s
I20260709 12:22:42.562114 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.538645   764 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.584249 30750 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.572368   641 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:42.589591   660 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.785s	user 0.014s	sys 0.000s
I20260709 12:22:42.590195   682 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.591820 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.592463 30855 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:42.593099 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.548591 32614 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:42.594324 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.500149   563 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.503054   726 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.594393 30860 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:42.560969   778 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:22:42.852389 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:42.852409   727 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.853333   764 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:42.853274   727 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.604516 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.855104 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.603498   774 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.856189   774 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.614979 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.857180 30857 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:42.857270 30856 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:42.858397   774 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.611768   789 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.613699 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:42.615718   712 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:42.616117   736 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:42.644577 30854 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.876130   736 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.877434   413 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.878481   736 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:42.859097   789 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.654484 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:42.880339 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:42.881063   789 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:42.653132 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 68958.9us
I20260709 12:22:42.882931 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.884183 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.638374   779 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:42.644503   713 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.887796   713 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:42.658058 30858 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.641177   488 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:42.849175 30859 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:42.652655   660 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.895637   488 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:42.895859 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.896435   660 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:42.894913   764 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:42.897375 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.897722   764 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:42.898054 30859 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:42.898134   764 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:42.898556   764 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.898984 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.900287 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.901348 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.906885   764 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.907675   726 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.908533   726 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:42.908987   726 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:42.909197   764 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:42.851418 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.851676 31509 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:42.602648   733 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.910351   733 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.911392 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.912487 30851 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:42.912722   733 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.853655 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.913537 30860 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:42.914636 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.915499 30860 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:42.855720 30852 raft_consensus.cc:2468] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:42.856671 30780 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 3: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:42.633054 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:42.918051 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.918207 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:42.919486 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:42.919977 30854 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:42.523329   725 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.859316 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.922616 30858 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:42.922794 30856 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:42.923466 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.874445   765 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:42.875212 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.925670 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.926326 30852 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:42.927165 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:42.645349 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 86265.7us
I20260709 12:22:42.892910 30782 raft_consensus.cc:606] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.866799 30857 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:42.928828 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.929594 30857 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:42.881554 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:42.856874   777 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:42.894572   368 consensus_meta.cc:287] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.182s	user 0.015s	sys 0.007s
I20260709 12:22:42.936810 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.937927 30860 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:42.920141 30934 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.921308 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.861675 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:42.923880 30858 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.927253 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:42.940279 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:42.914943 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.941919 30851 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:22:42.931915 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:42.909508   726 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.932789 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:42.851120   788 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:42.943364 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:42.956512 30856 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:42.947444 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:42.947788 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.934376 30782 raft_consensus.cc:614] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:42.951994 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:42.961710 30928 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:42.962055 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:42.947060 31506 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:42.963573 30776 raft_consensus.cc:2393] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:42.965323 30932 raft_consensus.cc:1240] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:42.882932   727 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:42.954447 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.964341 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.964586 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.859712   776 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.970880 30858 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:42.962787 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:42.966334 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:42.972522 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:42.962714 30782 raft_consensus.cc:606] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:42.974241 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.974251   776 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.975164 30860 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:42.975608 30859 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:42.976526 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.977241 30860 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:42.978320 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.952322 30854 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:42.980113 30860 raft_consensus.cc:2393] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:42.979044 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:42.980988 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.010201 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:43.010272 30934 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:43.011492 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.011884 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:43.009678 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.012931 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.013706 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.013833 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.014325 30860 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.014557 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:43.015947 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 119621us
W20260709 12:22:43.017886 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.021612 30854 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:43.023053 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.023730 30858 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:43.024665 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.024457 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.025305 30854 raft_consensus.cc:2376] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:22:42.947227   368 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:42.968452   773 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:43.026467 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.027055 30858 raft_consensus.cc:2376] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
I20260709 12:22:43.027230 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.028875 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:43.029700 30928 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:43.029681 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.031021 30934 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:43.031340 30857 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:43.030040 30852 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.031360 30856 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:43.035605 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.036813 30935 raft_consensus.cc:2368] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6.
I20260709 12:22:43.038511 30860 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:43.039880 30856 raft_consensus.cc:2376] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:22:43.040719 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1462) took 1165 ms. Trace:
I20260709 12:22:43.041199 30934 rpcz_store.cc:276] 0709 12:22:41.875264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.022730 (+1147466us) service_pool.cc:224] Handling call
0709 12:22:43.040628 (+ 17898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:43.043323 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.042413 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.044699 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.044086 30860 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:43.046123 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.048475 30852 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:43.046726 30854 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:43.058198 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.058677 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.059465 30856 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:43.059379 30857 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:43.063336 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.063752 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.063958 30858 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:43.064524 30852 raft_consensus.cc:2410] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:43.064637 32614 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:43.027999   727 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:22:43.040869   660 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.067821 30853 raft_consensus.cc:2368] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8.
I20260709 12:22:43.067924 30860 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:43.068414 30857 raft_consensus.cc:1275] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:43.069427 30858 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.078976 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.079098 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.079269 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.079656 30860 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:43.079686 30857 raft_consensus.cc:2376] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3. Re-sending same reply.
I20260709 12:22:43.080040 30856 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.045248   724 raft_consensus.cc:3055] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:43.081633 30860 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.084384 30854 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.082242 32614 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:43.085215 30857 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 12:22:43.087049 30857 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:43.036810   773 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:43.094358   796 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:22:43.045531   765 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:22:43.100026 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.176549   773 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:43.084066   724 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:43.183383 30851 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:43.208025   725 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:43.062799   798 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:22:43.088114   660 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:43.212030   641 consensus_meta.cc:287] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.003s
I20260709 12:22:43.178263   368 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:43.212661   641 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:43.213924 30855 raft_consensus.cc:2368] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:22:43.214282   724 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:43.215627   724 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.224776 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1193) took 2440 ms. Trace:
I20260709 12:22:43.234575 30856 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
W20260709 12:22:43.234927   424 consensus_meta.cc:287] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.494s	user 0.015s	sys 0.001s
I20260709 12:22:43.236335 30933 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
W20260709 12:22:43.237447 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 149613us
I20260709 12:22:43.225368 30931 rpcz_store.cc:276] 0709 12:22:40.795398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:40.795537 (+   139us) service_pool.cc:224] Handling call
0709 12:22:42.501475 (+1705938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.526902 (+ 25427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.224480 (+697578us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400223dd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:43.224692 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3922468736}
I20260709 12:22:43.259320 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:43.277856 30926 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1214) took 1927 ms (client timeout 1696 ms). Trace:
W20260709 12:22:43.278478 30926 rpcz_store.cc:269] 0709 12:22:41.333932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.550180 (+216248us) service_pool.cc:224] Handling call
0709 12:22:43.261341 (+1711161us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540027bd54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:43.261518 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2329059072}
I20260709 12:22:43.296804 31477 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:43.251303   563 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:43.298010   660 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:43.376370 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 79641us
I20260709 12:22:43.725461 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.862946 30856 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:43.435110   509 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:43.864406   509 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:43.855012 30776 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:22:43.853852 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 613750us
W20260709 12:22:43.867359 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.495872   726 consensus_meta.cc:287] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.001s
I20260709 12:22:43.854102 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.868553 30858 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:43.429714   772 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:43.869494 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.308986   801 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:43.868346   726 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:43.452169 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.872023 30778 raft_consensus.cc:1240] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 2. Current term is 3. Ops: []
I20260709 12:22:43.872117 30855 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:43.873157 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:43.454634 30933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1205) took 2298 ms (client timeout 2159 ms). Trace:
I20260709 12:22:43.418174 30784 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 2. Current term is 3. Ops: []
W20260709 12:22:43.853693 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.870715 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.870661 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:43.859592 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:43.875353 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.463030 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.880267 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 233) took 2282 ms. Trace:
I20260709 12:22:43.882419 30858 raft_consensus.cc:2393] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:43.873690 30855 raft_consensus.cc:2376] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5. Re-sending same reply.
W20260709 12:22:43.874363 30933 rpcz_store.cc:269] 0709 12:22:41.156689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.566753 (+410064us) service_pool.cc:224] Handling call
0709 12:22:43.454410 (+1887657us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54002148d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:43.454552 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3837456128}
W20260709 12:22:43.874095   678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.035s	sys 0.062s
W20260709 12:22:43.894074 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.894459 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.914865 30860 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:43.897430 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:43.873750   368 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.916744 30779 raft_consensus.cc:2410] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:22:43.902750 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 234) took 2276 ms. Trace:
I20260709 12:22:43.898123 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:43.919262 30783 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:43.910732 30781 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.910806 30777 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:43.894308 30782 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:43.900658 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.921783 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:43.922245 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.901682 30929 rpcz_store.cc:276] 0709 12:22:41.598022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.879508 (+2281486us) service_pool.cc:224] Handling call
0709 12:22:43.879799 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.879964 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.879991 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.880030 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:43.880057 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.880104 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.880215 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:43.924418 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:43.925356 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.926000 30860 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:43.926890 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.927587 30860 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:43.928524 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.929410 30860 raft_consensus.cc:2393] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:43.876814   424 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:43.885546   788 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:43.928889 30856 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:43.930939 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.938140 30855 raft_consensus.cc:2376] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:22:43.918901 30933 rpcz_store.cc:276] 0709 12:22:41.626431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.901708 (+2275277us) service_pool.cc:224] Handling call
0709 12:22:43.902106 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.902334 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.902374 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.902431 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:43.902476 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.902548 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.902678 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:43.939685 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:43.902462 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:43.940661 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:43.938442 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:43.941425 30777 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.932664 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:43.942112 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:43.913692   678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.035s	sys 0.062s
I20260709 12:22:43.943918 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.944384 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.945545 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:43.910372 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:43.947398 30785 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:43.948287 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:43.951941 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.951884 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:43.952783 30855 raft_consensus.cc:2376] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:22:43.910250   641 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:43.942385 30781 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:43.942818 30858 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:43.933472 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:43.958866 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:43.959952 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:43.964572 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.965639 30854 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:43.960551 30929 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:43.967980 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:43.931350   368 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:43.962937 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:43.947124   788 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:43.973827 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 235) took 2346 ms. Trace:
I20260709 12:22:43.974251 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.984933 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:43.994637 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:43.941890   726 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:43.995502 30858 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:43.974362 30933 rpcz_store.cc:276] 0709 12:22:41.627919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.972841 (+2344922us) service_pool.cc:224] Handling call
0709 12:22:43.973203 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.973419 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.973455 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:43.973510 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:43.973553 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.973621 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:43.973739 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:44.001081 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 236) took 2341 ms. Trace:
I20260709 12:22:43.996563 30855 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:44.002941 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.005004 30856 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:43.904525 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1237) took 1004 ms. Trace:
W20260709 12:22:44.005505 30935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1209) took 2837 ms (client timeout 2619 ms). Trace:
I20260709 12:22:44.003649 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 237) took 2154 ms. Trace:
I20260709 12:22:44.012768 30933 rpcz_store.cc:276] 0709 12:22:41.848824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.001515 (+2152691us) service_pool.cc:224] Handling call
0709 12:22:44.001818 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.002032 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.002071 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.002421 (+   350us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:44.002495 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.002777 (+   282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.003314 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:44.001621 30929 rpcz_store.cc:276] 0709 12:22:41.659704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.000007 (+2340303us) service_pool.cc:224] Handling call
0709 12:22:44.000417 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.000648 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.000687 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.000747 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:44.000802 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.000874 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.001010 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:44.006547 30859 rpcz_store.cc:276] 0709 12:22:42.899673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.901131 (+  1458us) service_pool.cc:224] Handling call
0709 12:22:43.904371 (+1003240us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b54003bea54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:43.904475 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139219712}
W20260709 12:22:44.006645 30935 rpcz_store.cc:269] 0709 12:22:41.157851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.626251 (+468400us) service_pool.cc:224] Handling call
0709 12:22:43.994443 (+2368192us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540027b354. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:43.995560 (+  1117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3160910592}
I20260709 12:22:44.031473 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:44.032550 30854 raft_consensus.cc:2368] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8.
I20260709 12:22:44.034819 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:43.942229   424 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:44.034842 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1208) took 2877 ms. Trace:
I20260709 12:22:43.974376   788 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:44.007745   772 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:44.041517 30928 rpcz_store.cc:276] 0709 12:22:41.157545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.031269 (+1873724us) service_pool.cc:224] Handling call
0709 12:22:43.036046 (+  4777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.042788 (+  6742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.042815 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.057102 (+ 14287us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.852067 (+794965us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:43.901886 (+ 49819us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.034427 (+132541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.034514 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.034573 (+    59us) raft_consensus.cc:1685] finished
0709 12:22:44.034593 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.034759 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18158,"prepare.queue_time_us":184186,"raft.queue_time_us":4754,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13771,"thread_start_us":374749,"threads_started":3,"wal-append.queue_time_us":781441}
I20260709 12:22:44.045694 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:44.046252 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:44.050107 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:44.058638 30783 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.060854 30928 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:43.998951   563 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:43.997593   641 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:44.054450 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 172584us
I20260709 12:22:44.062815   563 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.063490 30928 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:22:43.998303   739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.026s
W20260709 12:22:44.065963   739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.012s	sys 0.026s
I20260709 12:22:44.056607 30858 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
W20260709 12:22:44.074895 30900 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.952s (SENT)
I20260709 12:22:44.075524 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:44.086206 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:44.086978 30781 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:44.087823 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1463) took 2203 ms. Trace:
I20260709 12:22:44.088352 30933 rpcz_store.cc:276] 0709 12:22:41.884449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.044583 (+2160134us) service_pool.cc:224] Handling call
0709 12:22:44.087266 (+ 42683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.087454 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.087479 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.087522 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:44.087560 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.087614 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.087751 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:44.096917 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:44.056540 30777 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:44.057441   772 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:44.092502   804 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:22:44.129534 30783 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:44.137811 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:44.139057 30783 raft_consensus.cc:2410] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:22:44.139031 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 133078us
I20260709 12:22:44.112704 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:44.113318 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:44.125136 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 164910us
I20260709 12:22:44.150321 30781 raft_consensus.cc:2410] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:44.150435 30777 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
W20260709 12:22:44.152853 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 86589.7us
I20260709 12:22:44.154933 30933 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:44.114693   799 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.155808 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:44.159425 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 240) took 1611 ms. Trace:
W20260709 12:22:44.165400 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 294834us
I20260709 12:22:44.170749 30933 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:44.175838 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:44.169624 30935 rpcz_store.cc:276] 0709 12:22:42.548398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.049799 (+1501401us) service_pool.cc:224] Handling call
0709 12:22:44.050158 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.153025 (+102867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.153071 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.153129 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:44.159095 (+  5966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.159207 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.159349 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":102446,"threads_started":1}
I20260709 12:22:44.175125 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:44.182417 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:44.073540   726 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:44.187355 30667 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e7509fe1be74f179626fb4fcb4b4e65 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:44.163784   788 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:44.189906 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1428) took 1462 ms. Trace:
I20260709 12:22:44.190266 30785 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:44.193296 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:44.208865 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1212) took 3050 ms. Trace:
I20260709 12:22:44.205271 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.208488 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:44.201625 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 126991us
I20260709 12:22:44.213194 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.211584 30933 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:44.208210   818 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:44.213876 30935 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:44.214052   818 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:44.214326 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.214443   818 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.201732 30852 rpcz_store.cc:276] 0709 12:22:42.722273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.081990 (+359717us) service_pool.cc:224] Handling call
0709 12:22:43.082190 (+   200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.087517 (+  5327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.087565 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.253607 (+166042us) log.cc:844] Serialized 26 byte log entry
0709 12:22:43.458532 (+204925us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:43.458605 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:43.458714 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.183898 (+725184us) raft_consensus.cc:1685] finished
0709 12:22:44.183919 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.184050 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1615,"raft.queue_time_us":1237,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":5294,"thread_start_us":149012,"threads_started":1,"wal-append.queue_time_us":659771}
I20260709 12:22:44.209331 30934 rpcz_store.cc:276] 0709 12:22:41.158735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.042063 (+1883328us) service_pool.cc:224] Handling call
0709 12:22:43.042361 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.056232 (+ 13871us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:43.072910 (+ 16678us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.203619 (+1130709us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.208491 (+  4872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.208545 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:44.208600 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.208672 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.208802 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82190,"prepare.queue_time_us":31979,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":3304,"raft.queue_time_us":289254,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":13449,"spinlock_wait_cycles":2432,"thread_start_us":332384,"threads_started":3,"wal-append.queue_time_us":290814}
I20260709 12:22:44.184274   799 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:44.214972 30933 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:44.208598   713 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:44.214775 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.223891 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:44.190730   641 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:44.231942 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.233170 30934 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.215371 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:44.234745 30933 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 4.
I20260709 12:22:44.240061 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.241019 30933 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:44.242203 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.238524 31507 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:44.244323 30933 raft_consensus.cc:2393] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:44.203430   765 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:22:44.240495 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 58270.5us
I20260709 12:22:44.177145   819 consensus_queue.cc:1059] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:22:44.216846   815 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:44.223173   788 raft_consensus.cc:697] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:44.262567   368 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:44.243500 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:44.251287   739 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:22:44.268695 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 113717us
I20260709 12:22:44.259577   765 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:44.269436   713 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:22:44.272125 30934 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:44.291141 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:44.292795 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.293707 30934 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:44.296414   563 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:44.285357 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 52750.1us
W20260709 12:22:44.285236 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:44.304356 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 141285us
I20260709 12:22:44.291142 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1283) took 1364 ms. Trace:
I20260709 12:22:44.243863   799 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:44.301097 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:44.308245 30934 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.305302 30778 rpcz_store.cc:276] 0709 12:22:42.927056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.929683 (+  2627us) service_pool.cc:224] Handling call
0709 12:22:42.930078 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.872535 (+942457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.290869 (+418334us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400410d54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:44.291059 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165692288}
I20260709 12:22:44.272291 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1431) took 1243 ms. Trace:
I20260709 12:22:44.298354   727 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:44.248109   678 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:22:44.309935 30860 rpcz_store.cc:276] 0709 12:22:43.029201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.994209 (+965008us) service_pool.cc:224] Handling call
0709 12:22:44.031368 (+ 37159us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:44.039359 (+  7991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.039404 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:44.053431 (+ 14027us) log.cc:844] Serialized 52 byte log entry
0709 12:22:44.226090 (+172659us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:44.226148 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.226242 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.271954 (+ 45712us) raft_consensus.cc:1685] finished
0709 12:22:44.271987 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.272193 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":30654,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":122097,"threads_started":1,"wal-append.queue_time_us":175963}
I20260709 12:22:44.319841   815 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:44.322465   815 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:44.324625   815 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:44.326099 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:44.330394   765 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.340544 30776 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:44.341882   816 raft_consensus.cc:3055] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:44.346942   816 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:44.347506 30852 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:44.339169   678 consensus_queue.cc:1243] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:22:44.347919   816 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:44.348603 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.349236 30858 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:44.349610   816 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.350131   799 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.351691 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.352451 30929 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:44.345654 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:44.342833 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:44.343241 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:44.345196 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.346392 30854 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:22:44.318928 30826 connection.cc:256] RPC call timeout handler was delayed by -2.0426073479998195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 12:22:44.381357 30826 connection.cc:256] RPC call timeout handler was delayed by -2.0426073479998195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 12:22:44.317456   727 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:44.377578 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 107914us
I20260709 12:22:44.382126 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.383060 30858 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
W20260709 12:22:44.381803 30826 connection.cc:256] RPC call timeout handler was delayed by -2.0381073479998122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:22:44.384838 30826 connection.cc:256] RPC call timeout handler was delayed by -1.9931073479997394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 12:22:44.385157 30826 connection.cc:256] RPC call timeout handler was delayed by -1.9850073479997263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:22:44.385489 30826 connection.cc:256] RPC call timeout handler was delayed by -1.9328073479996419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 12:22:44.385782 30826 connection.cc:256] RPC call timeout handler was delayed by -1.9265073479996317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 12:22:44.386052 30826 connection.cc:256] RPC call timeout handler was delayed by -1.8635073479999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:22:44.386324 30826 connection.cc:256] RPC call timeout handler was delayed by -1.8095073479998973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 12:22:44.386590 30826 connection.cc:256] RPC call timeout handler was delayed by -1.7933073479998711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 12:22:44.386861 30826 connection.cc:256] RPC call timeout handler was delayed by -1.6493073479996383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 12:22:44.387128 30826 connection.cc:256] RPC call timeout handler was delayed by -1.5692073479999635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 12:22:44.387809 30826 connection.cc:256] RPC call timeout handler was delayed by -1.5593073479999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:22:44.388302 30826 connection.cc:256] RPC call timeout handler was delayed by -1.5098073479998675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
W20260709 12:22:44.388718 30826 connection.cc:256] RPC call timeout handler was delayed by -1.5053073479998602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
W20260709 12:22:44.393466 30826 connection.cc:256] RPC call timeout handler was delayed by -1.4558073479997802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 12:22:44.389576 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 105505us
I20260709 12:22:44.353438 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.340077   424 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:44.396323 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0958073479996528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2619s for a response
W20260709 12:22:44.396754 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0508073480000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2669s for a response
I20260709 12:22:44.397924 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:44.398715 30934 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:44.400597 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.374329   641 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.402139 30934 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
W20260709 12:22:44.382176   509 consensus_meta.cc:287] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.005s
I20260709 12:22:44.404592 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.405164 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.406510 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.406886 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:44.412003 30852 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:44.407600 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:44.425431 30928 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.409118 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:44.392381   839 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:44.410387   815 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:22:44.413172   820 log.cc:927] Time spent T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:22:44.414942   368 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:44.416699 30899 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:44.417724 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.421860 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1203) took 3265 ms. Trace:
I20260709 12:22:44.434306 30932 rpcz_store.cc:276] 0709 12:22:41.156033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:41.156134 (+   101us) service_pool.cc:224] Handling call
0709 12:22:41.156435 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:42.965889 (+1809454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.421628 (+1455739us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002233d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:44.421801 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4130945792}
I20260709 12:22:44.426469 30929 raft_consensus.cc:2410] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:44.407182 31507 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:44.429888 30855 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:44.401546   660 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:22:44.421401   641 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.430086 30858 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
W20260709 12:22:44.473897 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 64588.8us
I20260709 12:22:44.476385 30899 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:44.478463 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 47630.9us
W20260709 12:22:44.465372 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.475418 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 244) took 1502 ms. Trace:
W20260709 12:22:44.481001 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.479910 30899 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:44.480316 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.481261 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:44.478407 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 108529us
I20260709 12:22:44.483402 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.480923 30853 rpcz_store.cc:276] 0709 12:22:42.973011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.426142 (+1453131us) service_pool.cc:224] Handling call
0709 12:22:44.474885 (+ 48743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.475066 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.475089 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:44.475130 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:44.475160 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.475222 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.475357 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:44.487223 30929 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:44.420253   509 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.463557   837 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:44.506203 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1429) took 1559 ms. Trace:
I20260709 12:22:44.506707 30928 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:44.487675 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.508436 30855 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:44.510910 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:44.497442 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:44.432334   817 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:22:44.434774   839 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:44.504526   846 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:44.506654 30857 rpcz_store.cc:276] 0709 12:22:42.946475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.149428 (+1202953us) service_pool.cc:224] Handling call
0709 12:22:44.149785 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.150136 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.150170 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.165033 (+ 14863us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.376106 (+211073us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:44.376149 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.376216 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.505983 (+129767us) raft_consensus.cc:1685] finished
0709 12:22:44.506008 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.506139 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3203,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10673,"thread_start_us":168105,"threads_started":1,"wal-append.queue_time_us":295480}
I20260709 12:22:44.499693 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.521483 30929 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:44.522840 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:44.485531   827 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:44.477626   815 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:22:44.428285   788 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:44.518559   837 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:44.540032 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:44.539076 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 103113us
I20260709 12:22:44.573797 30853 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:44.568401 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 68817.1us
I20260709 12:22:44.578559 30826 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.528734   828 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:44.438756   727 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.581822 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1314) took 1321 ms. Trace:
I20260709 12:22:44.605868 30784 rpcz_store.cc:276] 0709 12:22:43.260181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.261529 (+  1348us) service_pool.cc:224] Handling call
0709 12:22:43.417906 (+156377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:43.874679 (+456773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.581503 (+706824us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540007bf50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:44.581715 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358710144}
I20260709 12:22:44.609154 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:44.614125 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:44.616362 30779 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:44.618431 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:44.619239 30782 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.620532 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:44.621733 30781 raft_consensus.cc:2368] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7.
I20260709 12:22:44.528116   846 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:44.533159   835 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:44.650223 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:44.655882 30777 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:44.585206   724 consensus_meta.cc:287] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.369s	user 0.010s	sys 0.007s
I20260709 12:22:44.658432 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:44.553630   816 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:44.533558   776 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:44.551757   849 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:44.583990   837 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.582401   822 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:44.673220 30935 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
W20260709 12:22:44.685905 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.581080   827 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:44.582068   678 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:44.669740   682 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:44.660998   727 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:44.677644   772 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.671900   830 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:44.657085   846 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:44.719585   848 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:22:44.747200 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 168701us
I20260709 12:22:44.768723 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.707362   854 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:44.745654   776 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.798245 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:44.801743 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 130680us
I20260709 12:22:44.677469   368 consensus_queue.cc:1048] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 12:22:44.745962   815 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:44.752440   830 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:44.806136 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.811149 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.747941   682 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.824385   682 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:44.809798   815 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.826843 30782 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:44.828536   815 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:44.809624   840 log.cc:927] Time spent T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 12:22:44.832947 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1218) took 3249 ms. Trace:
I20260709 12:22:44.708854   827 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.842875   839 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:44.844668   833 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
I20260709 12:22:44.847541 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1213) took 3688 ms. Trace:
I20260709 12:22:44.849975   641 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:44.833487 30926 rpcz_store.cc:276] 0709 12:22:41.583358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.852757 (+2269399us) service_pool.cc:224] Handling call
0709 12:22:43.853178 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:43.896318 (+ 43140us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:44.165546 (+269228us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.395552 (+230006us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:44.399479 (+  3927us) log.cc:844] Serialized 52 byte log entry
0709 12:22:44.399633 (+   154us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:44.399871 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.418577 (+ 18706us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.418760 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.418840 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.832593 (+413753us) raft_consensus.cc:1685] finished
0709 12:22:44.832625 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.832856 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135654,"prepare.queue_time_us":152636,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":161570,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":26432,"spinlock_wait_cycles":19363968,"thread_start_us":362327,"threads_started":2,"wal-append.queue_time_us":222909}
I20260709 12:22:44.880600 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:44.881494 30777 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:22:44.886787 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:44.887773 30776 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:44.890651 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:44.713608   822 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:44.896498   822 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:44.899763 30777 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
W20260709 12:22:44.908227 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.847990 30927 rpcz_store.cc:276] 0709 12:22:41.159068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.222955 (+2063887us) service_pool.cc:224] Handling call
0709 12:22:43.854526 (+631571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.095980 (+241454us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:22:44.129702 (+ 33722us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.379754 (+250052us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.388962 (+  9208us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.390846 (+  1884us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:44.391657 (+   811us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.432467 (+ 40810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.432536 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.847204 (+414668us) raft_consensus.cc:1685] finished
0709 12:22:44.847237 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.847445 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245397,"prepare.queue_time_us":32605,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":37,"raft.queue_time_us":423795,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":21016,"spinlock_wait_cycles":12320640,"thread_start_us":279087,"threads_started":2,"wal-append.queue_time_us":276175}
W20260709 12:22:44.920396 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 109379us
I20260709 12:22:44.921633 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.769904   772 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:44.811255   830 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:44.932717 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1215) took 3521 ms. Trace:
I20260709 12:22:44.939154 30858 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:44.960713   817 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:44.965893   509 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:44.978176 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1216) took 3472 ms. Trace:
I20260709 12:22:44.938068   849 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.938504   776 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:44.995774 30927 pending_rounds.cc:85] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 3
I20260709 12:22:44.996188 30927 pending_rounds.cc:107] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:22:44.996502 30927 raft_consensus.cc:2889] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:44.987129 30930 rpcz_store.cc:276] 0709 12:22:41.411157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.227693 (+1816536us) service_pool.cc:224] Handling call
0709 12:22:43.228056 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.858823 (+630767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.858852 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.894374 (+ 35522us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.088969 (+194595us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:44.112331 (+ 23362us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.328308 (+215977us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b1800371320. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d932522 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:44.932088 (+603780us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b1800371320. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287
0709 12:22:44.932258 (+   170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.932358 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.932420 (+    62us) raft_consensus.cc:1685] finished
0709 12:22:44.932441 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.932634 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67415,"prepare.queue_time_us":39157,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":736227,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":6817,"spinlock_wait_cycles":23096832,"thread_start_us":257840,"threads_started":2,"wal-append.queue_time_us":291960}
I20260709 12:22:45.000516 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:45.001384 30930 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
W20260709 12:22:45.002305 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:44.991758 30931 rpcz_store.cc:276] 0709 12:22:41.506073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:43.253554 (+1747481us) service_pool.cc:224] Handling call
0709 12:22:43.253946 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:43.913268 (+659322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:43.913313 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:43.930636 (+ 17323us) log.cc:844] Serialized 26 byte log entry
0709 12:22:44.114117 (+183481us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:44.165947 (+ 51830us) log.cc:844] Serialized 14 byte log entry
0709 12:22:44.181845 (+ 15898us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b480018c258. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:22:44.224417 (+ 42572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:44.224527 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:44.883695 (+659168us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b18003712c0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:44.977920 (+ 94225us) raft_consensus.cc:1685] finished
0709 12:22:44.977949 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:44.978099 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":721280,"prepare.queue_time_us":48854,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2907,"raft.queue_time_us":708189,"raft.run_cpu_time_us":3478,"raft.run_wall_time_us":286015,"spinlock_wait_cycles":23045376,"thread_start_us":202205,"threads_started":2,"wal-append.queue_time_us":291815}
W20260709 12:22:45.011221 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 89721.8us
I20260709 12:22:44.989972   817 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.017027   817 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:45.018148   776 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:45.019346 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.019791   660 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.020414 30853 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:45.020514   660 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:44.959550   818 consensus_meta.cc:287] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.005s
I20260709 12:22:45.022995 30826 leader_election.cc:400] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5.
I20260709 12:22:45.025734 30826 leader_election.cc:403] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.027231 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.031056   849 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:45.031554   776 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5.
I20260709 12:22:45.031698   849 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:45.032480   849 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.029211   818 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.035889   818 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:45.041283 30826 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:44.924597   855 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:44.957747   772 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:45.012840   815 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:45.047571 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.148049 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:45.154407 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.006s
W20260709 12:22:45.154821 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.005s	sys 0.006s
I20260709 12:22:45.059173   776 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.052978   828 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:45.156903 30928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.016s	sys 0.016s
W20260709 12:22:45.164466 30928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.016s	sys 0.016s
I20260709 12:22:45.028620   834 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:22:45.132501   815 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:45.130892   835 raft_consensus.cc:697] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:22:45.159912 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 112430us
I20260709 12:22:45.169323 30826 leader_election.cc:400] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6.
W20260709 12:22:45.164608 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 494598us
I20260709 12:22:45.170192 30826 leader_election.cc:403] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:22:45.156965 30933 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.004s	sys 0.008s
I20260709 12:22:45.156687   855 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:22:45.173604 30932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.002s	sys 0.010s
I20260709 12:22:45.166580 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1494) took 1197 ms. Trace:
W20260709 12:22:45.174633 30932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.003s	sys 0.010s
W20260709 12:22:45.172338 30933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.004s	sys 0.008s
I20260709 12:22:45.163343   862 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.165829   660 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:45.177044 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.170164 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:45.180064 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.182936 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 241) took 1259 ms. Trace:
I20260709 12:22:45.205961 30932 rpcz_store.cc:276] 0709 12:22:43.923353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.435285 (+511932us) service_pool.cc:224] Handling call
0709 12:22:44.435586 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.435795 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:22:44.477609 (+ 41814us) log.cc:844] Serialized 14 byte log entry
0709 12:22:45.177040 (+699431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:45.177106 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:45.177173 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.177247 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.182429 (+  5182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1630,"prepare.queue_time_us":41614,"prepare.run_cpu_time_us":238,"prepare.run_wall_time_us":1052,"raft.queue_time_us":3929,"thread_start_us":697311,"threads_started":1}
I20260709 12:22:45.185998   864 consensus_queue.cc:1059] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:45.186630   828 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:45.187376 30934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.008s	sys 0.004s
I20260709 12:22:45.189728 30777 raft_consensus.cc:3055] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:22:45.164197 30900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.012s
I20260709 12:22:45.190989 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:45.221848 30934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.009s	sys 0.004s
W20260709 12:22:45.222003 30900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.000s	sys 0.012s
I20260709 12:22:45.190766   641 consensus_queue.cc:1059] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:22:45.222455 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 690426us
I20260709 12:22:45.223111 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.169386   815 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.219969 30932 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:45.221904 30777 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:45.231793 30777 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:45.232898 30777 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:45.223891 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 53793.6us
W20260709 12:22:45.168649 30899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.007s
I20260709 12:22:45.225193   869 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.225423 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.234478 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:45.234069 30899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.005s	sys 0.008s
W20260709 12:22:45.240700 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 717891us
I20260709 12:22:45.242403 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.176874   855 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:45.245699 30899 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:45.248792 30932 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:45.253962   855 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:45.255046 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:45.256268 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:45.256851 30932 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:45.258405 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:45.171484   739 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:22:45.260203 30932 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:45.260458   739 consensus_queue.cc:1243] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:45.261049   739 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:45.260617   835 consensus_queue.cc:237] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.261400   739 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:45.262291   739 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.263434   739 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.197862   776 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.168505   818 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:22:45.178234   862 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.267086 30935 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:45.268466 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:45.318938 30750 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.918s (SENT) [suppressed 50 similar messages]
I20260709 12:22:45.251048   599 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:22:45.327688 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:45.328150 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.328023 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:45.328498 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.278146 30777 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:22:45.291033 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 45407.6us
I20260709 12:22:45.329499 30899 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:45.291712 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 49396.8us
I20260709 12:22:45.229194 30682 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 2 to 4, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 4 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.328661 30935 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.248446   660 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.240309   869 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:45.338071 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:45.338155 30932 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:45.386685   869 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.387909 30932 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:45.331595 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:45.332096 30682 catalog_manager.cc:5697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 1 to 5, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 5 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:22:45.390794 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59269.7us
I20260709 12:22:45.391489 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.391201 30682 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 4 to 5, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 5 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.342244 30783 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:45.345917 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:45.329881   816 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:45.348660   813 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:45.351147 30769 tablet_service.cc:1558] Processing DeleteTablet for tablet dd65da5a34854820ae636ab77116f737 with delete_type TABLET_DATA_TOMBSTONED (TS 5e7509fe1be74f179626fb4fcb4b4e65 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:54636
I20260709 12:22:45.352981   819 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.364748 30679 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48042 (request call id 177) took 9228 ms. Trace:
I20260709 12:22:45.174777 30928 rpcz_store.cc:276] 0709 12:22:43.969355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.507426 (+538071us) service_pool.cc:224] Handling call
0709 12:22:44.539789 (+ 32363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:44.540020 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:44.540280 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 12:22:45.166237 (+625957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:45.166288 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:45.166338 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.166402 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.166521 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1227,"prepare.queue_time_us":502,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":5089,"raft.queue_time_us":234,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":5160,"thread_start_us":625619,"threads_started":1}
I20260709 12:22:45.264055   788 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:45.395064 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.429185 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.408406 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:45.369573   837 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.652s	user 0.002s	sys 0.008s
I20260709 12:22:45.316946   817 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:22:45.426997 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 233868us
I20260709 12:22:45.330976   799 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:45.326615   862 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.449692 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:45.450824 30825 leader_election.cc:400] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7.
I20260709 12:22:45.453385 30825 leader_election.cc:403] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.287962   765 consensus_queue.cc:1059] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.127s
W20260709 12:22:45.418396   727 consensus_meta.cc:287] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.004s
I20260709 12:22:45.389251   509 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:45.415493   660 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:45.412711   713 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.478444 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.298424   867 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.192s
I20260709 12:22:45.487551 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.405905   850 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:22:45.471225   854 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:45.421890 30679 rpcz_store.cc:276] 0709 12:22:36.136595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:36.140148 (+  3553us) service_pool.cc:224] Handling call
0709 12:22:45.364642 (+9224494us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:40.166503 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:40.167177 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:40.167242 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:22:40.167278 (+    36us) tablet.cc:662] Decoding operations
0709 12:22:40.420320 (+253042us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:40.420395 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:40.420424 (+    29us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:22:40.473178 (+ 52754us) tablet.cc:701] Row locks acquired
0709 12:22:40.515298 (+ 42120us) write_op.cc:260] PREPARE: finished
0709 12:22:40.598719 (+ 83421us) write_op.cc:270] Start()
0709 12:22:40.598891 (+   172us) write_op.cc:276] Timestamp: P: 1783599760524991 usec, L: 0
0709 12:22:40.598915 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:22:40.651635 (+ 52720us) log.cc:844] Serialized 8660 byte log entry
0709 12:22:42.876159 (+2224524us) op_driver.cc:464] REPLICATION: finished
0709 12:22:43.042975 (+166816us) write_op.cc:301] APPLY: starting
0709 12:22:43.064775 (+ 21800us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:43.099927 (+ 35152us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:43.100054 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:43.125491 (+ 25437us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:43.205358 (+ 79867us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:22:43.205406 (+    48us) write_op.cc:312] APPLY: finished
0709 12:22:43.206045 (+   639us) log.cc:844] Serialized 151 byte log entry
0709 12:22:43.206275 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:43.206511 (+   236us) write_op.cc:454] Released schema lock
0709 12:22:43.206607 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:43.207113 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:43.207144 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":307914,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":138171,"apply.run_cpu_time_us":8593,"apply.run_wall_time_us":178181,"num_ops":22,"prepare.queue_time_us":474804,"prepare.run_cpu_time_us":53084,"prepare.run_wall_time_us":1434807,"raft.queue_time_us":369383,"raft.run_cpu_time_us":7363,"raft.run_wall_time_us":69972,"replication_time_us":2277058,"thread_start_us":1520585,"threads_started":4,"wal-append.queue_time_us":962253,"wal-append.run_cpu_time_us":77204,"wal-append.run_wall_time_us":2604359}]]}
I20260709 12:22:45.473233   819 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.517855   776 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6.
I20260709 12:22:45.486719   849 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.500914   765 raft_consensus.cc:3055] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:45.521785   855 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.522475   765 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:45.503558 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.473701   816 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:45.470129   813 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:45.484347   817 raft_consensus.cc:697] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:45.524578 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1492) took 1604 ms. Trace:
I20260709 12:22:45.528218 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:45.532333 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 355342us
I20260709 12:22:45.553315 30826 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:45.535327 30927 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.007s	sys 0.031s
I20260709 12:22:45.482491   660 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:45.554162 30927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.031s
I20260709 12:22:45.506201   831 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:45.556140 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1490) took 1637 ms. Trace:
I20260709 12:22:45.552357 30934 rpcz_store.cc:276] 0709 12:22:43.919672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.409014 (+489342us) service_pool.cc:224] Handling call
0709 12:22:44.409325 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:44.426805 (+ 17480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.426847 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:44.438662 (+ 11815us) log.cc:844] Serialized 26 byte log entry
0709 12:22:45.222482 (+783820us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:45.222525 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.222594 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.524322 (+301728us) raft_consensus.cc:1685] finished
0709 12:22:45.524347 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.524507 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16965,"raft.queue_time_us":19993,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7167,"thread_start_us":699771,"threads_started":1,"wal-append.queue_time_us":835436}
I20260709 12:22:45.488801   865 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.521601   849 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:45.501691   424 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.487852   727 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 12:22:45.524518   827 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.028s
I20260709 12:22:45.448305   837 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:45.563549 30933 rpcz_store.cc:276] 0709 12:22:43.919192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.245552 (+326360us) service_pool.cc:224] Handling call
0709 12:22:44.249996 (+  4444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:44.394543 (+144547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:44.394588 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:44.399298 (+  4710us) log.cc:844] Serialized 52 byte log entry
0709 12:22:44.962499 (+563201us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b480018c258. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:22:45.177818 (+215319us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:45.177857 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.177924 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.524648 (+346724us) raft_consensus.cc:1685] finished
0709 12:22:45.524673 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.556043 (+ 31370us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138125,"raft.queue_time_us":145599,"raft.run_cpu_time_us":2045,"raft.run_wall_time_us":555174,"spinlock_wait_cycles":27821312,"thread_start_us":742508,"threads_started":1,"wal-append.queue_time_us":1076750}
I20260709 12:22:45.485275   509 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:45.526928   816 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:45.584859 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.567083   876 raft_consensus.cc:3055] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:45.575316   865 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:45.590224   877 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:22:45.591487 30929 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:45.592054   827 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.000s	sys 0.029s
I20260709 12:22:45.658264 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 244) took 1352 ms. Trace:
I20260709 12:22:45.599493   854 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:45.600208   855 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:45.600445   813 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.523561   765 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.602270   424 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:45.568750   724 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:45.604120   815 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.605376   817 consensus_queue.cc:237] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.607316   799 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:45.562484   660 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.523855   861 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:22:45.639520 30935 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
W20260709 12:22:45.656093   883 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 12:22:45.656881   867 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:45.665592   854 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:45.658851 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 183949us
I20260709 12:22:45.658839 30929 rpcz_store.cc:276] 0709 12:22:44.305943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.533314 (+227371us) service_pool.cc:224] Handling call
0709 12:22:44.533602 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.655731 (+1122129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.657535 (+  1804us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002a2e54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:45.657744 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432478976}
W20260709 12:22:45.663321 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 243048us
W20260709 12:22:45.665566 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 161872us
I20260709 12:22:45.645640   368 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:45.628768   816 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.653451   865 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.706344   724 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:45.707003   724 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:45.628500   876 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:45.657786   509 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:45.627241   884 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7.
W20260709 12:22:45.695799   846 consensus_meta.cc:287] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.902s	user 0.012s	sys 0.001s
I20260709 12:22:45.728359 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1500) took 1149 ms. Trace:
I20260709 12:22:45.728832 30927 rpcz_store.cc:276] 0709 12:22:44.579264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.916245 (+336981us) service_pool.cc:224] Handling call
0709 12:22:44.995496 (+ 79251us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:45.012135 (+ 16639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:45.012193 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:45.024615 (+ 12422us) log.cc:844] Serialized 52 byte log entry
0709 12:22:45.555846 (+531231us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:45.555894 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.555974 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:45.728138 (+172164us) raft_consensus.cc:1685] finished
0709 12:22:45.728158 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:45.728297 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13801,"raft.queue_time_us":13937,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":530822,"threads_started":1,"wal-append.queue_time_us":632102}
I20260709 12:22:45.679805   799 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:45.736334 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 208171us
I20260709 12:22:45.691365   765 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.694907   854 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.694271   827 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:45.750711   827 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:45.751637   827 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.713001   819 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:45.734594   839 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:22:45.698987 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:45.759192 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:45.760008 30777 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:45.763098 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:45.710842   861 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.738077 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:45.693545 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:45.738123 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.752856   827 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.768492   892 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.769110 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.770275   892 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:45.770793 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.771759   892 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.772428 30900 leader_election.cc:400] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8.
I20260709 12:22:45.772846 30900 leader_election.cc:403] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:22:45.774224 30899 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:45.775519 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 82039.8us
I20260709 12:22:45.776105 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.776404 30825 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:45.754066   830 consensus_meta.cc:287] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.787s	user 0.013s	sys 0.001s
I20260709 12:22:45.782864 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.779284   884 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:45.725086   860 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:22:45.792157 30825 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:45.694597   867 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.798231 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:45.773679   837 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:45.787999   864 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.013s
I20260709 12:22:45.737694   846 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.814692 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:45.804186 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:45.788169   727 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.784957   563 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:45.817643 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:45.827503 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:45.827749 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:45.828481 30780 raft_consensus.cc:2393] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:45.828667 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:45.827507 30900 connection.cc:256] RPC call timeout handler was delayed by -1.4478998989998217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 12:22:45.795202   831 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:45.829470 30778 raft_consensus.cc:1240] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:45.853569 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 300335us
I20260709 12:22:45.829336 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:45.793097   890 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:22:45.854657 30900 connection.cc:256] RPC call timeout handler was delayed by -1.3182998989996122s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
I20260709 12:22:45.794812   892 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8.
I20260709 12:22:45.799057   884 raft_consensus.cc:697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:45.802348   368 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:45.858119 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:45.809607   893 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.858570 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:45.822734   788 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.868439 30777 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:45.864538 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:45.787371   822 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:22:45.871155 30926 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:45.825868   563 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:45.788807   830 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:45.878014 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.882812 30857 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:45.832021   818 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:45.781342   861 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:45.889621 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.895229 30852 raft_consensus.cc:2376] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6. Re-sending same reply.
I20260709 12:22:45.828527   882 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:45.901896 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.902081 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.902612 30856 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:45.905057 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.908046   894 tablet_replica.cc:333] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:22:45.901041   727 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:22:45.909394   894 raft_consensus.cc:2243] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:45.908205 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.910296 30858 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:45.910408   894 raft_consensus.cc:2272] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:45.911322   863 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:45.911355 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.911845   863 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:45.912330 30858 raft_consensus.cc:2376] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7. Re-sending same reply.
I20260709 12:22:45.912686 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.913048 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.913400 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.925676 30859 raft_consensus.cc:2393] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:45.926051 30856 raft_consensus.cc:2376] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6. Re-sending same reply.
I20260709 12:22:45.926623 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.883394   713 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:45.927214 30859 raft_consensus.cc:2376] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5. Re-sending same reply.
I20260709 12:22:45.925635 30860 raft_consensus.cc:2376] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6. Re-sending same reply.
I20260709 12:22:45.928076 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:45.928166   739 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.000s
I20260709 12:22:45.928218 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.866487   890 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:45.928922 30859 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:45.929144   890 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:45.929463 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.930047 30860 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:45.915688   894 ts_tablet_manager.cc:1916] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:22:45.871239   368 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.932152   368 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:45.933229   861 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:45.907727   892 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:45.873096   788 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:45.922866   884 consensus_queue.cc:237] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.923568   882 raft_consensus.cc:697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:45.912372   863 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.926923 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.933998   881 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:45.858749   868 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:22:45.936076   810 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:45.919170 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1498) took 1606 ms. Trace:
I20260709 12:22:45.970690 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.974548 30859 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.974107 30926 rpcz_store.cc:276] 0709 12:22:44.312516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:44.878692 (+566176us) service_pool.cc:224] Handling call
0709 12:22:44.879168 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.871713 (+992545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:45.918940 (+ 47227us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54001c70d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:45.919109 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2280789760}
I20260709 12:22:45.937441 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:45.938596   901 log.cc:927] Time spent T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:22:45.938704   889 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:22:45.796368   876 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.939502   831 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.958110   788 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:45.906708 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.990767 30855 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:45.942589 30931 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:45.943732   830 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:45.945717 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:45.890653   818 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.884649 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:45.948031 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.993506 30852 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:45.890990   563 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:45.948630 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 90610.5us
I20260709 12:22:45.916777   641 raft_consensus.cc:3055] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:45.905838 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:45.955119 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 125854us
I20260709 12:22:45.970634   424 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:45.960942 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:45.961316 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:45.834368   869 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.968140 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:45.968892 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:45.975854 31507 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:45.969623 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:45.978591 30900 leader_election.cc:336] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.918s (SENT)
W20260709 12:22:46.005424 30900 leader_election.cc:336] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.004s (SENT)
I20260709 12:22:45.966753   881 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.973897   810 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:45.939893   816 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:45.991881 30854 raft_consensus.cc:2376] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3. Re-sending same reply.
I20260709 12:22:45.949667   815 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.001629 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.021184 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.022332   855 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.022385 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:46.022881   855 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.002410 30858 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:46.007575 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.012529 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:46.012950 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:45.993578   818 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.023474 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.017953   822 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:22:46.063290   882 consensus_queue.cc:237] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.064934 30855 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:45.998330   641 raft_consensus.cc:740] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:46.067198 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.016132   881 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.010305   876 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:46.077234 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 64714.4us
I20260709 12:22:46.080802 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:46.097733 30900 leader_election.cc:336] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.936s (SENT)
I20260709 12:22:46.066340   776 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:46.066205   849 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:46.051324   816 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:46.010275   424 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.104848   822 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.062841   890 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.119621   822 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:46.119973   907 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:46.109207   776 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:46.121033   776 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.051286   855 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.123373   869 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:46.077486   810 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.015969   724 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.134003   724 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:46.134600   846 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.135284 30930 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:46.135533   810 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.138964   867 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:46.113246   849 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:46.140363   849 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.145865 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:46.115037   641 consensus_queue.cc:260] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:46.111541 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 107298us
I20260709 12:22:46.120517   907 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.112569 30859 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:46.166090 30853 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:46.146916 30784 raft_consensus.cc:1275] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:46.120132   822 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.145246 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.147800 30855 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:46.168756 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 54495us
I20260709 12:22:46.171331 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:46.163172 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 139794us
I20260709 12:22:46.146889 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.173667 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.177788 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.016281   898 consensus_queue.cc:1059] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 12:22:46.179584 30783 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:46.182343 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.179971 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:46.121532   890 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:46.182771 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.164634   853 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.186352 30930 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:46.176307   867 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.183955   509 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.205514   895 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:46.184264   739 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:46.163975   563 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.212527   799 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.209692   727 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:46.138358   491 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:46.218716   424 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:46.219228   660 consensus_meta.cc:287] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.534s	user 0.015s	sys 0.010s
I20260709 12:22:46.271888   660 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.274173   660 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:46.199374   641 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.220835   821 consensus_queue.cc:1059] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:22:46.168386   907 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:46.221334   862 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.003s
I20260709 12:22:46.226213   853 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:46.226468 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:46.230252   898 raft_consensus.cc:3055] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:22:46.231524   910 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:22:46.300837   563 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:46.205470 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:46.242532 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 246) took 1434 ms. Trace:
I20260709 12:22:46.304872 30931 rpcz_store.cc:276] 0709 12:22:44.808711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.009487 (+200776us) service_pool.cc:224] Handling call
0709 12:22:45.134321 (+124834us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b5800072998. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:45.144256 (+  9935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:45.993320 (+849064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:46.242284 (+248964us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54001c7fd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:46.242468 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910961792}
W20260709 12:22:46.260118 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 60770.7us
I20260709 12:22:46.263523   765 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.193450   906 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.282038 30935 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:46.179986   724 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
W20260709 12:22:46.289829 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.232576   831 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:46.288874   898 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:46.312140   909 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
I20260709 12:22:46.314150 30776 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:46.315315 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 109914us
I20260709 12:22:46.326573 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:46.326805 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.211797   368 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:46.332931 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 159350us
I20260709 12:22:46.286216   739 raft_consensus.cc:697] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:46.286321   890 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.210611   854 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.332867 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:46.335098 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.336463 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.337354 30851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425"
dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:32956
I20260709 12:22:46.341871 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:46.346323 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.346535 30750 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:46.348416 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:46.349901 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.351959 30750 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:22:46.354053 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.353053 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:46.358852 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:46.328819   853 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:46.367009 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.319528   765 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.318209   881 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.351046   906 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:46.313378   862 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.368280   905 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:46.350082   563 raft_consensus.cc:2764] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:46.356644   509 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:46.354977   893 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.385495   818 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.371805   898 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.388926   739 consensus_queue.cc:237] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.390161   368 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:46.392447 30777 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:46.368777   868 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:46.367175   682 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:46.394018 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.394639 30784 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.388893   818 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:46.379663 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.407591 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.408136 30855 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:46.411520 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.412243   641 raft_consensus.cc:2764] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:22:46.412587 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.413450 30853 raft_consensus.cc:2393] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:46.414479 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.414889   839 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.416425 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.417026 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.418007 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.418761 30858 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:46.418840 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.420445 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.420969 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.421259 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.421619 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.422024 30852 raft_consensus.cc:2376] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5. Re-sending same reply.
I20260709 12:22:46.355122   890 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:46.395823   865 consensus_meta.cc:287] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.690s	user 0.014s	sys 0.000s
I20260709 12:22:46.421576 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.392385   509 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:46.433068 30856 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:46.382467   905 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:46.434971 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.395181   727 raft_consensus.cc:2764] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:22:46.438304   865 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.426347   868 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:46.440591   854 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.441001   919 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.441365   912 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.439687 30858 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:46.444401 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 89447.7us
I20260709 12:22:46.451869 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:46.392915   864 consensus_queue.cc:1175] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47c0d0bc235a443aad3c62643e91b081" responder_term: 5 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:22:46.393641   884 consensus_queue.cc:1059] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:22:46.458362 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.429490   682 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:46.467859 30784 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:46.478232 30926 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:46.447348   509 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.479501 30860 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:46.482092 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:46.483603 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.484129 30777 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:46.472072 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.485368 30856 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:46.457053   788 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.486501 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.486891 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.447870   905 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.458534   919 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.497539 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.499251 30858 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:46.496047 30852 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:46.500027 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:46.502419 31509 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.500497 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.507599 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.509786 30779 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:46.500999   799 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.500097   919 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.531672 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:46.525370 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:46.506727   563 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.535785 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.546627 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.548647 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:46.508745   920 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:46.502533   839 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.539951 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:46.550414 30935 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:46.541025 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.553333 30852 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:46.557071 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.561324 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:46.557315 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:46.564823 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 53988.8us
I20260709 12:22:46.565616 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:46.565941 30930 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:46.503238   933 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:22:46.569947 30935 raft_consensus.cc:2410] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:46.514523   906 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:46.510324   893 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:22:46.507416   849 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.583194 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:46.596167 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.552112   839 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:46.552342   920 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:46.586022 31509 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:46.500520   853 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.594085   660 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.589785 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.671310 30858 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:46.590835 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.591010 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:46.673159 30935 raft_consensus.cc:2368] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5.
I20260709 12:22:46.551353   830 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.591769 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:46.564090   368 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.599946 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:46.684134 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 84314.1us
W20260709 12:22:46.679963 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 91343.6us
I20260709 12:22:46.563704   896 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.601428 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:46.578202   799 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:46.609678 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:46.613101   894 ts_tablet_manager.cc:1929] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:22:46.616677   881 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.564531   846 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:22:46.595506   682 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.702195 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.702943 30852 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:46.626492   862 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.635092 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:46.639098 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:46.705027 30932 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.640100 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:46.648883   788 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.526115   868 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.653630 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.529940   714 consensus_queue.cc:1059] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 12:22:46.593168   765 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.567418   739 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:22:46.675315 30854 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:46.601603   839 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:46.649698   776 consensus_meta.cc:287] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.000s
I20260709 12:22:46.603929   895 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:46.687031 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:46.749536 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 62586.1us
I20260709 12:22:46.608791   724 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.692090 30930 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.692699 30929 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:46.649713   865 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:46.654925   912 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:46.604610   929 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:22:46.696298   890 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:46.694093   920 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.696830   907 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.758316   827 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.760859   907 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.760623   509 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.637444   822 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.762689 30783 raft_consensus.cc:1240] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:46.763069 30781 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:46.623880   855 consensus_meta.cc:287] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.502s	user 0.014s	sys 0.003s
I20260709 12:22:46.762861   509 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.705924 30934 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.763983   849 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.763867   855 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.766028 30853 raft_consensus.cc:2368] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7.
I20260709 12:22:46.766893   855 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:46.769121   876 consensus_meta.cc:287] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.001s
W20260709 12:22:46.708942 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 55412.9us
I20260709 12:22:46.770183 30778 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:46.771559 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:46.772310   936 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:22:46.772670 30826 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:46.773948 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.774259   920 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.775359 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:46.775854 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:46.776000 30927 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.776547 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:46.777163 30935 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.753041   724 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.778218   724 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.772328 31509 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:46.762892   822 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.780892   849 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:22:46.781078   863 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.006s
I20260709 12:22:46.781615   849 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.781549   863 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.782100 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.782735 30782 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:46.783206   368 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:46.737231 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.783775 30851 raft_consensus.cc:606] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:46.784174 30851 raft_consensus.cc:614] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:46.784236 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.785198 30934 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:46.738221 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.654778   935 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 12:22:46.707525   799 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:22:46.650134   906 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.741195   842 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:46.805518 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:46.704226   894 log.cc:1199] T dd65da5a34854820ae636ab77116f737 P 5e7509fe1be74f179626fb4fcb4b4e65: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/wals/dd65da5a34854820ae636ab77116f737
I20260709 12:22:46.752985   831 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.775738 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.692947   867 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:46.776769   912 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.787396 30856 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.788201 30927 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:46.737357 30858 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:22:46.818782 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.819916 30858 raft_consensus.cc:2393] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:46.789252 30935 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
W20260709 12:22:46.784332 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 74373.9us
I20260709 12:22:46.790577 30930 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:46.798810 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:46.803120   724 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.832175 30929 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:22:46.804636   905 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.805785   842 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:46.743877 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.838284 30852 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.836292 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.783620   368 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:46.839959 30858 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.846355 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.847636 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:46.848312 30776 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:46.789891   739 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:46.851826 30826 leader_election.cc:400] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5.
I20260709 12:22:46.855921 30826 leader_election.cc:403] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:22:46.857388 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.812129   799 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.861266 30826 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.834478   867 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.813952   863 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.753824   776 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.818281   846 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:46.868216 30826 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.835088   881 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:46.845474   724 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:46.870523 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:46.874898 30856 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:46.851452   368 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.877966 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:46.879937 30858 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:46.880028 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.882541 30856 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:46.882987 30900 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:46.883860   865 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.885875   913 raft_consensus.cc:3055] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:46.886278   913 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:46.887140   913 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.887466   919 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.888710 30857 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:46.889328 30852 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
W20260709 12:22:46.891140   810 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.755s	user 0.017s	sys 0.004s
I20260709 12:22:46.893908   831 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:46.894759   842 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:46.895670   905 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.895874   894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:54636 (request call id 80) took 1579 ms. Trace:
I20260709 12:22:46.902281 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.905213 30858 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.905684 30783 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:46.896670   842 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:46.874476   928 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:46.875769   867 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:46.945231 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.922087 30858 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:46.946856 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:46.947746 30858 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:46.948791 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.896975   864 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:46.870083   799 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.954615 30858 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:46.944864   831 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:46.881094   927 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 4. Current term is 5.
I20260709 12:22:46.943156   853 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:22:46.970520   941 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:22:46.971673   831 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.961977   864 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:46.972819 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.980894 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.981556 30860 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:46.896287   894 rpcz_store.cc:276] 0709 12:22:45.347014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.350769 (+  3755us) service_pool.cc:224] Handling call
0709 12:22:45.789522 (+438753us) ts_tablet_manager.cc:1151] Deleting tablet dd65da5a34854820ae636ab77116f737
0709 12:22:45.812915 (+ 23393us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:22:46.302825 (+489910us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:46.612940 (+310115us) tablet_metadata.cc:665] Metadata flushed
0709 12:22:46.895746 (+282806us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":342103,"thread_start_us":191640,"threads_started":1}
I20260709 12:22:46.982770   919 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:46.982962 30667 catalog_manager.cc:5028] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): tablet dd65da5a34854820ae636ab77116f737 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:22:46.983649 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:46.984279 30859 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.986056   776 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:46.985214   853 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:46.994987   853 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.001659 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:47.002345 30856 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.004454 30932 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:47.015563 30856 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:47.016541 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:47.017026 30856 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.018016   835 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.018049   937 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.021780   835 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.022042   937 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.024087   835 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:47.018191   724 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.024005 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:47.025899 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:47.030928 30781 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.039495 30851 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:47.041252 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.044417 30777 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:47.044782 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:47.044368 30856 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:47.045703 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:47.046362 30856 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:47.026927 30899 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:47.037213 30859 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:47.024391   937 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.049810   905 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:47.051743 30859 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:47.049049 30856 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:47.060695 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:47.061625 30825 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:47.046561 30750 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:47.050017 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:47.069181 30852 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:47.062464 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:47.275674 30860 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:47.274088 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:47.196729 30853 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:47.077623 30859 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:47.292060 30853 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:22:47.294049 30853 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:47.020969   660 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:47.295156 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 233611us
I20260709 12:22:47.315183 30777 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:47.315850 30777 raft_consensus.cc:606] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:47.316215 30777 raft_consensus.cc:614] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:47.275830 30856 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:47.319105 30856 raft_consensus.cc:1240] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:22:47.304271 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 257759us
I20260709 12:22:47.099148 30851 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:47.301554 30860 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:47.021824   830 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:47.310408 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 258304us
I20260709 12:22:47.321308 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:47.163605   882 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.276396   920 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.294900   881 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.058947   788 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:47.270670   799 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.063613   905 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:47.336669   882 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.336798   830 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.272079   864 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.064184   835 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:47.307746   776 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:47.342371 30860 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:22:47.344022 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:47.311517   929 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:47.053988   724 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.337930   868 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:47.162897   865 consensus_queue.cc:1059] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.179s
I20260709 12:22:47.312899   368 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:47.389900 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.452647 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1355) took 1334 ms. Trace:
W20260709 12:22:47.532881 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 188913us
I20260709 12:22:47.514804 30856 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.535229 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1293) took 1020 ms. Trace:
I20260709 12:22:47.519342 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:47.535565 30860 rpcz_store.cc:276] 0709 12:22:46.514896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.321497 (+806601us) service_pool.cc:224] Handling call
0709 12:22:47.342135 (+ 20638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.534895 (+192760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.535176 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.505843 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:47.537863 30781 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:47.540042 30858 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:47.540619 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1296) took 1018 ms. Trace:
I20260709 12:22:47.349220   954 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.540951 30858 rpcz_store.cc:276] 0709 12:22:46.522615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.539503 (+1016888us) service_pool.cc:224] Handling call
0709 12:22:47.539902 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.540446 (+   544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.540575 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.533810 30782 rpcz_store.cc:276] 0709 12:22:46.117960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.118122 (+   162us) service_pool.cc:224] Handling call
0709 12:22:46.118420 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:46.783093 (+664673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.452311 (+669218us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54002d0354. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:47.452559 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527369472}
I20260709 12:22:47.543637 30933 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:47.546365 30858 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:47.546849 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1304) took 1022 ms. Trace:
I20260709 12:22:47.547134 30858 rpcz_store.cc:276] 0709 12:22:46.524639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.545736 (+1021097us) service_pool.cc:224] Handling call
0709 12:22:47.546046 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.546676 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.546811 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.548033 30858 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:47.548378 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1305) took 1023 ms. Trace:
I20260709 12:22:47.548555 30858 rpcz_store.cc:276] 0709 12:22:46.524870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.547633 (+1022763us) service_pool.cc:224] Handling call
0709 12:22:47.547836 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.548232 (+   396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.548345 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.549365 30858 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:22:47.549882 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1483) took 1013 ms. Trace:
I20260709 12:22:47.550201 30858 rpcz_store.cc:276] 0709 12:22:46.536802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.548976 (+1012174us) service_pool.cc:224] Handling call
0709 12:22:47.549213 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.549598 (+   385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.549744 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.552675 30858 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:47.348662   905 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.570801 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1484) took 1028 ms. Trace:
I20260709 12:22:47.571298 30858 rpcz_store.cc:276] 0709 12:22:46.542084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.552126 (+1010042us) service_pool.cc:224] Handling call
0709 12:22:47.552440 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:47.570493 (+ 18053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.570737 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.571749 30860 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:47.572430 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1302) took 1048 ms. Trace:
I20260709 12:22:47.572803 30860 rpcz_store.cc:276] 0709 12:22:46.524162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.542784 (+1018622us) service_pool.cc:224] Handling call
0709 12:22:47.571425 (+ 28641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.572205 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.572381 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.556773 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:47.557612 30781 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:47.484506   898 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:47.342319   906 consensus_queue.cc:1059] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.216s
I20260709 12:22:47.375977   928 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:47.465886   787 consensus_queue.cc:1059] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
W20260709 12:22:47.552824   839 consensus_meta.cc:287] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.002s
I20260709 12:22:47.348696   788 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.554536   835 raft_consensus.cc:697] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:47.576162   799 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:47.594002 30860 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.577523   933 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.346347   937 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.236s
I20260709 12:22:47.575704 30781 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.342522   920 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.513878   853 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:22:47.445747   882 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.572597 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:47.543663   727 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:47.606376   727 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.344949   881 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.590719 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1487) took 1047 ms. Trace:
I20260709 12:22:47.608942 30853 rpcz_store.cc:276] 0709 12:22:46.543113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.575468 (+1032355us) service_pool.cc:224] Handling call
0709 12:22:47.590045 (+ 14577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.590240 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.590270 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.590328 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:47.590386 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.590461 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.590637 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.595403 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1485) took 1053 ms. Trace:
I20260709 12:22:47.550684   884 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:22:47.594525   906 raft_consensus.cc:3055] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:47.586411   928 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.604758   933 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.607375 30858 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:47.610466 30860 rpcz_store.cc:276] 0709 12:22:46.542463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.582790 (+1040327us) service_pool.cc:224] Handling call
0709 12:22:47.593685 (+ 10895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.595035 (+  1350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.595328 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.594408   839 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:47.600889 30781 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:47.459772   867 consensus_meta.cc:287] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
I20260709 12:22:47.555614   954 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.626417 30781 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.630317 30780 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:47.611333   937 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:47.633352 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1488) took 1090 ms. Trace:
I20260709 12:22:47.634979 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 263) took 1501 ms. Trace:
I20260709 12:22:47.637403 30926 rpcz_store.cc:276] 0709 12:22:46.133431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.136433 (+  3002us) service_pool.cc:224] Handling call
0709 12:22:46.136801 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:46.478781 (+341980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.634657 (+1155876us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54000ea1d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:47.634897 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784728960}
I20260709 12:22:47.638911 30853 rpcz_store.cc:276] 0709 12:22:46.543420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.614970 (+1071550us) service_pool.cc:224] Handling call
0709 12:22:47.632701 (+ 17731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.632923 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:47.632960 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:47.633018 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:47.633059 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.633128 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.633279 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:47.640251 30858 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:47.641266 30860 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:47.618297   906 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.643621 30858 raft_consensus.cc:1275] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:47.645490 31508 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:47.649669 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 114746us
I20260709 12:22:47.646538 30853 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:47.654465 30776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:47.655229 30776 raft_consensus.cc:606] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:47.655594 30776 raft_consensus.cc:614] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:22:47.652043 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 98092.4us
W20260709 12:22:47.661074 30900 leader_election.cc:336] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 3.334s (SENT)
I20260709 12:22:47.662755 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:47.662319 30860 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:22:47.636566   937 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.643671   821 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.647927   839 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:47.670953 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.679999 30934 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.649580   927 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:47.669658 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.631944   867 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:47.687340 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 153248us
I20260709 12:22:47.689044 30929 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.678521 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:47.681946 30931 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:22:47.669727 30926 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:47.684441 30927 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:47.691584 30934 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:47.692075 30781 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:22:47.664944   868 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.673692   865 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.630748   727 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.693845 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:47.694881 30781 pending_rounds.cc:85] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 4
I20260709 12:22:47.697649 30931 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 12:22:47.702821 30781 pending_rounds.cc:107] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:22:47.681715   895 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:47.703255 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.704757 30781 raft_consensus.cc:2889] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:47.709120 30927 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:47.698716 30776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:47.649875   788 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.725678   884 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:47.726294   884 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.648147   835 consensus_queue.cc:237] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.727939 30855 raft_consensus.cc:2410] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:47.713322   868 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.728538   884 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:47.715667   867 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:47.716563   860 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:22:47.731722   920 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.732277 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.732407   368 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:47.687244   906 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.733492 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.733862   906 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.734063 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.731741   860 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:47.735309   860 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:47.736191   860 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.738157   881 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.719146   830 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:47.722419   928 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:47.722818   839 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.730243   959 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:47.730809   960 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:47.739748 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.740355 30927 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
W20260709 12:22:47.744050 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 50291.7us
I20260709 12:22:47.755781 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:47.760548   961 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:47.702050   937 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.761200   961 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.761513   937 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.761641   961 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.706480   865 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.738502   860 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.765836   865 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:47.766161   839 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:47.766251 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:47.766705   839 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.766898   933 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.690619   927 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.767863 30927 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [5.2-6.3]
I20260709 12:22:47.767567   839 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.768749   839 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:47.769129 30927 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:22:47.681953   821 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.770105   959 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:47.773166 30935 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:22:47.776113 30931 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:47.776615 30935 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:47.779910 30935 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.696594   929 raft_consensus.cc:697] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.770493   959 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.760637 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:47.790717   930 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.231s	user 0.005s	sys 0.020s
I20260709 12:22:47.791795 31508 raft_consensus.cc:2393] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
W20260709 12:22:47.793103 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 129844us
I20260709 12:22:47.799708   905 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:47.795807 30899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.088s	sys 0.145s
W20260709 12:22:47.802268 30899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.088s	sys 0.145s
I20260709 12:22:47.801941   964 consensus_queue.cc:1059] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:47.776053   927 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:47.803157 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 743526us
I20260709 12:22:47.797502   821 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.811268   368 consensus_queue.cc:1059] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:47.811997   954 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:47.812013   865 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:47.813215   865 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:47.813597   865 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:47.814505   865 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.815805   865 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:47.781526   960 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.818562   368 raft_consensus.cc:3055] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:47.819032   368 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:47.820178   960 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:47.819936   368 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.820586 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:47.821300   368 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:47.822810   959 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.823414 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1279) took 1405 ms. Trace:
I20260709 12:22:47.824873 30859 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.812510   905 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:47.825790 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:47.823874 30854 rpcz_store.cc:276] 0709 12:22:46.418478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.418592 (+   114us) service_pool.cc:224] Handling call
0709 12:22:47.823183 (+1404591us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540003edd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:47.823341 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544114048}
I20260709 12:22:47.826491 30930 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 2.
I20260709 12:22:47.789731   933 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:47.831110 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1347) took 1966 ms. Trace:
I20260709 12:22:47.832859 30779 rpcz_store.cc:276] 0709 12:22:45.864696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:45.864829 (+   133us) service_pool.cc:224] Handling call
0709 12:22:45.865156 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:46.510324 (+645168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.830890 (+1320566us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540014d7d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:47.831051 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481993600}
I20260709 12:22:47.837529 30927 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:47.844591 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:47.845731 30778 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:22:47.827607   959 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:47.847126 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1490) took 1159 ms. Trace:
I20260709 12:22:47.847549 30852 rpcz_store.cc:276] 0709 12:22:46.687599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.941515 (+253916us) service_pool.cc:224] Handling call
0709 12:22:47.846968 (+905453us) spinlock_profiling.cc:243] Waited 60.5 ms on lock 0x7b54003273d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:47.847066 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139120512}
I20260709 12:22:47.843765 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:47.849923 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:47.851395 30930 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:47.849561 30779 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:47.861909 30927 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:47.864254 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:47.830732   868 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:47.869446 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:47.873826 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:47.874331 30930 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:22:47.870863 30778 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
W20260709 12:22:47.876406 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 73197.5us
I20260709 12:22:47.834641   953 consensus_queue.cc:1059] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:22:47.834414   962 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:22:47.858490   933 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:47.837145   830 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:22:47.858146   867 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:22:47.897190   895 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:47.897660   895 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:47.898793   895 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.900116   895 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:47.903385   933 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.906435 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1248) took 1269 ms. Trace:
I20260709 12:22:47.907045 30928 rpcz_store.cc:276] 0709 12:22:46.636808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.643565 (+  6757us) service_pool.cc:224] Handling call
0709 12:22:46.643889 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:46.684058 (+ 40169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:46.684091 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:46.684147 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:46.684183 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:47.906066 (+1221883us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b54002639d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:47.906142 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:47.906347 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91871104}
I20260709 12:22:47.912106   892 raft_consensus.cc:3055] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:47.912631   892 raft_consensus.cc:740] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:47.913458   892 consensus_queue.cc:260] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.905463   816 raft_consensus.cc:3055] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:47.872414   868 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:47.858876   929 consensus_queue.cc:237] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:47.923811   892 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:47.970546 30784 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:47.971216 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:48.002204 30899 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:48.006469 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 119707us
W20260709 12:22:48.018682 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:47.922528   816 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:48.026751 30899 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:48.028061   830 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:48.030670   954 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:48.033130   927 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:47.916566   825 consensus_queue.cc:1059] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
W20260709 12:22:48.038975   970 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:22:48.046080 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 75349.1us
I20260709 12:22:48.055411   839 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:22:48.054874   961 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.057441 30779 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:48.058920   961 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.064270   825 raft_consensus.cc:3055] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:48.064491 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1272) took 1653 ms. Trace:
I20260709 12:22:48.066028   816 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.067387   927 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.074189 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1478) took 1598 ms. Trace:
I20260709 12:22:48.074815 30859 rpcz_store.cc:276] 0709 12:22:46.475737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.303072 (+827335us) service_pool.cc:224] Handling call
0709 12:22:47.824692 (+521620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.825251 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.073507 (+248256us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b540003edd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:48.073867 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196135808}
I20260709 12:22:48.076936   927 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:48.068239 30857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1282) took 1647 ms (client timeout 2051 ms). Trace:
I20260709 12:22:48.039526   937 consensus_queue.cc:1059] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:22:48.050304   830 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:48.082239 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.077092 30851 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:22:48.085189   839 raft_consensus.cc:3055] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.085369   799 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:48.085752   839 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.086246   799 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.071945 30855 rpcz_store.cc:276] 0709 12:22:46.410911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.411232 (+   321us) service_pool.cc:224] Handling call
0709 12:22:48.063828 (+1652596us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003a7fd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:48.064171 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025288576}
I20260709 12:22:48.087666   839 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.071791   825 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:48.090060   839 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.088806   816 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.091353   825 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:48.094807 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 68469us
I20260709 12:22:48.052790   868 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:48.099257 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:48.104071 30899 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:48.088471   799 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:48.079800 30857 rpcz_store.cc:269] 0709 12:22:46.420604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.420735 (+   131us) service_pool.cc:224] Handling call
0709 12:22:48.067731 (+1646996us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54003be554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:48.068058 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073926528}
I20260709 12:22:48.084517   830 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.117875 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1481) took 1572 ms. Trace:
I20260709 12:22:48.118094   954 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:48.118898   954 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.118501 30856 rpcz_store.cc:276] 0709 12:22:46.496557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.320189 (+823632us) service_pool.cc:224] Handling call
0709 12:22:47.514619 (+194430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.534888 (+ 20269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.068567 (+533679us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54004362d0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:48.068865 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446322560}
I20260709 12:22:48.118109 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:48.124174 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 59162.6us
I20260709 12:22:48.126725 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.127249   424 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:48.127816 30931 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:22:48.127871   424 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:48.120491   954 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.135214 30776 raft_consensus.cc:606] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:48.129724   424 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.136881 30785 raft_consensus.cc:1240] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:48.137960   424 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.129969   927 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.143525   927 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.121196   868 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.146723   868 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.150404   868 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:48.150763 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.151762   368 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:48.162771 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:48.165324   927 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.165391   958 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:48.166388   958 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.166953   958 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.167995   912 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.174665   825 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:48.179594   951 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.847s	user 0.001s	sys 0.003s
I20260709 12:22:48.130316 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:48.181860   950 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.800s	user 0.004s	sys 0.001s
W20260709 12:22:48.186487 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 56966.5us
I20260709 12:22:48.189165   953 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.190158   953 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.190970   895 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:48.191771   895 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.193166   953 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:48.207090   865 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:48.196931   929 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:48.212747   895 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:48.212611   839 consensus_queue.cc:1059] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:48.212504   865 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.213979   929 raft_consensus.cc:697] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.215705   865 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:48.215330   929 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.222817 30931 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:48.227887 30784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:48.228956 30784 raft_consensus.cc:606] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:48.229851   724 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:48.236637 30779 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
W20260709 12:22:48.236965   906 consensus_meta.cc:287] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.502s	user 0.016s	sys 0.000s
I20260709 12:22:48.255965 30932 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:48.258018 30779 raft_consensus.cc:606] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:48.265187 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:48.266907   831 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:48.268317   831 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:48.269466 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:48.271893 30856 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
W20260709 12:22:48.272070 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.276880 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.277382 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.286046 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.286952 30778 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
W20260709 12:22:48.287391   976 log.cc:927] Time spent T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.185s	user 0.002s	sys 0.000s
I20260709 12:22:48.286244 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:48.288900 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.289564 30900 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 4.301s (SENT)
I20260709 12:22:48.285458   912 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.295400 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:48.296193 30931 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:48.296142 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.294013 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.300199   912 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.300045   727 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:48.278586   958 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.305003   913 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:48.307796 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.308418 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:48.303094   727 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.310122   727 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.302908 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:22:48.311872   727 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:48.315019 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.318512 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1319) took 1877 ms. Trace:
I20260709 12:22:48.318986 30780 rpcz_store.cc:276] 0709 12:22:46.441011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.508069 (+ 67058us) service_pool.cc:224] Handling call
0709 12:22:46.529715 (+ 21646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:47.630758 (+1101043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.317916 (+687158us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001a5754. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:48.318280 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2530640128}
I20260709 12:22:48.319579   912 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:48.320935 30933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1242) took 1642 ms (client timeout 1690 ms). Trace:
W20260709 12:22:48.321393 30933 rpcz_store.cc:269] 0709 12:22:46.634635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:46.634796 (+   161us) service_pool.cc:224] Handling call
0709 12:22:48.237793 (+1602997us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b540027c754. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:48.276419 (+ 38626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468791680}
I20260709 12:22:48.293471   816 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.326274 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:48.330013 31508 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:48.330354 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1482) took 1817 ms. Trace:
I20260709 12:22:48.329497   714 raft_consensus.cc:3055] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.338395 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.335031 30851 rpcz_store.cc:276] 0709 12:22:46.513314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:47.321346 (+808032us) service_pool.cc:224] Handling call
0709 12:22:48.076415 (+755069us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.109325 (+ 32910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.330124 (+220799us) spinlock_profiling.cc:243] Waited 747 ms on lock 0x7b54003be550. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:48.330274 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1718560000}
I20260709 12:22:48.339941   714 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:48.349391 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:48.347604 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:48.361516 30926 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:48.335992   906 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:48.366117 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 111525us
I20260709 12:22:48.336905   816 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.344985   868 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:48.351261   424 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.369593 30899 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:48.372547 30931 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.369017 30779 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:48.375339   912 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.375998   912 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.353329   724 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.378801   954 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.377331   724 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:48.381268 30667 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:48.372042   868 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.368734   827 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:22:48.382768   724 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:48.383316   827 consensus_queue.cc:1243] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:48.382959   868 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.384620   868 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.384665 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.386354   912 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.367410   714 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.390347   830 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.381466   954 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:48.407612 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 123951us
I20260709 12:22:48.397830 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:48.428357 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62303.3us
I20260709 12:22:48.427492 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.414868 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.426882 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.439707 30935 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:48.441963 30929 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:48.441617 30933 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 2.
I20260709 12:22:48.434676 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.432566   895 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:48.451215 30678 catalog_manager.cc:5697] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:48.452342   978 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:22:48.454438 30932 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:48.462709   871 consensus_queue.cc:1059] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:22:48.463176 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.464319 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:48.465919 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:48.466555 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.467626 30928 raft_consensus.cc:2393] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:48.468504 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:48.469095   865 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.449460 30780 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 3.
I20260709 12:22:48.440953 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:48.474124 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 47060.8us
I20260709 12:22:48.459116 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.484577 30931 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:48.482653   959 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:48.485728 30779 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:48.485879   959 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.491197   959 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.486349   954 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:48.492620   954 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:48.493834   954 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.496738 30858 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:48.486544 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.488296   830 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:48.498905 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.487212   816 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:48.452913   906 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.505301   906 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:48.455085   895 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:48.506039   895 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.512629   959 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:48.514735 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:48.513728   822 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:48.515936   822 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:22:48.516309   822 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.516644   822 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.517481 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.518229 30935 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:48.519407   724 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:48.519855   724 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:48.520649 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.520820   724 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.521694 30929 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:48.510845   714 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:48.528273 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 56395.6us
W20260709 12:22:48.534889 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.535125   424 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:22:48.535883   980 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:22:48.538642   835 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:48.551512   724 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.551805   835 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:48.539317   959 consensus_queue.cc:1059] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:22:48.540297 30682 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 80) took 9979 ms. Trace:
I20260709 12:22:48.550714 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.553396 30933 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
W20260709 12:22:48.554703 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.560009 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:48.560340 30782 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:22:48.562211   933 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:48.562903 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:48.563679 30780 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.563566   822 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.572057 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.574327 30779 raft_consensus.cc:2410] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:48.588587 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.589787 30784 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:48.566075   961 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:48.600533 30858 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:22:48.606253 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 137959us
I20260709 12:22:48.609362 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.621410 30784 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:48.630662 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:48.631657   954 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:48.631814 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.632131   954 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.632570   958 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.632597   954 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.634090 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:48.634763 30858 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 3.
I20260709 12:22:48.635649   799 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:48.635726   835 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.636859 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:48.637240   835 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.638049   933 raft_consensus.cc:3055] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.638456   933 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.639338   906 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:48.639497   933 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.641044   933 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.637038   959 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:48.636854   799 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:22:48.646351   727 raft_consensus.cc:3055] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:48.646878   727 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.640012   906 raft_consensus.cc:697] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.649374 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:48.600396   961 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.658502 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.611392   822 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.659796 30857 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:48.671715 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:48.672374 30858 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:48.677523 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:48.647950   727 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.678613 30933 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.680934 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:48.686929   368 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.004s
I20260709 12:22:48.687485   368 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.694576   906 consensus_queue.cc:237] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.696281 30934 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:48.698024 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.666180 30678 catalog_manager.cc:5697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 4 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 6 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.718466 30931 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:48.718196 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:48.721519 30779 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:48.725140 30780 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:48.552985 30682 rpcz_store.cc:276] 0709 12:22:38.561144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:38.579161 (+ 18017us) service_pool.cc:224] Handling call
0709 12:22:48.539988 (+9960827us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:45.816296 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:45.927960 (+111664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:45.927994 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:22:45.928006 (+    12us) tablet.cc:662] Decoding operations
0709 12:22:45.928562 (+   556us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:45.928620 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:45.928647 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:22:45.928964 (+   317us) tablet.cc:701] Row locks acquired
0709 12:22:45.928978 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:22:45.929128 (+   150us) write_op.cc:270] Start()
0709 12:22:45.929259 (+   131us) write_op.cc:276] Timestamp: P: 1783599765929079 usec, L: 0
0709 12:22:45.929273 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:22:45.929955 (+   682us) log.cc:844] Serialized 1364 byte log entry
0709 12:22:46.752973 (+823018us) op_driver.cc:464] REPLICATION: finished
0709 12:22:46.849327 (+ 96354us) write_op.cc:301] APPLY: starting
0709 12:22:46.859648 (+ 10321us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:46.877798 (+ 18150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:46.915725 (+ 37927us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:46.983990 (+ 68265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:46.994146 (+ 10156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:22:46.994222 (+    76us) write_op.cc:312] APPLY: finished
0709 12:22:46.994475 (+   253us) log.cc:844] Serialized 34 byte log entry
0709 12:22:46.994672 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.994823 (+   151us) write_op.cc:454] Released schema lock
0709 12:22:46.994892 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:46.995383 (+   491us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:46.995424 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":249,"mutex_wait_us":19065,"reported_tablets":12,"spinlock_wait_cycles":4352,"child_traces":[["op",{"apply.queue_time_us":50324,"apply.run_cpu_time_us":3162,"apply.run_wall_time_us":161542,"num_ops":3,"prepare.queue_time_us":315709,"prepare.run_cpu_time_us":9533,"prepare.run_wall_time_us":204682,"raft.queue_time_us":306055,"raft.run_cpu_time_us":9747,"raft.run_wall_time_us":142052,"replication_time_us":774253,"spinlock_wait_cycles":31616,"thread_start_us":491062,"threads_started":4,"wal-append.queue_time_us":176573,"wal-append.run_cpu_time_us":38820,"wal-append.run_wall_time_us":1916961}]]}
I20260709 12:22:48.728621 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:48.661959   830 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:22:48.662084   865 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:22:48.731276   424 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:22:48.733718   961 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.739766 30899 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:48.751183 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:48.752504   958 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:48.753072   958 raft_consensus.cc:697] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:48.754160   958 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.755380   714 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.755967   714 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.756711   975 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.758924 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.759693 30783 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:48.760670 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:48.761225 30783 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:22:48.757422   975 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.764036 30678 catalog_manager.cc:5697] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 5, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.765637   975 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.767145   727 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:48.747408   799 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:48.769785   937 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:48.747314   424 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:22:48.772030   865 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:48.800979 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:48.783844   714 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:48.816428 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 65506.4us
I20260709 12:22:48.789996   835 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:48.831352 30783 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:22:48.806591   961 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:48.838301 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.761530   983 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:22:48.809859   865 raft_consensus.cc:697] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:48.803176 31503 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:48.817269 30678 catalog_manager.cc:5697] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 3, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:48.847028 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 148803us
I20260709 12:22:48.846524 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.852500 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.850374 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.855557 30779 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:48.856873 30783 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:48.863857 30785 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:48.869094 30933 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:22:48.871954 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.874735   865 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.880455 30858 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:48.846354   954 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.882360 30678 catalog_manager.cc:5697] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 3 to 5, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.884760 30933 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:48.889725 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 45290.5us
I20260709 12:22:48.893070 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:48.893510 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.894831   424 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.895020 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:48.895454   424 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.871994   927 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.908308 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.897734   424 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:48.898063   959 consensus_queue.cc:1059] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:22:48.910463   959 raft_consensus.cc:3055] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:48.910938   959 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:48.899081 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:48.898180 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:48.913915   895 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:48.914525 31503 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:48.915386 30928 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:48.916706   895 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:48.853021   835 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.917451 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:48.904938 30934 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:48.912314 30782 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:22:48.919142 30782 pending_rounds.cc:85] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 5
I20260709 12:22:48.908213 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.906780   912 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:48.924588 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.925411 30929 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:48.919440 30782 pending_rounds.cc:107] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:22:48.927209 30782 raft_consensus.cc:2889] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:48.925163   912 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.928485 30934 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:22:48.906445   927 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.926568 30935 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:48.887472 30678 catalog_manager.cc:5697] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.929934   912 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:48.940145 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:48.940495   997 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.943046 30926 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:48.941115   996 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.945384 30931 raft_consensus.cc:1275] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:48.946517 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:48.952384 30934 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:48.955839 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:48.956612 30931 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:22:48.912273   959 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:48.968127 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:48.969259 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.944396   895 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:22:48.975325 30678 catalog_manager.cc:5697] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:48.966872 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:48.990676 30931 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:48.971814   912 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:48.991619 30678 catalog_manager.cc:5697] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 4, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 4 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.977070   368 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:48.954640   997 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:48.970587   865 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:48.958895   996 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:49.088960 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.005896 30932 raft_consensus.cc:2410] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:22:49.083119 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 257402us
I20260709 12:22:49.028180 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:49.096360 30931 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:49.097569 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:48.987857   998 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.101102 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.101737 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 223484us
I20260709 12:22:49.102913 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:49.104974 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:48.999571 31503 raft_consensus.cc:2368] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:22:48.999845 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:49.107015 31476 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:49.101195   368 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:49.126471  1004 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.132485 30927 raft_consensus.cc:2368] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:22:49.054433   835 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:49.137418 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.123420 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:49.132616 30928 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 12:22:49.144933 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 45672.5us
W20260709 12:22:49.144835 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.044325 30678 catalog_manager.cc:5697] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:49.152073   995 log.cc:927] Time spent T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:22:49.141255 30851 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:49.154332   927 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:49.154728  1001 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:22:49.155443   927 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:49.156198   927 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.156597   895 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.157464   895 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.160427   895 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:49.140856   913 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.161499   913 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.161999   913 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.145032  1004 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.164875  1004 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.167289   996 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.144793   865 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.170583   368 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:49.171903   865 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:49.172272   997 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.173189 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:49.173080 30678 catalog_manager.cc:5697] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 4 to 5, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:49.174320 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 90725.6us
I20260709 12:22:49.175184 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.175033 30678 catalog_manager.cc:5697] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 3, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 3 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:49.176522 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.176596   822 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.176712 30678 catalog_manager.cc:5697] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:49.178944   727 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:49.180418   727 consensus_queue.cc:1059] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:49.184985   822 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:49.185946   997 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:49.186655   997 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:49.143579   825 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:49.192888   825 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:49.193846   825 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:49.194437   983 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:49.195178   983 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:49.196377   983 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.124526   958 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:49.197650   958 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.198158   958 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.148265 30928 pending_rounds.cc:85] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 3
I20260709 12:22:49.199548 30928 pending_rounds.cc:107] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:22:49.199836 30928 raft_consensus.cc:2889] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:49.201175   906 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.201311   985 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.514s	user 0.003s	sys 0.004s
I20260709 12:22:49.117049   998 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:49.217192 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 273601us
I20260709 12:22:49.223348 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.165594  1004 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.237792   975 consensus_queue.cc:1059] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:22:49.240188 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:49.240921 31508 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:49.240841   868 consensus_queue.cc:1059] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:49.187668   997 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.242043   868 raft_consensus.cc:3055] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:49.242425   868 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:49.243201   868 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.244405   868 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.244625   906 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.237978   996 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:49.247380 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:49.249994 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:49.252147 30851 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:49.251471 30856 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:49.260787 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:49.238188   912 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:49.270129 30857 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:49.236980  1004 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.258947   822 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:22:49.294852 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.297122 30856 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:49.250108   961 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:22:49.263583   996 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:49.298247 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:49.301937 30855 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:49.311511 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1384) took 1028 ms. Trace:
I20260709 12:22:49.291791 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:22:49.385071 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 136176us
W20260709 12:22:49.426388 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 185184us
I20260709 12:22:49.305896   895 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.422482   994 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:49.502761   994 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:49.504169   994 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.506228   961 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.506561  1010 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:22:49.506940   961 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.484412   913 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:49.478950   895 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.378705 30776 rpcz_store.cc:276] 0709 12:22:48.275438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.279261 (+  3823us) service_pool.cc:224] Handling call
0709 12:22:48.299207 (+ 19946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:48.335592 (+ 36385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:48.335626 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:48.350026 (+ 14400us) log.cc:844] Serialized 26 byte log entry
0709 12:22:48.555628 (+205602us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:48.555674 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:48.555766 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.200396 (+644630us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:49.293859 (+ 93463us) raft_consensus.cc:1685] finished
0709 12:22:49.293896 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:49.303508 (+  9612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":812,"raft.queue_time_us":7542,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":54392064,"thread_start_us":150837,"threads_started":1,"wal-append.queue_time_us":250745}
I20260709 12:22:49.548607   821 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.552117 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 289978us
I20260709 12:22:49.553730 30856 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:22:49.554312 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.554456 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 284655us
I20260709 12:22:49.478679   933 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.509649   961 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:49.570183 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 179439us
I20260709 12:22:49.572901 30856 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:22:49.575456 30858 raft_consensus.cc:1275] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:49.580689 30851 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:49.549588   913 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:49.556216   927 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.556455  1004 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.603595 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:49.549438   821 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:49.610662 30926 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:22:49.616184 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.582450 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:49.478434   912 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:49.638252 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:49.611348 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 366222us
I20260709 12:22:49.640969 30857 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:49.668280 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.570772   933 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:49.670632 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 91894.5us
I20260709 12:22:49.600841   822 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 12:22:49.691550 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 116921us
W20260709 12:22:49.695756 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 93520us
I20260709 12:22:49.601320   997 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:22:49.640036   906 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.702636 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:49.678352   959 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.709221 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:49.639770  1009 consensus_queue.cc:1059] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 12:22:49.696412   724 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.600842   996 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.695345   895 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:49.707195  1005 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.698580   727 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:49.703822  1007 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:49.707871   827 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:49.715939 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:49.704346   998 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:49.754035 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 54298.3us
I20260709 12:22:49.724090   906 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:49.758837   871 raft_consensus.cc:3055] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:49.751519   724 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.759078  1029 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:22:49.760301 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:49.761354   724 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:49.764179 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 161633us
I20260709 12:22:49.765062 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:49.766073  1006 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.373s	user 0.001s	sys 0.000s
I20260709 12:22:49.766278   727 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.767695  1017 log.cc:927] Time spent T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:22:49.767976  1008 log.cc:927] Time spent T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.341s	user 0.001s	sys 0.001s
I20260709 12:22:49.767031   727 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.759366   871 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:49.773445 30825 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:49.734254   827 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:49.765604   868 consensus_meta.cc:287] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.004s
W20260709 12:22:49.773336 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 95024.3us
I20260709 12:22:49.769687  1004 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:49.766067   961 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.801780 30825 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:49.802718 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:49.772842  1007 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:49.773502   906 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:49.788640   827 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.735167  1005 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:49.808701 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 43755.8us
I20260709 12:22:49.799957  1004 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.799311   927 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.819084   954 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:49.820966   821 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.825577 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:49.825938   895 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.844179 30851 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:49.844530 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:49.826287   868 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:49.828935 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:49.829834 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:49.830386 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:49.835568 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.837406 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:49.903658 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 67895.7us
I20260709 12:22:49.833362 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:49.809159   724 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:22:49.834059   933 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.840759  1007 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.841488   727 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.842499  1032 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:49.811120 31508 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:49.842324   871 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:49.847754 30855 consensus_meta.cc:287] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.002s
I20260709 12:22:49.882709 30783 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 12:22:49.885367 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 71732.9us
W20260709 12:22:49.903851 30900 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.785s (SENT)
I20260709 12:22:49.910948 30855 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:49.837543 30857 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:49.805914   961 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.905454 30934 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:49.812197  1031 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:49.910022 30780 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:49.835217  1004 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:49.917168 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:49.918288 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:49.919231 30778 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:49.920867 30750 leader_election.cc:400] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:22:49.921228 30750 leader_election.cc:403] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:49.910979 30783 pending_rounds.cc:85] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 5
W20260709 12:22:49.925171 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 123503us
I20260709 12:22:49.851796 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:49.930900 30926 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 3. Current term is 4. Ops: []
I20260709 12:22:49.929965 30783 pending_rounds.cc:107] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:22:49.935845 30783 raft_consensus.cc:2889] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:49.904129   959 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:49.932776 30825 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:49.937045 30930 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:49.875558  1005 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:49.937368 30785 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:49.939949  1038 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.892737   822 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:49.904078  1023 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:22:49.925161   821 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.930541  1027 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.937862   724 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.851989   868 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:49.951107 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 47301.1us
I20260709 12:22:49.937668   727 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:22:49.950603 30899 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:49.938897   871 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:49.880123   895 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.964149   895 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:49.938463   959 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:49.965059   958 consensus_meta.cc:287] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.001s
W20260709 12:22:49.953429 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 142574us
I20260709 12:22:49.954764   821 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:49.890724   906 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.942381  1032 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.964996   959 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:49.971467   821 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.974138 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.974861   961 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:49.976807 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:49.977864   997 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:49.978032  1032 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:49.978657   997 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:49.951387  1005 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:49.980091 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.981112   983 raft_consensus.cc:2764] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:49.949394  1038 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.957283 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:49.948868   927 raft_consensus.cc:2764] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:22:49.951205   822 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.986825 30899 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:49.984738 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:49.991191 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:50.001014 30825 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:49.995239 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:50.002490 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:50.010659 30777 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:50.016081 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:49.994606   961 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.022724 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:49.994500  1032 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:49.993484  1005 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:49.995244   895 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.028580 30930 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:50.030741 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.030913  1036 consensus_queue.cc:1048] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:22:50.015359   998 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.023557 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:49.956641   724 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:49.965695   958 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:49.955570  1027 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.027482   821 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:22:50.018141   997 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:50.019665   933 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:22:50.037740 30900 leader_election.cc:336] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.051s (SENT)
I20260709 12:22:50.048576 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:50.024102 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:50.028630   895 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.027323   961 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.030455  1005 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.027613  1032 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.047675 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.057989 30858 raft_consensus.cc:2393] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:50.018254  1007 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.000270   827 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.027346   727 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:22:50.053804 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.054557 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.055807  1026 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:22:50.039333   714 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:50.060078 30857 raft_consensus.cc:2410] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:50.062712 30856 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.052176   895 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.068183 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.058760  1005 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.052176  1036 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:50.054993   961 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.060787  1032 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:50.078646 30935 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:50.079264   958 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.077222  1036 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:50.080797  1027 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.082505 30930 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:50.066865   714 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.083799   724 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.086064   868 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.086328 30934 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:50.087598  1039 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.088707   961 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.090237 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:50.073860  1007 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.090505 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:50.065840   816 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:50.098871 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 65429.5us
I20260709 12:22:50.091312 31503 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:50.100775 30927 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:50.101455 30851 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
W20260709 12:22:50.100795 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 92440.5us
I20260709 12:22:50.103404 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.106078 30853 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:22:50.107275  1022 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260709 12:22:50.107666   827 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:50.096822  1036 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:50.104975   961 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.108646   822 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.105206 30928 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:50.119095 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1561) took 1151 ms. Trace:
I20260709 12:22:50.127177 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.128086 30853 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:50.130678 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.103967  1013 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:50.099638   714 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.134059  1013 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:50.134975  1013 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:50.136263  1013 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.101814  1007 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:50.143118  1047 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:22:50.119913 30929 rpcz_store.cc:276] 0709 12:22:48.958868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:48.968494 (+  9626us) service_pool.cc:224] Handling call
0709 12:22:48.973490 (+  4996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:49.267155 (+293665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:49.267187 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:49.288060 (+ 20873us) log.cc:844] Serialized 26 byte log entry
0709 12:22:49.604078 (+316018us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:49.604135 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:49.604231 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:49.670848 (+ 66617us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b480018c258. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:22:50.106469 (+435621us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:50.109686 (+  3217us) raft_consensus.cc:1685] finished
0709 12:22:50.109720 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:50.109899 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97764,"raft.queue_time_us":107843,"raft.run_cpu_time_us":28109,"raft.run_wall_time_us":560440,"spinlock_wait_cycles":77405824,"thread_start_us":379764,"threads_started":2,"wal-append.queue_time_us":421126}
I20260709 12:22:50.149299 30856 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:50.148712  1009 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.152513 30851 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:50.153640 30852 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:22:50.153735 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.154542 30860 raft_consensus.cc:2376] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
W20260709 12:22:50.154413 30668 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1bb0331e5b641b99a413ba3e4475499 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:50.155269 30853 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:50.152232  1009 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:50.157191 30900 leader_election.cc:336] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.779s (SENT)
I20260709 12:22:50.119081   997 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.133459   959 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.172080 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.173034 30779 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:50.171864 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.176227 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.180940 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.183275 30855 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:50.101557  1039 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.169322   822 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:50.187420 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.168821   961 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.188097 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:50.188936 30900 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.016s (SENT)
I20260709 12:22:50.190145 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.145237  1004 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.187079 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:22:50.195433 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.201478 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:50.203729 30785 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:50.187863  1038 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.226190 30858 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:50.201089  1046 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.228313 30779 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:50.218458 31508 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.239220  1009 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.205895   822 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.214016  1007 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.242421   822 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.202538   961 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.244844   961 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.246528 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.246784   959 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:50.247997 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.249164 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.228277   954 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:22:50.254432  1046 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.265012  1046 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:50.271062 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:50.289963 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 239973us
I20260709 12:22:50.311604 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:50.314877 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 125980us
I20260709 12:22:50.249387  1036 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.287456 31508 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:50.343106 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.303561   959 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:50.313372   822 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:50.348816 30750 leader_election.cc:400] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:22:50.344918   906 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:22:50.355552  1004 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:50.343501   996 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.013s	sys 0.011s
W20260709 12:22:50.356602   996 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.013s	sys 0.011s
I20260709 12:22:50.359499  1036 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.360105 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.381369 30852 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:50.362401 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.363708 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.364691 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.365031   714 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.365797   998 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:50.365978   822 raft_consensus.cc:697] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:50.366649 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:50.367389 31477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:50.389146 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:50.389832 30783 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.368161  1005 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:50.376318 30900 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.035s (SENT)
I20260709 12:22:50.382558 30856 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:50.392901 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.393662 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:50.395167 30860 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 4: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:50.408802 30782 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:22:50.410524 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:50.410799 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.411360 30928 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:50.402576  1046 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.411779 30854 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:22:50.402287   954 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.412181  1046 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.412773   954 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.414032 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.414361  1046 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.414911   954 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.414855 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:50.429795   827 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:50.429967 30778 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.414448   895 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.432801   895 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.410449 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.434127 30857 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:50.435158 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.435915 30857 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:50.436707 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.437278 30857 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 4.
I20260709 12:22:50.415778 30825 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:50.416334 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:50.416635 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.438592 30860 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.419479  1018 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:22:50.420288 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 44326.5us
I20260709 12:22:50.420771  1057 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:50.421339   799 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:50.411302 30852 raft_consensus.cc:2376] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5. Re-sending same reply.
I20260709 12:22:50.422297 30851 raft_consensus.cc:2410] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:50.423183 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.423611 31477 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:50.411520 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.451697 30855 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:50.428078 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.448271 30783 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:50.444691 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:50.453518 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.349206   961 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:22:50.455138 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.388123  1027 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:22:50.461408 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.388073   959 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.455806 30855 raft_consensus.cc:2376] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6. Re-sending same reply.
I20260709 12:22:50.463630 30778 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:50.480657 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.483920  1065 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:50.484030 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.484704  1065 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.485076 30855 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:50.486433 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.497053 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.498799 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.499594 30859 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:50.500695 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.456537  1004 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:22:50.472487   825 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.502749 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.506736 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.512775 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.531183 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.455495   996 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.461050   821 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:50.524148 30852 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:50.534994 30782 raft_consensus.cc:2410] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:50.539096 30855 raft_consensus.cc:2393] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:50.542745 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.544063 30857 raft_consensus.cc:2410] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:50.548668 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:50.458829   912 consensus_queue.cc:1059] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:22:50.560463 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:50.546286 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.201s (SENT) [suppressed 14 similar messages]
I20260709 12:22:50.568219 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:50.540112  1061 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 12:22:50.579836 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:50.581049 30776 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:50.556116 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.575287 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.536639   996 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.585192 30860 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:50.455622  1052 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:50.532565  1039 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.536335   825 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.474979  1057 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.621708 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.622473 30785 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:50.622603   825 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.623905 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:50.656756 30783 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:22:50.655644 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:50.658303 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:50.658684 30934 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:22:50.659621 30783 pending_rounds.cc:85] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:22:50.624902 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:50.660181 30783 pending_rounds.cc:107] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:22:50.662262 30783 raft_consensus.cc:2889] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:50.662477 30782 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:50.584275   996 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:50.666191 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 194829us
I20260709 12:22:50.668784 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:50.667042 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:50.679989  1040 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.680743  1040 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.680111   825 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:50.650126  1057 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:50.549579   822 consensus_queue.cc:237] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.700994 30852 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:22:50.638881   724 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.625481  1052 raft_consensus.cc:697] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:50.612357   961 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:22:50.646277  1016 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:22:50.689713  1005 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.713275 30855 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:50.708801   714 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.711097   821 raft_consensus.cc:697] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:50.712344   825 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
W20260709 12:22:50.742359 30900 leader_election.cc:336] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.989s (SENT)
I20260709 12:22:50.742856 30900 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:50.743992 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:50.744650 30934 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:50.712603  1072 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:50.758872 30853 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:22:50.767256  1066 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:22:50.769246  1078 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:22:50.742059   727 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:50.774574   821 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.775518 30781 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:50.740376  1068 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:50.745848   959 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:50.713554   724 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.751088  1072 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.770830  1005 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:22:50.788349  1032 consensus_meta.cc:287] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.000s
I20260709 12:22:50.803498 30934 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:50.795089  1072 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:50.809229  1051 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:50.786353   994 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:50.820223 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 90470.6us
I20260709 12:22:50.791152  1009 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:50.819635 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 119288us
I20260709 12:22:50.831542 30934 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:50.840220 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:50.841225 30933 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:50.843492 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:50.844359 30926 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:50.846964 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:50.821151   994 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.848742  1054 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:22:50.850369   994 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:50.851750   727 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:50.852458   727 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:50.806808  1032 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.792788  1068 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.970237  1088 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.975857  1088 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:50.977602   724 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:50.972512  1007 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:50.979418  1026 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:50.796226  1052 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.847002 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:51.009752 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.010658 30932 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:51.011015 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:50.891505 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.014513 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:50.886059 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 96045.8us
I20260709 12:22:51.013546 30934 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:51.032366 30781 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:50.843375  1005 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.036381 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.037777 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.039054 30856 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:51.039392 30934 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:51.040748 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:51.039319 30932 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.041836 30776 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:50.837646   825 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:51.018301  1085 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:22:51.051461  1085 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.051826 30932 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:50.838378  1009 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:50.901747 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:51.036267   906 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:51.018604   959 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:22:51.023522  1082 consensus_queue.cc:1048] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:22:51.071485   906 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:51.080888   906 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.056267  1005 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.073215  1085 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 12:22:51.126384 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 52913.6us
I20260709 12:22:51.133232  1082 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:51.134850  1088 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.186540 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:51.199568  1076 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 12:22:51.203034 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.203712  1068 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.204584 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.207880 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.216760 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.217460 30931 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:51.214594  1095 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:22:51.224882 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.226284 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.226963 30855 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:51.227886 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.228986 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.231014 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:51.231869 30860 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:51.239986 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.240799 30859 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:51.178406   994 consensus_queue.cc:1059] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:22:51.252813  1072 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.257807  1072 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.251444  1013 raft_consensus.cc:3055] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:51.258433  1005 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:51.258724  1013 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:51.249544 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.260916 30931 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:51.263525 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1358) took 1088 ms. Trace:
I20260709 12:22:51.263950 30780 rpcz_store.cc:276] 0709 12:22:50.174952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.175194 (+   242us) service_pool.cc:224] Handling call
0709 12:22:50.175692 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.176082 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:22:50.180187 (+  4105us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.681683 (+501496us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b1800063940. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf23a 00007f9610a29a2a
0709 12:22:50.738841 (+ 57158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.739333 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.739472 (+   139us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:50.739504 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.739570 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.259284 (+519714us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b1800063940. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:51.263305 (+  4021us) raft_consensus.cc:1685] finished
0709 12:22:51.263330 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.263460 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33208,"prepare.queue_time_us":633,"raft.queue_time_us":64862,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":19945,"spinlock_wait_cycles":33406208,"thread_start_us":46547,"threads_started":2,"wal-append.queue_time_us":612370}
I20260709 12:22:51.264937  1032 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.261972  1009 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:51.305588 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.307492 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.308284 30931 raft_consensus.cc:2368] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7.
I20260709 12:22:51.313972 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:51.322408 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 194630us
I20260709 12:22:51.319640 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.327220 30860 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:51.320101  1038 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.320492  1047 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.052s	user 0.004s	sys 0.000s
I20260709 12:22:51.259928  1013 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.330065 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:51.319252   727 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.333364 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.334331 30860 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
W20260709 12:22:51.322650   961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.030s
I20260709 12:22:51.337687 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:51.334967  1085 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:51.342564  1085 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.345067  1085 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:51.347543 30900 leader_election.cc:336] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.505s (SENT)
I20260709 12:22:51.347710 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1345) took 1108 ms. Trace:
I20260709 12:22:51.348225 30851 rpcz_store.cc:276] 0709 12:22:50.239644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.248939 (+  9295us) service_pool.cc:224] Handling call
0709 12:22:51.347471 (+1098532us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540015c054. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:51.347640 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390286080}
I20260709 12:22:51.331740  1072 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.336372   961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.005s	sys 0.030s
I20260709 12:22:51.351244 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 312) took 1094 ms. Trace:
I20260709 12:22:51.349653 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.373515 30851 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:22:51.372289 30900 leader_election.cc:336] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.509s (SENT)
I20260709 12:22:51.374737 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.338474  1027 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:22:51.391674 30900 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.512s (SENT)
I20260709 12:22:51.392309 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.393962 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:51.395521 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.393914   724 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:51.396299 30851 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:51.389671  1005 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.397137  1040 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:51.398307 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 313) took 1140 ms. Trace:
I20260709 12:22:51.398622 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1326) took 1164 ms. Trace:
I20260709 12:22:51.398767 30851 rpcz_store.cc:276] 0709 12:22:50.257993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.397248 (+1139255us) service_pool.cc:224] Handling call
0709 12:22:51.397743 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.397960 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.397984 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.398022 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:51.398057 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.398110 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.398234 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:51.401144  1036 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.401335 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 314) took 1143 ms. Trace:
I20260709 12:22:51.403151 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.403053  1036 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.404035 30935 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:51.403465 30851 rpcz_store.cc:276] 0709 12:22:50.258305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.400507 (+1142202us) service_pool.cc:224] Handling call
0709 12:22:51.400820 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.400996 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.401019 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.401059 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:51.401090 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.401141 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.401244 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:51.382226 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:51.406208 30859 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:51.407793 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 316) took 1016 ms. Trace:
I20260709 12:22:51.382850 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.408345 30853 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:51.408692 30932 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.409636 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.410277 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1352) took 1168 ms. Trace:
I20260709 12:22:51.411048 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.373564  1072 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.415555  1072 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.408113 30859 rpcz_store.cc:276] 0709 12:22:50.391870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.406908 (+1015038us) service_pool.cc:224] Handling call
0709 12:22:51.407242 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.407450 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.407479 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.407525 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:51.407565 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.407620 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.407731 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:51.334750  1038 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.372906  1013 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.404644 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:51.386588  1099 log.cc:927] Time spent T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:22:51.405110 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.401654 30857 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:22:51.406133 30858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1317) took 1339 ms (client timeout 1505 ms). Trace:
I20260709 12:22:51.399060 30856 rpcz_store.cc:276] 0709 12:22:50.234624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.392661 (+158037us) service_pool.cc:224] Handling call
0709 12:22:51.398416 (+1005755us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b5400076054. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:51.398565 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1483985664}
I20260709 12:22:51.417852 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 317) took 1021 ms. Trace:
I20260709 12:22:51.428743 30859 rpcz_store.cc:276] 0709 12:22:50.396185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.416939 (+1020754us) service_pool.cc:224] Handling call
0709 12:22:51.417280 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.417473 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.417501 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.417542 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:51.417578 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.417630 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.417752 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:51.410696 30853 rpcz_store.cc:276] 0709 12:22:50.241555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.759829 (+518274us) service_pool.cc:224] Handling call
0709 12:22:51.408016 (+648187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.408709 (+   693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.410073 (+  1364us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b5400437bd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:51.410210 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459323648}
I20260709 12:22:51.391062   727 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.412393 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:51.428494 30858 rpcz_store.cc:269] 0709 12:22:50.067130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.067919 (+   789us) service_pool.cc:224] Handling call
0709 12:22:51.405932 (+1338013us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400437bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:51.406073 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350065536}
I20260709 12:22:51.372807 30860 rpcz_store.cc:276] 0709 12:22:50.257359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.349888 (+1092529us) service_pool.cc:224] Handling call
0709 12:22:51.350381 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.350659 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.350704 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:51.350778 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:51.350841 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.350946 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.351110 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:51.385715  1027 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:51.432724 30932 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:22:51.437489 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:51.385931   996 consensus_meta.cc:287] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.003s
I20260709 12:22:51.441221 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.442129 30932 raft_consensus.cc:2410] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:51.443106 30900 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:51.443907 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:51.445351 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.446632 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.447188 30932 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.449719 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:51.452214 30859 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.454767 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.458387 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:51.460342 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.435582  1027 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:51.505102 30935 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:51.505384 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.479683 30932 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:51.507968 31508 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:51.449954  1040 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:51.508518 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:51.456688   827 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:51.509181 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.514019 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.514377 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.514799 30935 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.511910 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.514132 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.515789 30932 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:51.450384   724 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.513659 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:51.521209 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:51.523068 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:51.456459  1005 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.526438 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:51.526439 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.528054 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.467589  1052 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:51.445020   996 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.531106 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:51.507550  1036 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.523567 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.513614   827 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:51.519963   868 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.529560  1072 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.529352  1009 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.537891 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:51.538967   996 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.539935 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.540681 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.513502   727 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:22:51.543018 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:51.543370 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 83581.6us
I20260709 12:22:51.545368 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.521927  1032 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.519977   724 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:51.542542 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.550107 30927 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:51.555887 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.532121  1052 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:51.544888   912 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.558802 30928 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:51.547199   994 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.547433   827 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:51.560281 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.545333  1004 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:51.547904  1072 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.557689 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.547658   868 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.564508 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.561853  1052 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:51.549082   961 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.565598  1107 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:51.565044 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.565533 30926 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:51.559639   724 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.572520 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:51.571395 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 318) took 1155 ms. Trace:
I20260709 12:22:51.558940  1032 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.571681 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.559767  1007 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.561854  1036 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:51.578428 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.573136 30851 rpcz_store.cc:276] 0709 12:22:50.415733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.422033 (+1006300us) service_pool.cc:224] Handling call
0709 12:22:51.435973 (+ 13940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.449539 (+ 13566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.449597 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.450324 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.533188 (+ 82864us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:51.533251 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.534306 (+  1055us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.570463 (+ 36157us) raft_consensus.cc:1685] finished
0709 12:22:51.570483 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.571333 (+   850us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8453,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10237,"thread_start_us":66789,"threads_started":1,"wal-append.queue_time_us":89563}
I20260709 12:22:51.579937 30750 leader_election.cc:400] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7.
I20260709 12:22:51.580220 30750 leader_election.cc:403] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:22:51.568125   996 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.568257   868 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.568672  1072 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.587720 30926 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:51.569494   961 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.569480   799 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:51.592008 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:51.569696  1107 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:51.594511 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.596293 30930 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:51.574316  1032 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.572584  1040 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:51.598382 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.578527  1036 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:51.586153  1085 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.589187  1088 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:51.606076  1076 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:51.597023   996 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.597419  1107 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.594004   961 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.597506  1109 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7.
I20260709 12:22:51.606907   799 raft_consensus.cc:697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:51.615273  1038 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:51.623972  1117 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:51.618291  1036 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:51.633354  1112 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:22:51.633625   996 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:51.620039  1088 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.618113  1085 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:51.640440 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.627046  1120 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:51.642865 30785 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:51.662016 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:51.662919 30851 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:51.666196   799 consensus_queue.cc:237] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:51.678443  1114 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:22:51.642059  1038 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:51.679713  1038 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:51.642437  1103 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:51.682272  1103 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:51.682698  1103 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.686564  1120 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:51.688139  1120 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:51.689872  1109 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:51.690459  1109 raft_consensus.cc:697] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:51.691370  1109 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:51.694175 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 53811.8us
I20260709 12:22:51.695921 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.701404 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:51.739012 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:51.742410 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.746260 30935 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:22:51.645361  1088 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.646663  1085 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:51.643939  1076 raft_consensus.cc:697] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:51.752928 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:51.753625 30851 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:22:51.754447 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:51.748556   933 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:51.768810 30930 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:22:51.750864   906 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:51.763047  1110 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 12:22:51.772404 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 128939us
I20260709 12:22:51.935586 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:51.770759   933 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.769673  1029 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:51.949734 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:51.955969 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:51.756728  1107 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.773808   906 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.032711  1123 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:52.033466  1123 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:52.033984  1123 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:52.048888 30930 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:51.965440   933 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:52.083621 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 317153us
I20260709 12:22:51.962514  1029 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.789251   868 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:51.757648  1040 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.042670   906 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:51.963487   998 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:52.089033  1013 consensus_meta.cc:287] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.004s
I20260709 12:22:52.118064 30930 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:22:52.044598  1009 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:51.960391  1121 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:52.088795   799 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.070586  1038 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:22:52.127609  1121 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.140362 30931 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:22:52.143900 30927 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:22:52.158362  1121 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:52.142161   799 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:22:52.159714  1027 consensus_meta.cc:287] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.003s
I20260709 12:22:52.115334  1029 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:52.091383   912 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.186770 30931 raft_consensus.cc:1275] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:52.202709 30930 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 12:22:52.153327  1072 consensus_meta.cc:287] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.555s	user 0.001s	sys 0.006s
I20260709 12:22:52.212994 30927 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:52.130501  1004 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.244575  1123 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.247309  1123 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:52.248382  1123 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:52.244591   724 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.662s	user 0.002s	sys 0.005s
I20260709 12:22:52.249151   724 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.251343   724 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:52.252243  1123 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:52.254993  1131 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.255302  1123 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:52.255589  1131 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.125145   998 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:52.273011 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.016s	sys 0.024s
W20260709 12:22:52.273409 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.016s	sys 0.024s
I20260709 12:22:52.211666  1127 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:52.161283  1009 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.206696  1027 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:52.259104  1128 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:52.117654  1076 consensus_queue.cc:237] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.231937  1072 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.259572  1004 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:52.307055 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:52.279898 30781 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:22:52.375492  1004 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:52.326236  1052 consensus_meta.cc:287] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.002s
I20260709 12:22:52.298913 30927 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:52.376477  1052 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:52.377430 30927 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:52.278904 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:52.321843 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:52.280571 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:52.212190   912 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:52.635555 31477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.029s	sys 0.048s
I20260709 12:22:52.470868 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:53.141069 31477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.039s	sys 0.070s
W20260709 12:22:52.366510 30926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.005s	sys 0.005s
W20260709 12:22:53.075315 30930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.004s	sys 0.008s
W20260709 12:22:53.141886 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 1.05486e+06us
I20260709 12:22:52.380026 30783 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:53.142158 30926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.383s	user 0.024s	sys 0.048s
I20260709 12:22:52.567926 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:52.639348 30935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.004s	sys 0.031s
W20260709 12:22:53.142457 30930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.004s	sys 0.008s
W20260709 12:22:53.149806 30935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.387s	user 0.009s	sys 0.057s
I20260709 12:22:52.566131 30899 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:52.275847 30856 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.035s	sys 0.079s
I20260709 12:22:52.471447 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1365) took 2215 ms. Trace:
W20260709 12:22:52.530258 30929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.000s	sys 0.022s
I20260709 12:22:52.468267 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1599) took 1015 ms. Trace:
I20260709 12:22:52.375734 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:53.155866 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 589851us
W20260709 12:22:53.152318 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.006s	sys 0.005s
W20260709 12:22:53.200539 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.006s	sys 0.007s
I20260709 12:22:52.281520 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.151214 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1592) took 1766 ms. Trace:
I20260709 12:22:53.202329 30783 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
W20260709 12:22:53.202634 30929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.456s	user 0.008s	sys 0.065s
W20260709 12:22:52.283342  1109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.006s	sys 0.035s
W20260709 12:22:52.629402  1080 log.cc:927] Time spent T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.779s	user 0.011s	sys 0.003s
I20260709 12:22:52.905507 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 335) took 1272 ms. Trace:
I20260709 12:22:53.153344 30779 rpcz_store.cc:276] 0709 12:22:50.256471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.256598 (+   127us) service_pool.cc:224] Handling call
0709 12:22:50.680550 (+423952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:50.680735 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.680765 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:50.680815 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:50.680854 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.680912 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.471229 (+1790317us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54001d9550. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:52.471373 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974000896}
I20260709 12:22:53.201864 30931 rpcz_store.cc:276] 0709 12:22:51.453014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.204979 (+751965us) service_pool.cc:224] Handling call
0709 12:22:52.205360 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:52.205615 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:52.238171 (+ 32556us) log.cc:844] Serialized 14 byte log entry
0709 12:22:52.467886 (+229715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:52.467950 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:52.468004 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.468073 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:52.468192 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31980,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":98,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8589,"thread_start_us":229252,"threads_started":1}
I20260709 12:22:52.494653  1070 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:52.496686  1036 consensus_meta.cc:287] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.853s	user 0.007s	sys 0.006s
W20260709 12:22:52.460681  1088 consensus_meta.cc:287] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.004s
I20260709 12:22:53.201588  1150 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:22:52.470033   961 consensus_meta.cc:287] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.832s	user 0.008s	sys 0.004s
W20260709 12:22:52.348754  1032 consensus_meta.cc:287] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.000s
I20260709 12:22:53.203482 30935 rpcz_store.cc:276] 0709 12:22:51.385035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.747682 (+362647us) service_pool.cc:224] Handling call
0709 12:22:51.747931 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.748102 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:51.762419 (+ 14317us) log.cc:844] Serialized 14 byte log entry
0709 12:22:53.150840 (+1388421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.150895 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:53.150946 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.151013 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.151144 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15492,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":675,"raft.queue_time_us":98,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":1387613,"threads_started":1}
W20260709 12:22:52.334298   827 consensus_meta.cc:287] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.754s	user 0.006s	sys 0.005s
I20260709 12:22:52.366979   799 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:53.215386 30785 rpcz_store.cc:276] 0709 12:22:51.633286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.633453 (+   167us) service_pool.cc:224] Handling call
0709 12:22:51.633832 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:51.652973 (+ 19141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.905147 (+1252174us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b540028ffd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:52.905414 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20004224}
W20260709 12:22:52.639250  1085 consensus_meta.cc:287] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.867s	user 0.011s	sys 0.007s
I20260709 12:22:52.637076  1052 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:53.134524  1009 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:52.692035  1103 consensus_meta.cc:287] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.009s	user 0.008s	sys 0.006s
W20260709 12:22:52.934686  1121 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.001s
I20260709 12:22:52.697458  1027 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:52.307029  1013 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:53.265951  1076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.055s	sys 0.054s
I20260709 12:22:52.896934  1051 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.488703  1117 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:52.341065  1129 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:52.359476   998 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:52.627717  1136 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:52.345852  1134 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:53.211328  1109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.472s	user 0.034s	sys 0.092s
I20260709 12:22:52.712646  1065 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:52.369181  1107 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.199729  1004 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.259829 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:53.131680 30668 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1bb0331e5b641b99a413ba3e4475499 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:22:52.380319  1131 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.088613  1072 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:52.713831  1094 log.cc:927] Time spent T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.538s	user 0.007s	sys 0.009s
I20260709 12:22:53.014552  1140 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.208645  1095 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.197068  1122 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:53.273108   827 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.273190   961 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.364464   827 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:53.364985   961 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.274521 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.368078 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.368878 30935 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:52.298672  1127 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:52.488500   906 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.252032 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:52.331382  1128 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:52.369956   727 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:53.321653 30856 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.680s	user 0.057s	sys 0.115s
I20260709 12:22:53.322201  1013 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:53.305253  1090 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 2.129s	user 0.014s	sys 0.032s
I20260709 12:22:53.305907  1085 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.388515 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.386543   727 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:53.332373   933 consensus_meta.cc:287] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.224s	user 0.011s	sys 0.001s
I20260709 12:22:53.333972 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 290) took 2939 ms. Trace:
I20260709 12:22:53.275544  1156 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.390367  1131 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:53.341635 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 192342us
I20260709 12:22:53.262934  1036 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.392679 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:53.393743  1036 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.394423  1036 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:53.336301  1076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.058s	sys 0.054s
I20260709 12:22:53.396123 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:53.340763   912 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.398528 30935 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:53.272467  1070 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:53.340406  1152 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:22:53.399886 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.277983  1032 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.271746  1088 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.401302 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1603) took 1661 ms. Trace:
I20260709 12:22:53.401711 30930 rpcz_store.cc:276] 0709 12:22:51.740164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.218111 (+477947us) service_pool.cc:224] Handling call
0709 12:22:52.268046 (+ 49935us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:52.278863 (+ 10817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:52.278893 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:52.279485 (+   592us) log.cc:844] Serialized 52 byte log entry
0709 12:22:53.150064 (+870579us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:53.150116 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.150205 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.401048 (+250843us) raft_consensus.cc:1685] finished
0709 12:22:53.401077 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.401244 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2430,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":101,"thread_start_us":811753,"threads_started":1,"wal-append.queue_time_us":808902}
I20260709 12:22:53.357640 30931 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:53.403133  1088 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:53.346395   959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.003s	sys 0.008s
I20260709 12:22:53.403666 30777 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:53.403893   959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.003s	sys 0.008s
I20260709 12:22:53.404285 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.404970 30930 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.405946 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1436) took 1124 ms. Trace:
I20260709 12:22:53.406383 30777 rpcz_store.cc:276] 0709 12:22:52.281972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.506385 (+224413us) service_pool.cc:224] Handling call
0709 12:22:53.405694 (+899309us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400246654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:53.405878 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583769472}
I20260709 12:22:53.320406  1103 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.409044 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1334) took 3172 ms. Trace:
I20260709 12:22:53.409188  1103 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.353893  1129 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.411533  1129 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.413264  1122 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:53.413995  1122 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.353137  1134 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.416388  1134 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.416913  1134 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.359901  1004 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.371016  1140 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.417454  1134 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.319008  1121 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:53.379518 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:53.420396 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:53.377717  1016 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.356938  1027 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.390980  1131 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.391124   727 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.390136   933 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.459103 30780 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:53.460078   933 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.341938  1051 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.390111 30929 rpcz_store.cc:276] 0709 12:22:50.395008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.408249 (+ 13241us) service_pool.cc:224] Handling call
0709 12:22:50.408562 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.449020 (+ 40458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.449063 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.455122 (+  6059us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.767575 (+312453us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b480018c258. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:22:51.746128 (+978553us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b180028fa20. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf0d1 00007f96109daa0f
0709 12:22:53.204250 (+1458122us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:53.204289 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.204356 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.204399 (+    43us) raft_consensus.cc:1685] finished
0709 12:22:53.204411 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.333876 (+129465us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36672,"raft.queue_time_us":32163,"raft.run_cpu_time_us":3461,"raft.run_wall_time_us":323357,"spinlock_wait_cycles":23699712,"thread_start_us":1457921,"threads_started":1,"wal-append.queue_time_us":2670050}
W20260709 12:22:53.434885  1142 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.389s	user 0.001s	sys 0.001s
I20260709 12:22:53.468322 30930 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:53.470299 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:53.471890 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1526) took 3294 ms. Trace:
W20260709 12:22:53.401145  1144 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.737s	user 0.007s	sys 0.002s
W20260709 12:22:53.366703 30668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 235089us
I20260709 12:22:53.441011 30779 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.386262   998 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.445654  1140 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.445832  1134 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.446203 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.446815 30933 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.447701  1121 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:53.449265  1004 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.382015   821 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.449687  1016 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.509692  1169 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.437041  1005 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.409468 30852 rpcz_store.cc:276] 0709 12:22:50.236750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.702235 (+465485us) service_pool.cc:224] Handling call
0709 12:22:50.713699 (+ 11464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.718494 (+  4795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.718522 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.735909 (+ 17387us) log.cc:844] Serialized 26 byte log entry
0709 12:22:50.816808 (+ 80899us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:50.841902 (+ 25094us) log.cc:844] Serialized 14 byte log entry
0709 12:22:50.842134 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:50.842183 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.632724 (+790541us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b18003c1780. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d932522 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:52.678929 (+1046205us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b18003c1780. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9002a6 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1
0709 12:22:53.403771 (+724842us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b18003c1780. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:53.408775 (+  5004us) raft_consensus.cc:1685] finished
0709 12:22:53.408798 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.408958 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":811,"prepare.queue_time_us":28373,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":1597,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":19348,"spinlock_wait_cycles":89949696,"thread_start_us":46722,"threads_started":1,"wal-append.queue_time_us":84049}
I20260709 12:22:53.457213 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.460580 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.402877  1032 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.471236 30777 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.493700 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.460889   996 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.495209  1120 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.453133   961 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.349309  1136 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.451272  1027 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.386749  1153 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:53.421855 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.492667   912 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:53.569512 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.570204 30935 raft_consensus.cc:1240] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:53.570525 30785 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:53.503239 30857 rpcz_store.cc:276] 0709 12:22:50.177273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.672201 (+494928us) service_pool.cc:224] Handling call
0709 12:22:51.401410 (+729209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.427984 (+ 26574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.471663 (+2043679us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b5400076050. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:53.471826 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600560384}
I20260709 12:22:53.372792  1095 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:53.499444 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 299351us
I20260709 12:22:53.573263 30899 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:53.554409  1102 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.014s	sys 0.006s
I20260709 12:22:53.557577 30929 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.556022 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1608) took 1262 ms. Trace:
I20260709 12:22:53.577615 30930 rpcz_store.cc:276] 0709 12:22:52.293225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.505724 (+1212499us) service_pool.cc:224] Handling call
0709 12:22:53.506162 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.555369 (+ 49207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.555464 (+    95us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:53.555546 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:53.555620 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.555727 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.555936 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1961,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":6347}
I20260709 12:22:53.560156 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.466355  1009 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:53.574549 30899 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:53.348905  1117 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.505437  1159 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:53.575227 30935 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:53.511626  1169 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.390746  1156 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.575233 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1527) took 2536 ms. Trace:
I20260709 12:22:53.581703 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:53.592243  1117 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.592679  1156 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.592834  1117 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:53.593127 30899 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:53.555076  1085 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:53.510370 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 76900.5us
I20260709 12:22:53.594383  1127 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.594655  1070 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.594928  1052 raft_consensus.cc:2764] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:22:53.570564   961 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.596037 30899 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:53.596957  1131 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.597518   961 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.599547 30776 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:22:53.583954 30779 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:53.585933  1065 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:53.582334   827 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:53.587476 30935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49608
I20260709 12:22:53.606622 30935 raft_consensus.cc:606] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:22:53.589697  1169 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.594051  1009 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.575821 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1374) took 2802 ms. Trace:
I20260709 12:22:53.576154 30777 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:53.597824  1127 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:53.604979 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.616760 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1588) took 2234 ms. Trace:
W20260709 12:22:53.580600  1102 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.014s	sys 0.007s
W20260709 12:22:53.605089 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 207942us
I20260709 12:22:53.618867 30783 raft_consensus.cc:1240] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:53.606957 30780 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:53.609911 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.614750 30930 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:53.620986 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:53.611668 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 214317us
I20260709 12:22:53.612299 30784 rpcz_store.cc:276] 0709 12:22:50.772966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.773131 (+   165us) service_pool.cc:224] Handling call
0709 12:22:50.775026 (+  1895us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.802453 (+ 27427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.802484 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.814089 (+ 11605us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.014157 (+200068us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:51.014198 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.014268 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.261324 (+2247056us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:53.565821 (+304497us) raft_consensus.cc:1685] finished
0709 12:22:53.565856 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.575717 (+  9861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19461,"raft.queue_time_us":43081,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":20331,"spinlock_wait_cycles":12807424,"thread_start_us":199681,"threads_started":1,"wal-append.queue_time_us":258036}
I20260709 12:22:53.616643 30779 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 3.
I20260709 12:22:53.563233   998 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.623833 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.631211 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.632115 30851 raft_consensus.cc:2410] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:53.510717   821 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.563794   996 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:53.633647 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.633189  1016 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.638677 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.638813 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.609817  1128 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.639724 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.640399 30859 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:53.641353 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.642133 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.642302 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1587) took 2260 ms. Trace:
I20260709 12:22:53.643311 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.643774 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:53.645088  1161 log.cc:927] Time spent T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:22:53.645823 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.646435 30855 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:53.647161   998 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.647274 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.647957  1157 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:53.648279 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.648514  1157 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.648995  1013 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.650492  1027 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.651345 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.654017   996 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:22:53.654629 30858 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:53.656167 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.616403  1065 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:53.651363 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:53.617185 30926 rpcz_store.cc:276] 0709 12:22:51.383503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.589027 (+205524us) service_pool.cc:224] Handling call
0709 12:22:51.604252 (+ 15225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.643454 (+ 39202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.643485 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.648388 (+  4903us) log.cc:844] Serialized 26 byte log entry
0709 12:22:53.153453 (+1505065us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:53.153512 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.153607 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.400289 (+246682us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:53.611068 (+210779us) raft_consensus.cc:1685] finished
0709 12:22:53.611098 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.616691 (+  5593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17809,"raft.queue_time_us":45371,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6791,"spinlock_wait_cycles":979496832,"thread_start_us":1415175,"threads_started":2,"wal-append.queue_time_us":831593}
I20260709 12:22:53.623756  1156 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.568470  1005 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.642872 30928 rpcz_store.cc:276] 0709 12:22:51.381642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.578924 (+197282us) service_pool.cc:224] Handling call
0709 12:22:51.595571 (+ 16647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:51.789574 (+194003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.789618 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:51.906818 (+117200us) log.cc:844] Serialized 26 byte log entry
0709 12:22:52.309947 (+403129us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:52.310005 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:52.310106 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.418866 (+1108760us) spinlock_profiling.cc:243] Waited 86.4 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:53.634050 (+215184us) raft_consensus.cc:1685] finished
0709 12:22:53.634069 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.642208 (+  8139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44981,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":2459,"spinlock_wait_cycles":198791936,"thread_start_us":410207,"threads_started":2,"wal-append.queue_time_us":632606}
I20260709 12:22:53.667094  1140 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:53.667511  1127 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.667881  1162 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:22:53.668563  1040 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.696185 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.696846 30851 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.669456 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.697702 31476 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:53.670502  1051 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.624953  1169 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.656421 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.702713 30858 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.675494 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.677913 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.701429 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.703862 30853 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:53.678179 30929 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
W20260709 12:22:53.678560 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 48027.9us
I20260709 12:22:53.681267 30859 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.590247 30856 rpcz_store.cc:276] 0709 12:22:51.038801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.436038 (+397237us) service_pool.cc:224] Handling call
0709 12:22:51.436368 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:51.463116 (+ 26748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:51.463141 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:51.506986 (+ 43845us) log.cc:844] Serialized 52 byte log entry
0709 12:22:51.617180 (+110194us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:53.378466 (+1761286us) log.cc:844] Serialized 14 byte log entry
0709 12:22:53.574903 (+196437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.574976 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:53.575016 (+    40us) raft_consensus.cc:1685] finished
0709 12:22:53.575031 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:53.575162 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":728608,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":15584,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":14035,"thread_start_us":2007343,"threads_started":3,"wal-append.queue_time_us":121705,"wal-append.run_cpu_time_us":2135,"wal-append.run_wall_time_us":1002125}
I20260709 12:22:53.643915 30852 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:53.609603  1032 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.581957   912 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.567045  1120 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.715516 31509 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:53.607775  1117 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:22:53.707823 30934 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:53.698825  1127 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.733275 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.734230  1127 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.734638 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.735550 30934 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:53.736034 30851 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:22:53.738061 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.738662  1164 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:53.739149  1164 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.739102 30926 raft_consensus.cc:2410] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:53.739768  1164 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.740988 30926 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:22:53.741488   912 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.742101   912 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.708230   906 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.742581   912 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.720954  1141 consensus_queue.cc:1059] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:53.721342   821 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.721246 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.744012  1141 raft_consensus.cc:3055] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:53.700120  1156 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.744055 30857 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:53.744477  1141 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:53.746049  1156 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.717237  1169 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.746548  1120 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.726651   827 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:53.717103  1040 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.716885  1121 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:53.728210 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.747851 30860 raft_consensus.cc:2376] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6. Re-sending same reply.
I20260709 12:22:53.728621  1032 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.729557  1135 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:53.745568  1029 consensus_meta.cc:287] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 1.528s	user 0.010s	sys 0.002s
I20260709 12:22:53.739069 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:53.747960 30929 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:53.695762  1013 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:53.598773  1153 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.748530 30855 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.729839  1136 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.719053 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.745419  1141 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.782545  1095 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.855535  1169 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.855965 30856 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:53.857131 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.786303 30858 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:53.858471 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.842432 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1607) took 1552 ms. Trace:
W20260709 12:22:53.858901 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 119900us
I20260709 12:22:53.859599 30856 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 4.
I20260709 12:22:53.859827 30933 rpcz_store.cc:276] 0709 12:22:52.289984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.639135 (+349151us) service_pool.cc:224] Handling call
0709 12:22:52.639539 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.509944 (+870405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:53.842103 (+332159us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400263ed4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:53.842347 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856055552}
I20260709 12:22:53.860515 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.861133 30856 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:53.860404 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.751302 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.864353 30854 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
W20260709 12:22:53.862411 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 230951us
I20260709 12:22:53.866346 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:53.858918 30899 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:53.828433 30934 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:53.783368 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.863045 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:53.872134 30930 raft_consensus.cc:2410] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:22:53.855189  1141 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:53.855351  1029 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.778342 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.872349 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:53.873265 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 225962us
I20260709 12:22:53.876668 30852 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:53.881770 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:53.883742 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:53.885730 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.886641 30783 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:53.888435 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.888695 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:53.889225 30856 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:53.891412 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.853062 30859 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:22:53.892622 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:53.891788 30858 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:53.838058  1040 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:53.700273  1160 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:53.895143 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:53.772078  1163 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:53.895274 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:53.900084 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:53.903422 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.907991 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.908980 30933 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:53.911972 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.912693 30934 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.768193 31503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.858858  1120 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.917059 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.855019  1157 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:53.926317 30783 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:22:53.913743 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.700940  1065 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.763633  1005 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:53.890142  1052 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.912293  1117 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:53.870667   906 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:53.871898  1159 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:53.928710 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.915388  1169 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:53.929872 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:53.948462 30783 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 3.
I20260709 12:22:53.781903 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.891909  1162 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:53.947501 30930 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:22:53.927632 30926 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:53.894500   996 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.936225 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.754369  1121 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.788022   827 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:53.914316  1057 raft_consensus.cc:3055] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:53.867076  1013 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.951617 30933 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:22:53.903935  1109 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:22:53.955476 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.967716 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:53.927250 31507 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:22:53.970150 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:54.009424 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:53.976886 30899 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:54.014796 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:54.015087 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 47457.9us
I20260709 12:22:54.015414 30930 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:54.015714 30779 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:53.973368 30934 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:54.019733 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:54.019635 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.964408  1057 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:54.020932 30855 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:54.021550 30930 raft_consensus.cc:2376] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9. Re-sending same reply.
I20260709 12:22:54.023124 30900 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:54.024919 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:54.017225 30899 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:53.947142   906 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:54.032476 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:54.032763 31505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:53.943482  1052 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:54.033640 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:54.035635  1052 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:54.035719  1040 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:54.036178  1005 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:22:54.036453  1040 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:54.036798  1005 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.037210  1040 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.037365  1005 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.029724 30931 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:54.040207 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:53.953924  1162 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.934051  1120 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.043241 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:53.963500  1117 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:54.051378 30899 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:54.054383  1052 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:54.053941 30930 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:54.031117  1122 consensus_meta.cc:287] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.004s
I20260709 12:22:53.956496   996 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:53.954085  1051 consensus_queue.cc:1059] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:22:54.088711 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:53.953936  1140 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:22:54.038183  1160 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:54.044342   906 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:53.966576  1007 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:22:54.083081 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:54.038475  1156 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:54.013841   998 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:22:54.115852 30930 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:22:54.053835  1162 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.111451 30933 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:54.026880  1157 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:22:54.050523   912 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:54.120615 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.122519 30926 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:22:54.125229 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:54.190001 30851 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:54.083679  1052 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:54.119961  1169 raft_consensus.cc:3055] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:54.139330 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:54.108747  1160 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:54.181962 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 98978.7us
W20260709 12:22:54.171159 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 119858us
I20260709 12:22:54.159551 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:54.127511  1127 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:54.228520 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:54.230509 30851 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:54.231590  1127 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.232084  1127 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:54.232805  1168 consensus_queue.cc:1059] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.217s
I20260709 12:22:54.233827 31504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:54.234328  1083 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 12:22:54.235214 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:54.241489  1175 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 12:22:54.244961  1177 log.cc:927] Time spent T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:22:54.245185   827 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:54.124558   961 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 12:22:54.102291  1102 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:22:54.242184 30930 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:54.212467 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.188599  1129 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:54.095060  1122 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.124310  1128 consensus_queue.cc:1059] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:22:54.248114 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:54.192263  1052 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:54.307596 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 50428.5us
W20260709 12:22:54.253800  1164 consensus_meta.cc:287] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.019s
I20260709 12:22:54.356122  1164 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:54.356753  1007 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:54.357415  1007 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:54.357877  1005 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.358599  1164 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:54.358805  1007 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.360124  1005 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:54.360453 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:54.299257 30930 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:54.360776  1007 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:54.194605  1051 raft_consensus.cc:3055] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:54.360926 31508 raft_consensus.cc:2393] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:54.361652  1051 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:54.361955  1052 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:54.362676  1051 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.363915  1051 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:54.195672  1169 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:54.243868  1065 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:54.170441  1156 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.361038 30778 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:22:54.258445 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 218357us
I20260709 12:22:54.250730  1140 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.249155  1160 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:54.260361 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:54.105360  1159 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:54.344727 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:54.376106 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:54.375123  1140 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:54.354812 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:54.389542 30777 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:54.345949 30851 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:54.392328 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:54.378492 30778 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
W20260709 12:22:54.385952 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 138640us
I20260709 12:22:54.403730 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:54.385988 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:54.448546 31476 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:54.459854 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 56221.7us
I20260709 12:22:54.466130 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:54.347267  1129 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:54.555382 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 106956us
I20260709 12:22:54.254787  1171 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.455s
I20260709 12:22:54.293841  1172 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.517s
I20260709 12:22:54.458979  1083 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:54.472563  1136 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:54.463776  1005 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:54.261636  1117 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:54.603706  1187 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:22:54.861618  1184 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:54.863469  1127 consensus_meta.cc:287] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.003s
I20260709 12:22:54.706193  1193 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:54.810313  1120 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:54.772539  1102 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:54.808408  1083 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:54.872735 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 497058us
I20260709 12:22:54.923699 30927 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:54.982206 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:54.753964  1157 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.772814  1109 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:22:54.708256  1121 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:54.969954 30779 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.006s
W20260709 12:22:54.997823 30779 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.006s
I20260709 12:22:54.602772  1128 consensus_queue.cc:1059] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.335s
W20260709 12:22:54.905929  1159 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.061s
W20260709 12:22:55.010025  1159 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.008s	sys 0.062s
I20260709 12:22:54.879240  1153 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:54.986459 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:55.011565  1013 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.021981  1027 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:55.017136  1160 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.000s
I20260709 12:22:54.987277  1193 raft_consensus.cc:697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:55.001991  1129 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.979558  1102 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:54.912335  1136 raft_consensus.cc:697] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:55.001951 30935 raft_consensus.cc:614] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:22:55.042663 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49608 (request call id 72) took 3705 ms. Trace:
I20260709 12:22:54.987120  1083 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.043040  1136 consensus_queue.cc:237] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.046012  1148 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:55.046815  1148 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.023624  1027 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.026975  1140 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:55.056165  1027 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.032402  1102 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:54.980290  1184 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.057873 30851 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:55.043118 30935 rpcz_store.cc:276] 0709 12:22:51.347215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.587329 (+2240114us) service_pool.cc:224] Handling call
0709 12:22:55.001825 (+1414496us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5400025420. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961099c520 00007f9610a19652 00007f96159e760a 00007f960ef6d7d4 00007f960ef6d762 00007f960ef6d691 00007f960ef6d60c 00007f960ef6c8c2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:55.042541 (+ 40716us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56985856}
I20260709 12:22:55.060197  1184 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:55.036921 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 50540.9us
I20260709 12:22:54.708760   727 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.244s
I20260709 12:22:55.039755  1065 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:55.061558 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:54.975410   827 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:55.062865   827 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.063494 30900 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:55.065150 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:55.002453  1188 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:55.066716  1188 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:55.067364  1188 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:55.031240  1193 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.070809  1065 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:55.071579  1065 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:55.072785  1065 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.074041  1120 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:22:55.082042  1052 consensus_meta.cc:287] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.000s
I20260709 12:22:55.082594  1120 raft_consensus.cc:697] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:55.082758  1052 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:55.083925  1120 consensus_queue.cc:237] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:54.976703 30932 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1276) took 3532 ms (client timeout 2186 ms). Trace:
W20260709 12:22:55.088294 30932 rpcz_store.cc:269] 0709 12:22:51.390823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.527770 (+136947us) service_pool.cc:224] Handling call
0709 12:22:54.923282 (+3395512us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b540027c254. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:54.923486 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4839464832}
I20260709 12:22:55.090626  1122 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:55.095589  1007 consensus_meta.cc:287] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.734s	user 0.012s	sys 0.000s
I20260709 12:22:55.075242   827 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:54.976931  1127 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:55.106736 30858 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.017s	sys 0.033s
W20260709 12:22:55.110778 30858 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.018s	sys 0.033s
I20260709 12:22:55.319823 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1376) took 1690 ms. Trace:
I20260709 12:22:55.328503 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1383) took 1697 ms. Trace:
I20260709 12:22:55.328645 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1447) took 1412 ms. Trace:
I20260709 12:22:55.329530 30784 rpcz_store.cc:276] 0709 12:22:53.916391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.917566 (+  1175us) service_pool.cc:224] Handling call
0709 12:22:53.930749 (+ 13183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.936632 (+  5883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.936672 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.957512 (+ 20840us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.341011 (+383499us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:54.341124 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.341277 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.328443 (+987166us) raft_consensus.cc:1685] finished
0709 12:22:55.328463 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.328588 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3798,"raft.queue_time_us":126,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10297,"thread_start_us":301556,"threads_started":1,"wal-append.queue_time_us":959443}
W20260709 12:22:55.183393 30856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.027s	sys 0.086s
W20260709 12:22:55.332135 30856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.030s	sys 0.105s
I20260709 12:22:55.150969 30933 raft_consensus.cc:2368] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5.
W20260709 12:22:55.336440 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 271389us
I20260709 12:22:55.329362 30858 rpcz_store.cc:276] 0709 12:22:53.630663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.912380 (+281717us) service_pool.cc:224] Handling call
0709 12:22:53.912676 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.912904 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:54.126487 (+213583us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.328146 (+1201659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:55.328196 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:55.328249 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.328315 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.328444 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":427395,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":3328,"thread_start_us":1395804,"threads_started":2}
W20260709 12:22:55.295022  1095 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.014s	sys 0.064s
I20260709 12:22:55.328775 30854 rpcz_store.cc:276] 0709 12:22:53.628866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.888299 (+259433us) service_pool.cc:224] Handling call
0709 12:22:53.911656 (+ 23357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.927764 (+ 16108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.927798 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.931691 (+  3893us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.251244 (+319553us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:54.386600 (+135356us) log.cc:844] Serialized 14 byte log entry
0709 12:22:54.386848 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.386926 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.319496 (+932570us) raft_consensus.cc:1685] finished
0709 12:22:55.319526 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.319710 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11733,"prepare.queue_time_us":555617,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1493,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":70433,"thread_start_us":308762,"threads_started":2,"wal-append.queue_time_us":1184801}
I20260709 12:22:55.413952 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:55.177896  1040 consensus_meta.cc:287] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.123s	user 0.013s	sys 0.000s
W20260709 12:22:55.427790 30858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1564) took 1492 ms (client timeout 1917 ms). Trace:
W20260709 12:22:55.435139 30858 rpcz_store.cc:269] 0709 12:22:53.935521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.413611 (+1478090us) service_pool.cc:224] Handling call
0709 12:22:55.427687 (+ 14076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.436964 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:55.430732 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.004s	sys 0.007s
W20260709 12:22:55.438053 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.004s	sys 0.007s
W20260709 12:22:55.114964   906 consensus_meta.cc:287] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.945s	user 0.008s	sys 0.004s
I20260709 12:22:55.401551 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:55.295962  1051 consensus_meta.cc:287] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.921s	user 0.012s	sys 0.005s
W20260709 12:22:55.439566 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 956710us
I20260709 12:22:55.138259   827 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:22:55.445526   906 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.446020 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1568) took 1250 ms. Trace:
I20260709 12:22:55.483081 30858 rpcz_store.cc:276] 0709 12:22:54.195377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.436616 (+1241239us) service_pool.cc:224] Handling call
0709 12:22:55.445947 (+  9331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.447242 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:55.425199  1095 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.016s	sys 0.075s
W20260709 12:22:55.457633  1194 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.417s	user 0.003s	sys 0.002s
I20260709 12:22:55.476887   827 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.492928   827 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.324867  1127 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:55.432876  1052 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:55.462348  1162 consensus_meta.cc:287] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 1.270s	user 0.012s	sys 0.000s
I20260709 12:22:55.414338  1005 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:55.499171 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.498871  1162 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.499399  1005 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.501334  1051 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.401639  1122 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.501963  1051 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.502290  1205 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:55.502346  1122 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.503033  1205 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:55.503340 31510 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:22:55.503988 31510 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42838 (request call id 140) took 1485 ms. Trace:
I20260709 12:22:55.503931  1205 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.504755  1122 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:55.460317  1141 consensus_meta.cc:287] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 1.565s	user 0.011s	sys 0.000s
I20260709 12:22:55.470263 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.489279 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:55.506476 30853 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:22:55.502390 30857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1364) took 1885 ms (client timeout 1544 ms). Trace:
W20260709 12:22:55.507437 30857 rpcz_store.cc:269] 0709 12:22:53.617496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.617634 (+   138us) service_pool.cc:224] Handling call
0709 12:22:55.502182 (+1884548us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540003ded4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.502309 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240511232}
I20260709 12:22:55.464960 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1453) took 1529 ms. Trace:
I20260709 12:22:55.491083 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.492071  1134 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:22:55.511556 30858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41694 (request call id 327) took 1597 ms (client timeout 2019 ms). Trace:
I20260709 12:22:55.504336  1051 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.515116 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:55.508750 30783 rpcz_store.cc:276] 0709 12:22:53.935310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.949284 (+ 13974us) service_pool.cc:224] Handling call
0709 12:22:55.464020 (+1514736us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:22:55.464266 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.464506 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.464546 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:55.464604 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:55.464647 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.464729 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.464879 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44043008}
W20260709 12:22:55.513043 30853 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1551) took 1812 ms (client timeout 1636 ms). Trace:
W20260709 12:22:55.517581 30853 rpcz_store.cc:269] 0709 12:22:53.701604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.719926 (+ 18322us) service_pool.cc:224] Handling call
0709 12:22:55.470044 (+1750118us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:55.512956 (+ 42912us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12578688}
I20260709 12:22:55.519073 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:55.519886 30780 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:55.520422 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1450) took 1591 ms. Trace:
I20260709 12:22:55.520789 30780 rpcz_store.cc:276] 0709 12:22:53.928817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.929007 (+   190us) service_pool.cc:224] Handling call
0709 12:22:55.518879 (+1589872us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:22:55.520352 (+  1473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44371840}
I20260709 12:22:55.106375  1157 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.518723 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.467758  1082 raft_consensus.cc:3055] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:55.484671 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:55.536857 30854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1580) took 1297 ms (client timeout 1667 ms). Trace:
I20260709 12:22:55.025746  1160 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:55.513721 30858 rpcz_store.cc:269] 0709 12:22:53.914593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.490775 (+1576182us) service_pool.cc:224] Handling call
0709 12:22:55.511493 (+ 20718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.558066 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.559356 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1586) took 1165 ms. Trace:
I20260709 12:22:55.559899 30858 rpcz_store.cc:276] 0709 12:22:54.402973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.557707 (+1154734us) service_pool.cc:224] Handling call
0709 12:22:55.559258 (+  1551us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.561214 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.562714 30858 raft_consensus.cc:2468] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 4.
I20260709 12:22:55.563383 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1582) took 1323 ms. Trace:
I20260709 12:22:55.563766 30858 rpcz_store.cc:276] 0709 12:22:54.240323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.560843 (+1320520us) service_pool.cc:224] Handling call
0709 12:22:55.563328 (+  2485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.564994 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.157918   868 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.510325 31509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42840 (request call id 276) took 1852 ms. Trace:
I20260709 12:22:55.566174 31509 rpcz_store.cc:276] 0709 12:22:53.657705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.657874 (+   169us) service_pool.cc:224] Handling call
0709 12:22:53.658164 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:53.715989 (+ 57825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.509939 (+1793950us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400091d54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:55.510173 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95013248}
I20260709 12:22:55.504449 31510 rpcz_store.cc:276] 0709 12:22:54.019100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.502732 (+1483632us) service_pool.cc:224] Handling call
0709 12:22:55.503114 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.503695 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.503906 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.524718 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.568518 30858 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:55.569204 30857 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:55.569376 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1575) took 1331 ms. Trace:
I20260709 12:22:55.478084  1083 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:55.481937  1065 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:55.531046  1070 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:55.572111  1065 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.572751  1070 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:55.573187  1070 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.574527  1065 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.513722  1140 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:55.575237  1140 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.577348  1140 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:55.569818 30857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1585) took 1255 ms (client timeout 1636 ms). Trace:
W20260709 12:22:55.578871 30857 rpcz_store.cc:269] 0709 12:22:54.314147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.508380 (+1194233us) service_pool.cc:224] Handling call
0709 12:22:55.569720 (+ 61340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.501672  1162 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.531652 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1571) took 1294 ms. Trace:
I20260709 12:22:55.444538  1040 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.522702  1153 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:55.537341 30854 rpcz_store.cc:269] 0709 12:22:54.239730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.435836 (+1196106us) service_pool.cc:224] Handling call
0709 12:22:55.536769 (+100933us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:55.431138  1158 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.000s	sys 0.011s
I20260709 12:22:55.488355  1121 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:22:55.582566 30853 rpcz_store.cc:276] 0709 12:22:54.236906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.518450 (+1281544us) service_pool.cc:224] Handling call
0709 12:22:55.531561 (+ 13111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.584419 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:55.591327 30825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.060s	sys 0.092s
I20260709 12:22:55.587144 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1572) took 1350 ms. Trace:
W20260709 12:22:55.592147 30825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.060s	sys 0.092s
I20260709 12:22:55.592417 30853 rpcz_store.cc:276] 0709 12:22:54.237191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.584042 (+1346851us) service_pool.cc:224] Handling call
0709 12:22:55.587052 (+  3010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.593879 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.594789 30853 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:55.595481 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1583) took 1346 ms. Trace:
I20260709 12:22:55.595923 30853 rpcz_store.cc:276] 0709 12:22:54.249550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.593498 (+1343948us) service_pool.cc:224] Handling call
0709 12:22:55.595404 (+  1906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.569945 30858 rpcz_store.cc:276] 0709 12:22:54.238138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.564624 (+1326486us) service_pool.cc:224] Handling call
0709 12:22:55.569296 (+  4672us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:55.593415 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 607792us
I20260709 12:22:55.599989 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.601161 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1391) took 1538 ms. Trace:
I20260709 12:22:55.604619 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.604872 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.605577 30825 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:55.606410 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1573) took 1369 ms. Trace:
I20260709 12:22:55.606896 30857 rpcz_store.cc:276] 0709 12:22:54.237492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.579762 (+1342270us) service_pool.cc:224] Handling call
0709 12:22:55.606339 (+ 26577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.601634 30858 rpcz_store.cc:276] 0709 12:22:54.062777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.599600 (+1536823us) service_pool.cc:224] Handling call
0709 12:22:55.601065 (+  1465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.557734  1051 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.608498 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.608441 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:55.578118  1203 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:22:55.612924 30858 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.606074 30853 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:22:55.536393  1082 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:55.590499  1158 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.000s	sys 0.012s
I20260709 12:22:55.614004 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:55.621225 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 220398us
I20260709 12:22:55.621941 30932 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:55.614714 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1570) took 1378 ms. Trace:
I20260709 12:22:55.615445 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.616621 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.580060  1083 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.663345 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.753016 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.753921 30930 raft_consensus.cc:2393] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:55.754809 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:55.755417 30930 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.755647 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1382) took 2125 ms. Trace:
I20260709 12:22:55.756064 30852 rpcz_store.cc:276] 0709 12:22:53.630411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.907674 (+277263us) service_pool.cc:224] Handling call
0709 12:22:53.942703 (+ 35029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.040638 (+ 97935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:54.040686 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:54.040745 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:54.040794 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.755404 (+1714610us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b5400141254. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:55.755458 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.755588 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224597376}
I20260709 12:22:55.627084 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1574) took 1389 ms. Trace:
W20260709 12:22:55.757579 31508 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42840 (request call id 278) took 1982 ms (client timeout 2387 ms). Trace:
I20260709 12:22:55.757933 30854 rpcz_store.cc:276] 0709 12:22:54.237824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.583311 (+1345487us) service_pool.cc:224] Handling call
0709 12:22:55.626987 (+ 43676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.759048 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.759815 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1577) took 1521 ms. Trace:
I20260709 12:22:55.760141 30854 rpcz_store.cc:276] 0709 12:22:54.238770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.758774 (+1520004us) service_pool.cc:224] Handling call
0709 12:22:55.759755 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.760488  1029 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.761054 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.605790  1150 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.740279  1082 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.762935  1082 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.764961  1009 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.664276 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.766111 30857 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:55.766572 31507 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42836 (request call id 223) took 3473 ms. Trace:
I20260709 12:22:55.767092 31507 rpcz_store.cc:276] 0709 12:22:52.293004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.293219 (+   215us) service_pool.cc:224] Handling call
0709 12:22:52.293713 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:54.013370 (+1719657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.766183 (+1752813us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540006b154. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:55.766449 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3756188416}
I20260709 12:22:55.768899 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1386) took 2327 ms. Trace:
I20260709 12:22:55.769230 30935 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:55.622020 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:55.769505 30776 rpcz_store.cc:276] 0709 12:22:53.441821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.442455 (+   634us) service_pool.cc:224] Handling call
0709 12:22:53.442938 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.601500 (+158562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.768559 (+2167059us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003cdcd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:55.768814 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359344384}
I20260709 12:22:55.770296 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:55.770511 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 148573us
I20260709 12:22:55.771118 30935 raft_consensus.cc:2393] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:55.771354 30900 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:55.773483  1181 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.526s	user 0.000s	sys 0.013s
I20260709 12:22:55.605451  1127 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:55.768379 30930 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
W20260709 12:22:55.783090 30851 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1579) took 1543 ms (client timeout 1610 ms). Trace:
I20260709 12:22:55.782869  1127 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.783645 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:55.783603 30851 rpcz_store.cc:269] 0709 12:22:54.239423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.393606 (+154183us) service_pool.cc:224] Handling call
0709 12:22:55.782906 (+1389300us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b540012e654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.783028 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358673664}
I20260709 12:22:55.784619 30930 raft_consensus.cc:2393] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:22:55.620296  1117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.026s
I20260709 12:22:55.606990  1121 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:55.612221   996 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.680225 30858 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:55.684034  1027 raft_consensus.cc:3055] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:55.687003  1040 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.688426  1157 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:55.689149  1201 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:22:55.690769  1156 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.692879 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1377) took 2063 ms. Trace:
W20260709 12:22:55.693171  1206 log.cc:927] Time spent T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:22:55.618127  1051 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:55.687050 30860 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1370) took 2067 ms (client timeout 1886 ms). Trace:
I20260709 12:22:55.670498  1160 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:55.694041  1204 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:55.677873  1122 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.702003 31506 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
W20260709 12:22:55.718634 30933 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1627) took 1805 ms (client timeout 2157 ms). Trace:
W20260709 12:22:55.738359 30855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1379) took 2108 ms (client timeout 1857 ms). Trace:
I20260709 12:22:55.780952 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.806468 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:55.789157 31511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:55.813886 30860 rpcz_store.cc:269] 0709 12:22:53.620071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.620222 (+   151us) service_pool.cc:224] Handling call
0709 12:22:55.686854 (+2066632us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540003e8d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.686969 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249177344}
W20260709 12:22:55.816103 30858 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1569) took 1580 ms (client timeout 2050 ms). Trace:
I20260709 12:22:55.796521 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:55.816696 30858 rpcz_store.cc:269] 0709 12:22:54.236174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.608288 (+1372114us) service_pool.cc:224] Handling call
0709 12:22:55.816031 (+207743us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.817350 30930 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:55.786370 30931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1299) took 2114 ms (client timeout 1835 ms). Trace:
I20260709 12:22:55.697573   994 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.681357  1007 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:22:55.885492  1204 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:55.885985  1204 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:55.590806  1153 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:55.886592  1153 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:55.886788  1204 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:55.887655 31511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42836 (request call id 228) took 1861 ms (client timeout 2157 ms). Trace:
W20260709 12:22:55.888228 31511 rpcz_store.cc:269] 0709 12:22:54.026695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.788693 (+1761998us) service_pool.cc:224] Handling call
0709 12:22:55.887558 (+ 98865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.591706  1191 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:55.761970  1150 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.889822  1102 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:55.890066  1191 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.597517  1065 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.891518 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1378) took 2262 ms. Trace:
I20260709 12:22:55.891813  1065 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.892323  1191 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.888116  1204 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:55.894181 31506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42836 (request call id 224) took 2043 ms (client timeout 2186 ms). Trace:
I20260709 12:22:55.894328 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.894999 30858 raft_consensus.cc:2376] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8. Re-sending same reply.
I20260709 12:22:55.896165 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.896730 30858 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.663398 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.898120 30929 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:55.891942 30859 rpcz_store.cc:276] 0709 12:22:53.629395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.892808 (+263413us) service_pool.cc:224] Handling call
0709 12:22:53.913557 (+ 20749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.915497 (+  1940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.915524 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.929465 (+ 13941us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.406068 (+476603us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:54.406131 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.406230 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.456728 (+1050498us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:55.607483 (+150755us) raft_consensus.cc:1685] finished
0709 12:22:55.607507 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.891339 (+283832us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400437bd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.891457 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219,"raft.queue_time_us":10736,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3254,"spinlock_wait_cycles":122299648,"thread_start_us":423972,"threads_started":1,"wal-append.queue_time_us":1090193}
I20260709 12:22:55.899217 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.899832 30929 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:55.899502 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.776417  1052 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:55.700580  1140 consensus_queue.cc:1059] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:22:55.758158 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:55.900744 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:55.818768 30933 rpcz_store.cc:269] 0709 12:22:53.913074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.138257 (+225183us) service_pool.cc:224] Handling call
0709 12:22:55.718333 (+1580076us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400213ed4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.718547 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195687168}
I20260709 12:22:55.901083  1140 consensus_queue.cc:1243] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:22:55.746711   906 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.901880 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.902496 30933 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:55.897356 31502 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.756589 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.816185 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.822515 30853 rpcz_store.cc:276] 0709 12:22:54.236579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.596912 (+1360333us) service_pool.cc:224] Handling call
0709 12:22:55.614633 (+ 17721us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:55.814121 30855 rpcz_store.cc:269] 0709 12:22:53.629630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.647029 (+ 17399us) service_pool.cc:224] Handling call
0709 12:22:55.738124 (+2091095us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54004371d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.738263 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231518080}
I20260709 12:22:55.830492  1160 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:55.790297 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 345) took 1974 ms. Trace:
I20260709 12:22:55.830879 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.833832 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:55.901156 30852 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:55.835016 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.836391  1005 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.836995  1122 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:55.814303  1117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.005s	sys 0.029s
I20260709 12:22:55.794706 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.842830 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1606) took 3557 ms. Trace:
I20260709 12:22:55.817905 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:55.904018 30935 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
W20260709 12:22:55.914772 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 96992.8us
I20260709 12:22:55.915426 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.916015 30935 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:55.916814 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:55.904462 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:55.839257  1121 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:55.917618 30932 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.904940 30853 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:22:55.918460 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1385) took 2286 ms. Trace:
I20260709 12:22:55.918771 30853 rpcz_store.cc:276] 0709 12:22:53.632142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.904344 (+2272202us) service_pool.cc:224] Handling call
0709 12:22:55.904655 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.918176 (+ 13521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.918403 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.846849  1127 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.852746 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:55.900786  1052 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:55.906097 30781 rpcz_store.cc:276] 0709 12:22:53.815689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.815891 (+   202us) service_pool.cc:224] Handling call
0709 12:22:53.816334 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:53.845272 (+ 28938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:53.845317 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:53.868671 (+ 23354us) log.cc:844] Serialized 26 byte log entry
0709 12:22:54.054534 (+185863us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:54.054586 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:54.054666 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.772737 (+1718071us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:22:55.789833 (+ 17096us) raft_consensus.cc:1685] finished
0709 12:22:55.789866 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.790210 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9475,"raft.queue_time_us":9640,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":2614,"spinlock_wait_cycles":9269632,"thread_start_us":129775,"threads_started":1,"wal-append.queue_time_us":196063}
I20260709 12:22:55.922168  1052 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:55.922617  1135 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:55.923174  1135 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:55.924710  1164 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:55.907323 30860 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:55.805722 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:55.925714 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1393) took 1862 ms. Trace:
I20260709 12:22:55.926187 30860 rpcz_store.cc:276] 0709 12:22:54.063473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.834635 (+1771162us) service_pool.cc:224] Handling call
0709 12:22:55.925629 (+ 90994us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.903515 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:55.855929  1032 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:55.894675 31506 rpcz_store.cc:269] 0709 12:22:53.850747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.932541 (+ 81794us) service_pool.cc:224] Handling call
0709 12:22:55.893998 (+1961457us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54004f8b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.894114 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3396010240}
I20260709 12:22:55.900555  1051 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:55.891544  1150 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.902525  1065 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.814213 30856 rpcz_store.cc:276] 0709 12:22:53.629134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.891296 (+262162us) service_pool.cc:224] Handling call
0709 12:22:53.925894 (+ 34598us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:53.930569 (+  4675us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:22:54.125256 (+194687us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.332642 (+1207386us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:55.402477 (+ 69835us) log.cc:844] Serialized 78 byte log entry
0709 12:22:55.402600 (+   123us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:55.403670 (+  1070us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.404085 (+   415us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.404386 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 12:22:55.462914 (+ 58528us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b18002a0a60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d932522 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:55.610032 (+147118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.610120 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:55.692460 (+ 82340us) raft_consensus.cc:1685] finished
0709 12:22:55.692491 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:55.692765 (+   274us) inbound_call.cc:177] Queueing success response
0709 12:22:55.763557 (+ 70792us) spinlock_profiling.cc:243] Waited 87.3 ms on lock 0x7b48000ce7d8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
Metrics: {"mutex_wait_us":46323,"prepare.queue_time_us":540019,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":76190,"raft.run_cpu_time_us":4072,"raft.run_wall_time_us":469224,"spinlock_wait_cycles":236156288,"thread_start_us":1440788,"threads_started":3,"wal-append.queue_time_us":1391541}
I20260709 12:22:55.923990  1135 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.930172 30856 raft_consensus.cc:1240] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 12:22:55.930897 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1544) took 2238 ms. Trace:
I20260709 12:22:55.931238 30856 rpcz_store.cc:276] 0709 12:22:53.692243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.929465 (+2237222us) service_pool.cc:224] Handling call
0709 12:22:55.929883 (+   418us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:55.930617 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.930837 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.928781 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:55.852380 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:55.914239 30926 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:55.784986 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:56.006247 30926 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:55.864715 30854 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:22:56.007848 30926 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:55.910722  1122 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:55.906947  1148 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:55.900579  1188 consensus_meta.cc:287] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.004s
I20260709 12:22:56.011122  1169 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:55.818065 30931 rpcz_store.cc:269] 0709 12:22:53.671413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.720860 (+ 49447us) service_pool.cc:224] Handling call
0709 12:22:55.786128 (+2065268us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54002238d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.786272 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655850752}
W20260709 12:22:56.015503 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.016537 30934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1633) took 2066 ms (client timeout 1751 ms). Trace:
I20260709 12:22:56.017400  1160 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:56.019106  1040 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.018656  1160 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.019650  1040 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:55.758073 31508 rpcz_store.cc:269] 0709 12:22:53.775267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:53.777924 (+  2657us) service_pool.cc:224] Handling call
0709 12:22:55.757344 (+1979420us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54003f8c54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.757483 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121008896}
W20260709 12:22:55.933564 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.024513 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1588) took 1130 ms. Trace:
I20260709 12:22:56.024983 30851 rpcz_store.cc:276] 0709 12:22:54.893734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.784726 (+890992us) service_pool.cc:224] Handling call
0709 12:22:56.024434 (+239708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:55.934386 30929 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:56.026556 30857 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:22:56.027060 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:56.027325 30857 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1578) took 1788 ms (client timeout 1984 ms). Trace:
W20260709 12:22:56.027817 30857 rpcz_store.cc:269] 0709 12:22:54.239078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.607919 (+1368841us) service_pool.cc:224] Handling call
0709 12:22:56.027256 (+419337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.028787 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:56.028934 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:56.030404 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.031468 30783 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:56.036085 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:56.037106 30781 raft_consensus.cc:2368] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8.
I20260709 12:22:56.038580 30926 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:22:56.039924 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:56.042347 30857 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:22:56.042883 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.041625 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:56.046957 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:56.048357 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:56.017084 30934 rpcz_store.cc:269] 0709 12:22:53.949714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:54.019498 (+ 69784us) service_pool.cc:224] Handling call
0709 12:22:56.016259 (+1996761us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54002152d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:56.016442 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4348419456}
I20260709 12:22:56.033213 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:55.949407 30858 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:56.063416 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1581) took 1823 ms. Trace:
I20260709 12:22:55.932881 30852 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
W20260709 12:22:56.069149 30852 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1567) took 1959 ms (client timeout 2186 ms). Trace:
I20260709 12:22:55.950798 30932 raft_consensus.cc:2410] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:22:56.011320  1188 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:55.916869 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:56.066735 30858 rpcz_store.cc:276] 0709 12:22:54.240033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.895923 (+1655890us) service_pool.cc:224] Handling call
0709 12:22:56.063324 (+167401us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:56.074255 30854 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1587) took 1311 ms (client timeout 1699 ms). Trace:
W20260709 12:22:56.077564 30854 rpcz_store.cc:269] 0709 12:22:54.762807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.760798 (+997991us) service_pool.cc:224] Handling call
0709 12:22:56.074062 (+313264us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54003796d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:56.074189 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171174784}
I20260709 12:22:56.079067 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:56.079854 30854 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.083778 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:56.084489 30859 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
W20260709 12:22:56.073289 30852 rpcz_store.cc:269] 0709 12:22:54.109439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.757694 (+1648255us) service_pool.cc:224] Handling call
0709 12:22:56.069049 (+311355us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.086861 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:56.085572 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:56.074779 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:56.090081 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:56.091930 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.093175 30852 raft_consensus.cc:2393] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:56.096688 30784 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:56.098697 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:56.099530 30933 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:22:56.102202 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49830.8us
I20260709 12:22:51.455510 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:56.106658 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 58707.4us
I20260709 12:22:55.914364 30927 rpcz_store.cc:276] 0709 12:22:52.285336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:52.378294 (+ 92958us) service_pool.cc:224] Handling call
0709 12:22:54.923467 (+2545173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:54.982421 (+ 58954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:55.842532 (+860111us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b540027c250. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:55.842746 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4173103360}
I20260709 12:22:56.104457 31476 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:56.109097 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:56.110019 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:56.110879 30858 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.125865 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:55.729477  1057 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.126832 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.128320 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:56.129333 30851 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:56.131158 30926 raft_consensus.cc:2393] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:56.131321 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:56.139907 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:56.142701 30859 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:22:56.143616 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1547) took 2450 ms. Trace:
I20260709 12:22:56.143940 30859 rpcz_store.cc:276] 0709 12:22:53.693159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.141945 (+2448786us) service_pool.cc:224] Handling call
0709 12:22:56.142370 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:56.143274 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.143542 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.145251 30858 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:22:56.145498 30859 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [7.4-8.5]
W20260709 12:22:56.049607  1120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.019s	sys 0.087s
I20260709 12:22:56.146179 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1550) took 2449 ms. Trace:
I20260709 12:22:56.146536 30859 rpcz_store.cc:276] 0709 12:22:53.696596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.144726 (+2448130us) service_pool.cc:224] Handling call
0709 12:22:56.145073 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:56.145895 (+   822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.146117 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.147274 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:55.818025  1027 raft_consensus.cc:740] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:56.106010   827 consensus_meta.cc:287] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.612s	user 0.012s	sys 0.000s
I20260709 12:22:56.153815 30859 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:56.154119 30930 raft_consensus.cc:2393] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:56.156425 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.157301 30854 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:56.155737 30858 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:22:56.164166 30935 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:22:56.166764 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1555) took 2443 ms. Trace:
I20260709 12:22:56.167299 30858 rpcz_store.cc:276] 0709 12:22:53.723437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.155237 (+2431800us) service_pool.cc:224] Handling call
0709 12:22:56.155520 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.164472 (+  8952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.166665 (+  2193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.169296 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1559) took 2444 ms. Trace:
I20260709 12:22:56.169961 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:56.171917 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:56.133037  1095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.030s	sys 0.029s
I20260709 12:22:56.174759 30854 raft_consensus.cc:1275] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:22:56.179073 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:56.179227 30852 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:22:56.169750 30858 rpcz_store.cc:276] 0709 12:22:53.724907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.168265 (+2443358us) service_pool.cc:224] Handling call
0709 12:22:56.168629 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.168870 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.168908 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.168965 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:56.169022 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.169093 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.169226 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:56.190904 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.153406  1120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.019s	sys 0.087s
W20260709 12:22:56.138929  1070 consensus_meta.cc:287] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.004s
I20260709 12:22:56.246616  1057 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.037858  1153 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:56.089269   994 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.074303  1007 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 12:22:56.414149 30930 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:56.399300 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.435055 30779 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
W20260709 12:22:56.215363 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.195502 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1554) took 2472 ms. Trace:
I20260709 12:22:56.240228 30934 raft_consensus.cc:1240] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.201192 30851 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:22:56.194416 30900 connection.cc:256] RPC call timeout handler was delayed by -1.6697412290000102s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 12:22:56.437024 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1549) took 2743 ms. Trace:
W20260709 12:22:56.437440 30900 connection.cc:256] RPC call timeout handler was delayed by -1.3880412290000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:22:56.219194 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.034s	sys 0.084s
W20260709 12:22:56.130932  1171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.003s	sys 0.032s
I20260709 12:22:56.181288  1157 consensus_queue.cc:1059] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.224s
I20260709 12:22:56.128278  1040 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:56.181082  1009 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:56.321084 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:56.384339 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.405237 30899 leader_election.cc:400] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8.
I20260709 12:22:56.456350 30899 leader_election.cc:403] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.412242 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1548) took 2718 ms. Trace:
I20260709 12:22:56.456951 30852 rpcz_store.cc:276] 0709 12:22:53.693464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.138266 (+2444802us) service_pool.cc:224] Handling call
0709 12:22:56.178984 (+ 40718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.411999 (+233015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.412188 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.426625 30858 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:22:56.458310 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1560) took 2733 ms. Trace:
I20260709 12:22:56.458679 30858 rpcz_store.cc:276] 0709 12:22:53.725268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.426065 (+2700797us) service_pool.cc:224] Handling call
0709 12:22:56.426435 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.458029 (+ 31594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.458236 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:56.459286 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.460188 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 322) took 2585 ms. Trace:
W20260709 12:22:56.441627  1171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.393s	user 0.003s	sys 0.032s
I20260709 12:22:56.421452  1051 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:56.329221 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:56.377995   961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.014s	sys 0.022s
I20260709 12:22:56.324805 30935 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:22:56.381573  1205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.014s	sys 0.025s
I20260709 12:22:56.411720 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1556) took 2688 ms. Trace:
I20260709 12:22:56.493634 30854 rpcz_store.cc:276] 0709 12:22:53.723790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.161470 (+2437680us) service_pool.cc:224] Handling call
0709 12:22:56.161850 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.411433 (+249583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.411662 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:56.410926 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 239091us
I20260709 12:22:56.308483 30933 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:22:56.411271  1095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.030s	sys 0.030s
W20260709 12:22:56.425573  1134 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.087s	sys 0.162s
I20260709 12:22:56.413405 30929 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:22:56.436553 30859 rpcz_store.cc:276] 0709 12:22:53.723049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.147312 (+2424263us) service_pool.cc:224] Handling call
0709 12:22:56.153611 (+  6299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.161182 (+  7571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.195270 (+ 34088us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b54003782d0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:56.195426 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13881728}
I20260709 12:22:56.507097 30859 raft_consensus.cc:1240] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:56.507897 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 324) took 2631 ms. Trace:
I20260709 12:22:56.508301 30859 rpcz_store.cc:276] 0709 12:22:53.876099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.506370 (+2630271us) service_pool.cc:224] Handling call
0709 12:22:56.506833 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.507624 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.507839 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.153330  1174 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:56.157735 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:22:56.437933 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.040s	sys 0.097s
W20260709 12:22:56.515779 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 1.00064e+06us
I20260709 12:22:56.515961 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1545) took 2823 ms. Trace:
W20260709 12:22:56.439478 31474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.440408  1213 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:22:56.195031  1193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.049s	sys 0.090s
I20260709 12:22:56.437604 30851 rpcz_store.cc:276] 0709 12:22:53.693810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.143441 (+2449631us) service_pool.cc:224] Handling call
0709 12:22:56.200961 (+ 57520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.436756 (+235795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.436960 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:56.443216 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.447162 30900 connection.cc:256] RPC call timeout handler was delayed by -1.3619412289999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
W20260709 12:22:56.508184  1134 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.087s	sys 0.163s
I20260709 12:22:56.436332 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.182356  1210 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.281s
I20260709 12:22:56.184474   827 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.193565  1191 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:22:56.464039 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 59014.7us
I20260709 12:22:56.576026 30899 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:56.464592  1211 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:56.468088 30960 heartbeater.cc:646] Failed to heartbeat to 127.28.234.126:42357 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.28.234.126:42357 timed out after 15.000s (SENT)
W20260709 12:22:56.478052 30825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.012s	sys 0.015s
W20260709 12:22:56.577533 30825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.013s	sys 0.015s
W20260709 12:22:56.577867 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 967434us
I20260709 12:22:56.578997 30825 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:56.327409  1188 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:56.485548 30785 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:56.496105 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:56.512598 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.581086 30780 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:56.514214 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:56.493367  1205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.014s	sys 0.025s
I20260709 12:22:56.516506 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:56.584615 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 68191.1us
I20260709 12:22:56.585621 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:56.587224 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:56.519063 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 323) took 2643 ms. Trace:
I20260709 12:22:56.588511 30825 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:56.516992 30856 rpcz_store.cc:276] 0709 12:22:53.692542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.932008 (+2239466us) service_pool.cc:224] Handling call
0709 12:22:55.932328 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:55.932544 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:56.023469 (+ 90925us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.515055 (+491586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.515129 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:56.515201 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.515303 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.515901 (+   598us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3863,"prepare.queue_time_us":117042,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":487297,"threads_started":1}
W20260709 12:22:56.589202 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 93210.5us
W20260709 12:22:56.524698 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.591035 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:56.524519 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:56.591720 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.489053  1051 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:56.460547 30858 rpcz_store.cc:276] 0709 12:22:53.874351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.459403 (+2585052us) service_pool.cc:224] Handling call
0709 12:22:56.459725 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.459902 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.459924 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.459965 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:56.459994 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.460042 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.460136 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.597232 30858 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:56.598004 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1566) took 2550 ms. Trace:
I20260709 12:22:56.596997 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:56.598445 30858 rpcz_store.cc:276] 0709 12:22:54.047408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.596559 (+2549151us) service_pool.cc:224] Handling call
0709 12:22:56.596878 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.597724 (+   846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.597950 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.595477 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 328) took 2669 ms. Trace:
I20260709 12:22:56.599259 30856 rpcz_store.cc:276] 0709 12:22:53.926482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.590573 (+2664091us) service_pool.cc:224] Handling call
0709 12:22:56.594901 (+  4328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.595099 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.595127 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.595180 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:56.595222 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.595291 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.595410 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.600019 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1390) took 2537 ms. Trace:
I20260709 12:22:56.539573 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.529388 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:56.386224  1027 consensus_queue.cc:260] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:56.544369 30824 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.018s	sys 0.051s
W20260709 12:22:56.529088  1193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.349s	user 0.058s	sys 0.115s
I20260709 12:22:56.546944 30851 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:22:56.537806  1120 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.537367  1134 consensus_queue.cc:1243] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:56.520746  1162 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:22:56.521509  1186 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:22:56.524643  1136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.477s	user 0.019s	sys 0.026s
I20260709 12:22:56.403434  1156 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:56.588886 30854 rpcz_store.cc:276] 0709 12:22:53.875313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.494744 (+2619431us) service_pool.cc:224] Handling call
0709 12:22:56.518304 (+ 23560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.518562 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.518600 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.518657 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:56.518716 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.518805 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.518982 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:56.487911   961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.014s	sys 0.022s
I20260709 12:22:56.430675  1070 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:56.563938  1082 consensus_meta.cc:287] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.001s
I20260709 12:22:56.591841 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:56.651352 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 59910.4us
I20260709 12:22:56.600378 30858 rpcz_store.cc:276] 0709 12:22:54.062314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.599259 (+2536945us) service_pool.cc:224] Handling call
0709 12:22:56.599553 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.599721 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.599746 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.599785 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:56.599821 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.599869 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.599970 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.598265  1171 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:22:56.611940 30824 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.018s	sys 0.055s
I20260709 12:22:56.613155 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1392) took 2550 ms. Trace:
I20260709 12:22:56.621402 30928 raft_consensus.cc:2393] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:56.622212 30899 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:56.657249 30856 rpcz_store.cc:276] 0709 12:22:54.063126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.600124 (+2536998us) service_pool.cc:224] Handling call
0709 12:22:56.612433 (+ 12309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.612668 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.612705 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.612763 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:56.612819 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.612888 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.613034 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.547423  1121 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:22:56.601804  1095 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:56.614583  1160 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:22:56.597481  1009 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:56.601904  1223 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:56.662459  1134 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:22:56.634634  1221 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:22:56.601629  1205 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:56.625660 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 326) took 2741 ms. Trace:
I20260709 12:22:56.598344  1051 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.623513   994 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:56.653995 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 329) took 1154 ms. Trace:
I20260709 12:22:56.688185  1223 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:56.693197 30858 rpcz_store.cc:276] 0709 12:22:55.500058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.652879 (+1152821us) service_pool.cc:224] Handling call
0709 12:22:56.653282 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.653503 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.653551 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.653608 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:22:56.653657 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.653747 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.653917 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.694064 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1541) took 3003 ms. Trace:
I20260709 12:22:56.694186  1223 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.695050 30858 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:22:56.602689 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 73396.8us
I20260709 12:22:56.697664  1032 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:56.698897  1032 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:22:56.673237  1214 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.240s	user 0.001s	sys 0.001s
I20260709 12:22:56.699815  1032 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:56.700950 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.544s (SENT) [suppressed 21 similar messages]
I20260709 12:22:56.701086  1070 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:56.701151  1032 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.702886 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:22:56.703541 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.703715  1007 raft_consensus.cc:3055] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:56.704100  1007 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:56.704905  1007 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.686393  1095 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:56.710736  1095 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.691720  1210 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:56.716446  1204 consensus_meta.cc:287] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.821s	user 0.008s	sys 0.001s
I20260709 12:22:56.666177  1122 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:56.717115 30857 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:56.666404  1040 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.652076 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:56.718118 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 66109.7us
I20260709 12:22:56.717908  1040 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.718776 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:56.719712 30750 leader_election.cc:400] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5.
I20260709 12:22:56.719983 30750 leader_election.cc:403] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.720276  1040 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:56.722247  1217 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:56.722451 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:56.722820  1217 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:56.723157  1052 consensus_meta.cc:287] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.000s
I20260709 12:22:56.723292 31506 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 5: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:56.723587  1052 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:56.723814  1217 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.724208  1174 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:22:56.619169  1188 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:56.640298  1136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.593s	user 0.021s	sys 0.026s
I20260709 12:22:56.662839 30854 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:56.662034 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 330) took 1161 ms. Trace:
I20260709 12:22:56.694569 30853 rpcz_store.cc:276] 0709 12:22:53.691242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.919474 (+2228232us) service_pool.cc:224] Handling call
0709 12:22:55.919839 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:55.920200 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.920227 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:55.920709 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.400028 (+479319us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:22:56.400067 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.400187 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.693827 (+293640us) raft_consensus.cc:1685] finished
0709 12:22:56.693845 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.693998 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":894,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"thread_start_us":478907,"threads_started":1,"wal-append.queue_time_us":654373}
I20260709 12:22:56.727450 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1576) took 2489 ms. Trace:
I20260709 12:22:56.593326  1135 consensus_queue.cc:1059] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:22:56.666953 30781 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:56.598042  1191 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:56.633869  1218 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:22:56.633383  1120 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.678401  1244 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:56.679750 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 325) took 2803 ms. Trace:
I20260709 12:22:56.618000  1220 consensus_queue.cc:1059] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:22:56.656718  1171 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.738615  1171 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.688448 30851 rpcz_store.cc:276] 0709 12:22:53.892329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.526072 (+2633743us) service_pool.cc:224] Handling call
0709 12:22:56.546573 (+ 20501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.618767 (+ 72194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.618985 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.741948  1191 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:56.743552 30783 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:56.744051 30783 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:56.745039   827 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:56.744985 30783 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.692715  1009 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:56.717229  1122 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.748324  1122 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.748284  1009 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.748756  1193 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:22:56.749172  1193 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:56.750155  1193 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:56.751468  1193 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:56.593506  1117 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:22:56.727837 30854 rpcz_store.cc:276] 0709 12:22:54.238433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.644569 (+2406136us) service_pool.cc:224] Handling call
0709 12:22:56.662502 (+ 17933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.727201 (+ 64699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.727395 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:22:56.721643 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.754992 30784 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
W20260709 12:22:56.755584 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.688920  1219 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:56.686832  1153 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:56.724224  1205 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:56.736092  1120 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:56.731523   906 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:56.736151  1052 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:56.727604  1109 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5.
I20260709 12:22:56.737418 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.800099 30779 raft_consensus.cc:2410] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:56.738080  1135 raft_consensus.cc:3055] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:56.692361  1134 raft_consensus.cc:697] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:56.747205  1220 raft_consensus.cc:3055] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:56.750566  1009 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:56.780275   827 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:56.757683 30783 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:56.727299 30856 rpcz_store.cc:276] 0709 12:22:55.500416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.658572 (+1158156us) service_pool.cc:224] Handling call
0709 12:22:56.661298 (+  2726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.661541 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.661579 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.661638 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:56.661694 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.661809 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.661960 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:22:56.738103 30859 rpcz_store.cc:276] 0709 12:22:53.876858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.509389 (+2632531us) service_pool.cc:224] Handling call
0709 12:22:56.510103 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.510727 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:56.542938 (+ 32211us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.679422 (+136484us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.679479 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:56.679529 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.679591 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.679701 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33364,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":51688,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":135394,"threads_started":2,"wal-append.queue_time_us":134700}
W20260709 12:22:56.743418  1227 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:22:56.775374 30926 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:56.767361  1244 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:56.787854 31477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:56.831697  1228 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 12:22:56.791518 30935 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:56.726933  1188 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:56.760623  1007 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:56.767781  1219 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.767462  1121 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:22:56.811569 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 214689us
W20260709 12:22:56.832391 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 241417us
I20260709 12:22:56.726521 30931 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:56.843767 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.849313 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:56.850072 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.799001  1191 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.789796 30851 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:22:56.829895  1016 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:22:56.872700 30783 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 12:22:56.927572 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.874470 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 309) took 1140 ms. Trace:
I20260709 12:22:56.831918  1220 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:56.835830  1135 raft_consensus.cc:740] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:56.845968   827 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:56.837920   906 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:56.923955 30851 pending_rounds.cc:85] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 7
I20260709 12:22:56.861840 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1561) took 3136 ms. Trace:
W20260709 12:22:56.924062 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 223113us
I20260709 12:22:56.927708 30783 pending_rounds.cc:85] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 4
I20260709 12:22:56.925704 30926 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:56.874732 30930 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:22:56.923520  1237 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:22:56.934558 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 204683us
W20260709 12:22:56.926411 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.853873  1244 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.949885 30783 pending_rounds.cc:107] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:56.963744 30783 raft_consensus.cc:2889] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:56.965145 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.965234 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.966163 30778 raft_consensus.cc:2393] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:56.966701 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.968016 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:56.873720  1188 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:56.926062 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:56.891961  1219 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:56.950623 30852 rpcz_store.cc:276] 0709 12:22:53.814922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.457819 (+2642897us) service_pool.cc:224] Handling call
0709 12:22:56.465188 (+  7369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.465388 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:22:56.465638 (+   250us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.861342 (+395704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.861423 (+    81us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:22:56.861497 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.861590 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.861732 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":512,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":50679,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":395238,"threads_started":2,"wal-append.queue_time_us":212821}
I20260709 12:22:56.917513  1205 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.928854  1191 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:56.960421 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:56.962420 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:56.930336 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:56.950102 30900 leader_election.cc:336] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.886s (SENT)
I20260709 12:22:56.971379  1211 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8.
I20260709 12:22:56.969317 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:56.969461 30899 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:56.973963 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 247807us
I20260709 12:22:57.004756 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:56.979542 30851 pending_rounds.cc:107] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:22:57.005609 30851 raft_consensus.cc:2889] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:57.005824 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:56.982039 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1542) took 3290 ms. Trace:
I20260709 12:22:57.006834 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.006577 30860 rpcz_store.cc:276] 0709 12:22:53.691589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.927005 (+2235416us) service_pool.cc:224] Handling call
0709 12:22:55.927502 (+   497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:22:55.928061 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:55.928097 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:22:55.928823 (+   726us) log.cc:844] Serialized 52 byte log entry
0709 12:22:56.390489 (+461666us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:22:56.390549 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.390671 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:56.981782 (+591111us) raft_consensus.cc:1685] finished
0709 12:22:56.981805 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.981954 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":292,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":461250,"threads_started":1,"wal-append.queue_time_us":637650}
W20260709 12:22:57.007984 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 57901.4us
W20260709 12:22:56.972963  1068 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:22:56.930513  1121 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:56.955514 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.020037 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.035961 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.039218 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.040077 30778 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:57.041179 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33360 (request call id 7) took 1132 ms. Trace:
I20260709 12:22:57.043399 30934 rpcz_store.cc:276] 0709 12:22:55.886253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.441544 (+555291us) service_pool.cc:224] Handling call
0709 12:22:57.007088 (+565544us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b54000b6654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a25735 00007f96159e5d29 00007f960ef641d4 00007f960ef64162 00007f960ef64091 00007f960ef6400c 00007f960ef632c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:57.018494 (+ 11406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29635968}
I20260709 12:22:57.042773 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:57.022392  1117 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:22:56.972447  1243 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 12:22:57.062502 30928 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1304) took 1449 ms (client timeout 1684 ms). Trace:
I20260709 12:22:57.062597 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.063283 30933 raft_consensus.cc:1240] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:22:57.063390 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 133095us
I20260709 12:22:56.972596  1134 consensus_queue.cc:237] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:57.062920 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 138408us
I20260709 12:22:57.062506 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1400) took 1052 ms. Trace:
I20260709 12:22:57.062372 30926 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.042982  1246 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:57.090058 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.011770  1220 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.035538  1211 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:22:57.097179 30857 rpcz_store.cc:276] 0709 12:22:56.009657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.043432 (+ 33775us) service_pool.cc:224] Handling call
0709 12:22:57.053410 (+1009978us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400076554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:57.062455 (+  9045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357966080}
W20260709 12:22:57.078430 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.094553 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:22:57.095039 30928 rpcz_store.cc:269] 0709 12:22:55.612909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.613075 (+   166us) service_pool.cc:224] Handling call
0709 12:22:57.053399 (+1440324us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b540027cc54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:57.062432 (+  9033us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959068928}
I20260709 12:22:57.104156 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.106227 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.115868 30826 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:57.115989 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.118738 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.119357 30856 raft_consensus.cc:2376] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7. Re-sending same reply.
I20260709 12:22:57.119619 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:57.120831  1240 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:22:57.124668 30926 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:57.127000 30858 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:57.125989 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.129623 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.130785 30926 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:57.131562 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:57.012048   827 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.134291 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.139835 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.024389  1135 consensus_queue.cc:260] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:57.105711  1246 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:57.140918 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.164485 30780 raft_consensus.cc:2410] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:22:57.150471 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.165040 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.112071  1211 consensus_queue.cc:1243] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:22:57.157241 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:57.158174 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 152953us
I20260709 12:22:57.140514 30858 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:57.159579 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.159967 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.163157 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:57.148841 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 349608us
I20260709 12:22:57.148406 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.144374 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.223734 30928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:57.224700 30928 raft_consensus.cc:606] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:57.119657  1191 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:57.052795   906 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.156991  1220 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:22:57.225826 30750 connection.cc:256] RPC call timeout handler was delayed by -2.4118874860000687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.225s for a response
I20260709 12:22:57.232813 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:22:57.242914 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.254215 30750 connection.cc:256] RPC call timeout handler was delayed by -2.1026509880002777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 12:22:57.248761  1242 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
W20260709 12:22:57.253691 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 94218.7us
I20260709 12:22:57.167937 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.260191 30928 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:22:57.175360 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.183969 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.267244 30857 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:57.138862  1243 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:57.255455 30750 connection.cc:256] RPC call timeout handler was delayed by -1.9703509880005186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
I20260709 12:22:57.252390 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.257212 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:57.151180  1065 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.140005  1169 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.273145 30926 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
W20260709 12:22:57.281275 30750 connection.cc:256] RPC call timeout handler was delayed by -1.7948509880002348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 12:22:57.281792 30750 connection.cc:256] RPC call timeout handler was delayed by -1.721851314000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 12:22:57.282177 30750 connection.cc:256] RPC call timeout handler was delayed by -1.66330694699991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:22:57.282452 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5598513139998431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:22:57.282725 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5527509880002981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 12:22:57.253950  1234 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
I20260709 12:22:57.285178 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 307) took 1552 ms. Trace:
I20260709 12:22:57.285560 30932 rpcz_store.cc:276] 0709 12:22:55.733036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.157713 (+424677us) service_pool.cc:224] Handling call
0709 12:22:56.158117 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:56.174881 (+ 16764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.174929 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:56.175525 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:22:56.600458 (+424933us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:56.600496 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.600560 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.284984 (+684424us) raft_consensus.cc:1685] finished
0709 12:22:57.285003 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.285121 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16200,"raft.queue_time_us":23045,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":91209,"thread_start_us":258660,"threads_started":1,"wal-append.queue_time_us":520678}
I20260709 12:22:57.288552 30932 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:57.227058  1210 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:57.259763  1120 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:57.283010 30926 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:57.272856  1225 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.725s	user 0.002s	sys 0.002s
I20260709 12:22:57.168690  1246 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.273411  1243 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:57.278822 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.291270 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:57.293287  1122 consensus_meta.cc:287] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.001s
I20260709 12:22:57.310807 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.292634 30825 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.140668  1241 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.315014 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.316246 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:57.292049 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.266709 30778 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
W20260709 12:22:57.282997 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5527509880002981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 12:22:57.224357  1204 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 12:22:57.319927 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4824513140001727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 12:22:57.320581 30750 connection.cc:256] RPC call timeout handler was delayed by -1.466418375000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 12:22:57.320998 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4034183750000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:22:57.321893 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4034183750000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:22:57.322309 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3800183749999633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:22:57.322731 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3521183749999182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:22:57.323266 30750 connection.cc:256] RPC call timeout handler was delayed by -1.345818374999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:22:57.323987 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3350183749998905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 12:22:57.325156 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3233183749998716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 12:22:57.167484  1140 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:22:57.327105 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2765183750002507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:22:57.335072 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2468183750002026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 12:22:57.336315 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2063183750001372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 12:22:57.336716 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2063183750001372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 12:22:57.337081 30750 connection.cc:256] RPC call timeout handler was delayed by -1.20181837500013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 12:22:57.337497 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1811183750000964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
W20260709 12:22:57.337885 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1559183750000557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 12:22:57.338263 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1235183750000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 12:22:57.167640  1157 consensus_queue.cc:1059] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.149s
I20260709 12:22:57.335757 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.344151 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.345168 30779 raft_consensus.cc:2410] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:57.315140  1243 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.299973  1210 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:22:57.338631 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1217183750000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:22:57.350289 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1145183749999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 12:22:57.305680 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:57.346727 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.321237  1120 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.348434 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:57.334051 30785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.003s	sys 0.032s
W20260709 12:22:57.350826 30750 connection.cc:256] RPC call timeout handler was delayed by -1.0668183749999116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:22:57.354012 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.364693 30785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.032s
I20260709 12:22:57.357179 30851 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:57.347815 30929 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:22:57.365875 30929 raft_consensus.cc:606] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:57.367532 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 74985us
I20260709 12:22:57.368218  1134 consensus_queue.cc:1059] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:57.369174  1134 raft_consensus.cc:3055] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:57.369562  1134 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:57.370443  1134 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:57.371407  1134 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:57.358047  1210 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.367492 30929 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:22:57.376818 30929 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 4. Current term is 5. Ops: []
I20260709 12:22:57.378043 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.378820 30779 raft_consensus.cc:2393] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:22:57.380026  1057 consensus_meta.cc:287] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.943s	user 0.010s	sys 0.001s
I20260709 12:22:57.380801 30777 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:57.381670  1128 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:57.382217  1262 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:22:57.382270  1128 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.381912 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:57.383430  1269 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:22:57.384194  1251 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:57.383113  1222 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.920s	user 0.000s	sys 0.003s
I20260709 12:22:57.381568 30779 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:57.368453 30825 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.367440 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:57.396353 30932 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:22:57.376643  1051 consensus_meta.cc:287] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.000s
I20260709 12:22:57.295531  1065 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:57.402591  1193 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.002s
I20260709 12:22:57.404165  1219 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:57.407133 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 357) took 1253 ms. Trace:
I20260709 12:22:57.408098 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 302) took 1786 ms. Trace:
I20260709 12:22:57.411823 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 355) took 1279 ms. Trace:
W20260709 12:22:57.424283 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.417197  1256 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:22:57.422034 30730 auto_rebalancer.cc:893] Removing replace marker failed: Replica 47c0d0bc235a443aad3c62643e91b081 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:57.350198  1241 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.421412  1156 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:57.319204  1122 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.398777  1217 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:57.420277  1243 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:57.421623 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 53246.7us
I20260709 12:22:57.434856 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.435503 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.427058 30931 rpcz_store.cc:276] 0709 12:22:55.621940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.013627 (+391687us) service_pool.cc:224] Handling call
0709 12:22:56.032897 (+ 19270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.927339 (+894442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.407834 (+480495us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54001c75d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:57.408031 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591273216}
I20260709 12:22:57.427928 30784 rpcz_store.cc:276] 0709 12:22:56.132349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.132467 (+   118us) service_pool.cc:224] Handling call
0709 12:22:56.754829 (+622362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.767568 (+ 12739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.411590 (+644022us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400121bd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:57.411755 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378874112}
W20260709 12:22:57.394065  1171 consensus_meta.cc:287] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.655s	user 0.018s	sys 0.000s
I20260709 12:22:57.426915 30781 rpcz_store.cc:276] 0709 12:22:56.153704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.154685 (+   981us) service_pool.cc:224] Handling call
0709 12:22:56.155066 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.728106 (+573040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.406824 (+678718us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54001a6b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:57.407057 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176645504}
I20260709 12:22:57.431233 31506 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:22:57.433672 30730 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:22:57.436658 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:57.441393 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 257500us
I20260709 12:22:57.442862 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.443593 30825 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.445386 30825 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:57.439460 30730 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:22:57.334923  1140 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:57.448894 30785 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:57.463182 30825 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.461162 30784 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:22:57.464555 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.464660 30784 raft_consensus.cc:606] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:57.468731 30825 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.428378  1169 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:57.422667  1121 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:57.475056  1204 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.475736 30781 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:57.413906  1051 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.422422  1188 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.463109  1140 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:57.460671  1156 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.460400  1217 raft_consensus.cc:697] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:22:57.489933 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.470402  1157 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.470400  1241 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.465521  1275 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:57.424126  1210 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.504858 30935 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:57.447461  1171 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:57.507984 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:57.491683  1169 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.513504 30825 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.515793  1188 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:57.517382  1122 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:57.518999  1219 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:57.523764  1065 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:57.524972  1217 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:57.527302 30858 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:57.504354  1277 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:57.530620 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1388) took 3895 ms. Trace:
I20260709 12:22:57.531592  1051 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:57.532490 30668 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 47c0d0bc235a443aad3c62643e91b081 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:57.533051  1210 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:57.538401 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1470) took 1495 ms. Trace:
I20260709 12:22:57.538913 30777 rpcz_store.cc:276] 0709 12:22:56.043061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.043206 (+   145us) service_pool.cc:224] Handling call
0709 12:22:56.043574 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.381138 (+1337564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.538098 (+156960us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540008bbd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:57.538319 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3074520320}
I20260709 12:22:57.540448  1243 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:57.545948 30784 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:57.546684 30784 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:57.531040 30855 rpcz_store.cc:276] 0709 12:22:53.634879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.905264 (+2270385us) service_pool.cc:224] Handling call
0709 12:22:55.905597 (+   333us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:22:56.511538 (+605941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:56.511568 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:22:56.542093 (+ 30525us) log.cc:844] Serialized 78 byte log entry
0709 12:22:56.799445 (+257352us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:56.851029 (+ 51584us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.853462 (+  2433us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.853811 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.853989 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.375097 (+521108us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800383e60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:57.385632 (+ 10535us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b1800383e60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:22:57.529442 (+143810us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800383e60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9002a6 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419
0709 12:22:57.530259 (+   817us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54004380d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:57.530315 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:57.530366 (+    51us) raft_consensus.cc:1685] finished
0709 12:22:57.530380 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:57.530534 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45295,"prepare.queue_time_us":1097630,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":31169,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":50947,"spinlock_wait_cycles":1400792704,"thread_start_us":201833,"threads_started":1,"wal-append.queue_time_us":361098}
I20260709 12:22:57.549064  1171 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:22:57.559593  1027 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:57.565984 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:22:57.567776  1244 consensus_meta.cc:287] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:22:57.568635 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:57.568274  1244 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:57.569597 30854 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:56.928370 30927 rpcz_store.cc:276] 0709 12:22:55.733824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.191738 (+457914us) service_pool.cc:224] Handling call
0709 12:22:56.323326 (+131588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.323611 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:56.574692 (+251081us) log.cc:844] Serialized 14 byte log entry
0709 12:22:56.874086 (+299394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:56.874151 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:56.874208 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:56.874270 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:56.874414 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":362824,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1812,"raft.queue_time_us":13592,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":33238,"thread_start_us":502891,"threads_started":2}
I20260709 12:22:57.574973 30859 raft_consensus.cc:3055] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:57.575546 30859 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:57.576651 30859 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.580899  1140 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.573294  1246 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:57.586481 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:57.588086  1128 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:57.591377  1140 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:57.581552  1120 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:22:57.595036  1244 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:57.596760  1246 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:57.547894 30784 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.601068 30784 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.605630 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:57.610486 30859 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.604192 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:57.573295   827 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.622550 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:57.620947 30927 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
W20260709 12:22:57.619361 30750 leader_election.cc:336] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.540s (SENT)
I20260709 12:22:57.618037 30929 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:57.624166 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:57.625830 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:57.639361 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 174875us
I20260709 12:22:57.641642 30777 pending_rounds.cc:85] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:22:57.642225 30777 pending_rounds.cc:107] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:22:57.642530 30777 raft_consensus.cc:2889] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:22:57.642978 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 129568us
I20260709 12:22:57.642971 30777 pending_rounds.cc:107] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:22:57.644096 30777 raft_consensus.cc:2889] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:57.644629 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.646858  1275 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.649125 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.649832 30825 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.652127 30825 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:57.657609 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.643239  1134 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:57.664707 30825 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.666860 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:57.669744 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.648345  1171 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:57.650349  1246 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.674998 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:57.676348  1283 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:22:57.677811 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:57.678342  1148 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:22:57.647503  1275 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.682209 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:57.683498 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:57.683768  1275 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:57.684491  1188 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:57.684963  1188 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:57.685361  1188 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.689106  1251 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:57.690006  1251 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.691933 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.696993  1052 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:22:57.663341  1244 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.697640  1052 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:57.699517  1052 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.701202 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:57.709419 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:57.711467 30678 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 204) took 18612 ms (client timeout 15000 ms). Trace:
W20260709 12:22:57.717119 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 50335.2us
I20260709 12:22:57.718565 30825 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.720391 30784 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:22:57.723336 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.667068  1157 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.665434  1140 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:57.737558 30825 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.666553  1243 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.062s
W20260709 12:22:57.712110 30678 rpcz_store.cc:269] 0709 12:22:39.061584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:39.061827 (+   243us) service_pool.cc:224] Handling call
0709 12:22:57.673996 (+18612169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:22:49.512376 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:22:49.738717 (+226341us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:22:49.756645 (+ 17928us) write_op.cc:435] Acquired schema lock
0709 12:22:49.769586 (+ 12941us) tablet.cc:662] Decoding operations
0709 12:22:49.884088 (+114502us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:22:49.884176 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:22:49.884203 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:22:50.031498 (+147295us) tablet.cc:701] Row locks acquired
0709 12:22:50.031571 (+    73us) write_op.cc:260] PREPARE: finished
0709 12:22:50.031750 (+   179us) write_op.cc:270] Start()
0709 12:22:50.031914 (+   164us) write_op.cc:276] Timestamp: P: 1783599770031686 usec, L: 0
0709 12:22:50.031931 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:22:50.034834 (+  2903us) log.cc:844] Serialized 4867 byte log entry
0709 12:22:50.460478 (+425644us) op_driver.cc:464] REPLICATION: finished
0709 12:22:50.682435 (+221957us) write_op.cc:301] APPLY: starting
0709 12:22:50.682534 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:22:50.682811 (+   277us) tablet.cc:1370] finished BulkCheckPresence
0709 12:22:50.682942 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:22:51.256186 (+573244us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b5c001e990c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9616c11331 00007f9616c11221 00007f9616c0bf6c 00007f961436c30b 00007f961436bfd3 00007f961446ae34 00007f961445697c 00007f961445ad61 00007f961445ad19 00007f961445aca9 00007f961445ac71
0709 12:22:51.256638 (+   452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:22:51.257073 (+   435us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:22:51.257139 (+    66us) write_op.cc:312] APPLY: finished
0709 12:22:51.257585 (+   446us) log.cc:844] Serialized 88 byte log entry
0709 12:22:51.274296 (+ 16711us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:51.274573 (+   277us) write_op.cc:454] Released schema lock
0709 12:22:51.274650 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:22:51.326974 (+ 52324us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:22:51.329922 (+  2948us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":52932,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":221651,"apply.run_cpu_time_us":27271,"apply.run_wall_time_us":635952,"num_ops":12,"prepare.queue_time_us":205665,"prepare.run_cpu_time_us":25299,"prepare.run_wall_time_us":635869,"raft.queue_time_us":315782,"raft.run_cpu_time_us":23811,"raft.run_wall_time_us":228333,"replication_time_us":428369,"spinlock_wait_cycles":16212352,"thread_start_us":521855,"threads_started":4,"wal-append.queue_time_us":40108,"wal-append.run_cpu_time_us":79270,"wal-append.run_wall_time_us":2273499}]]}
I20260709 12:22:57.728482  1251 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:57.726274  1051 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:22:57.743391  1282 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:22:57.751586 30825 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.740088  1283 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:22:57.763888 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 47914.9us
W20260709 12:22:57.769002 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.785879  1140 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.786123  1171 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.787745 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.790192  1281 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.796350  1171 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.796636  1281 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.798960  1171 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:57.799180  1281 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:57.748134  1251 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:57.799778  1251 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.797405 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.794481 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.806275 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.750773  1051 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:57.808027 30855 raft_consensus.cc:2393] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:57.751413  1243 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:57.812037 30853 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:57.814919 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.815737 30859 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:57.814086 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.809217  1051 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:57.818920 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.821241 30855 raft_consensus.cc:2376] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8. Re-sending same reply.
I20260709 12:22:57.821290 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.822253 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.823153 30855 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.825590 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.826838 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.827405 30859 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:22:57.828292 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.828806 30859 raft_consensus.cc:2376] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:22:57.831032 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.831709 30851 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:22:57.832584 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.834000 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.834263 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 313) took 1798 ms. Trace:
I20260709 12:22:57.834630 30930 rpcz_store.cc:276] 0709 12:22:56.035517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.436143 (+400626us) service_pool.cc:224] Handling call
0709 12:22:56.874398 (+438255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:56.949592 (+ 75194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.834084 (+884492us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54002baa50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:57.834207 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950760832}
I20260709 12:22:57.835054 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.836095 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.836314 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1634) took 1066 ms. Trace:
I20260709 12:22:57.836678 30933 rpcz_store.cc:276] 0709 12:22:56.770095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.773579 (+  3484us) service_pool.cc:224] Handling call
0709 12:22:57.063031 (+289452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:57.096049 (+ 33018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.836139 (+740090us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540027cc50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:57.836258 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615568768}
I20260709 12:22:57.837141 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.840276 30934 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:22:57.833669 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.842164 30851 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:57.842286 30853 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:57.829613 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.855427 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.856139 30855 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:57.861666 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.863274 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.851282  1157 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.868646  1251 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.870317  1117 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:57.871102  1251 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:57.870987  1117 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.873185  1117 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:57.874118  1135 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:57.866667 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:57.869553 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 239949us
I20260709 12:22:57.865093 30853 raft_consensus.cc:2376] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6. Re-sending same reply.
I20260709 12:22:57.878443 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:57.879025 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.876929 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:57.879930 30855 raft_consensus.cc:2410] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:22:57.876212 30750 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.636s (SENT)
I20260709 12:22:57.882059 30851 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:57.883301 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.883921 30851 raft_consensus.cc:2376] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8. Re-sending same reply.
W20260709 12:22:57.884109 30750 leader_election.cc:336] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.674s (SENT)
I20260709 12:22:57.884756 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:57.886237 30750 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.699s (SENT)
I20260709 12:22:57.887777 30930 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: [5.2-7.3]
I20260709 12:22:57.880002 30929 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:22:57.890401 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.891765 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.898149 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:57.891242 30750 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.784s (SENT)
I20260709 12:22:57.900725 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:57.901875 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.902663 30927 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:57.903463 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.904449 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.905022 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.905514 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.906790 30826 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.907655 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.908756 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.908780 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:57.909498 30859 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:57.901364 30855 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:57.889515  1027 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:22:57.911597 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.863775  1188 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:57.913440 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:57.914220 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.916105 30853 raft_consensus.cc:2410] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:22:57.912768 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:57.915931 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:57.919229 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:22:57.920403 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.920552 30927 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:57.920845 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:57.921030 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.922094 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:57.908960  1243 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:57.923918  1216 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 1.460s	user 0.005s	sys 0.000s
I20260709 12:22:57.924620 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:57.925197 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 334) took 1168 ms. Trace:
I20260709 12:22:57.925482 30859 raft_consensus.cc:2410] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:22:57.925593 30854 rpcz_store.cc:276] 0709 12:22:56.756554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.756763 (+   209us) service_pool.cc:224] Handling call
0709 12:22:56.786537 (+ 29774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.570196 (+783659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:57.924987 (+354791us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54004367d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:57.925141 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800232192}
I20260709 12:22:57.927248 30854 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:22:57.924135  1188 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:57.913457  1140 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:22:57.941304 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.950366 30853 raft_consensus.cc:1275] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:22:57.964417 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.991734 30855 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:22:57.912355  1157 consensus_queue.cc:1059] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:22:57.919157  1281 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.070375 31506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42836 (request call id 230) took 1099 ms. Trace:
I20260709 12:22:58.070978 31506 rpcz_store.cc:276] 0709 12:22:56.971240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.971393 (+   153us) service_pool.cc:224] Handling call
0709 12:22:58.070136 (+1098743us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54004f92d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:58.070294 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958508800}
W20260709 12:22:58.074683 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.076270 30853 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:58.078310  1157 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:58.078779  1157 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:58.079586  1157 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.080839  1157 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.084692  1051 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:57.934636  1027 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.154s
I20260709 12:22:58.087371  1027 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:58.087738  1027 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.088553  1027 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.089917  1027 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:22:58.090785 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:57.931459  1171 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:57.931094  1140 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:57.933547 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:22:58.105645 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 172148us
I20260709 12:22:58.111162 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:58.068372  1283 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:22:58.094023  1140 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:58.132853  1068 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:58.133791  1068 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:58.134114  1068 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.134869  1068 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.135514 30927 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:58.136010  1068 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:58.137814 30855 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:22:58.139071 30855 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:22:58.140053 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1599) took 1013 ms. Trace:
I20260709 12:22:58.140436 30858 rpcz_store.cc:276] 0709 12:22:57.127080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.232502 (+105422us) service_pool.cc:224] Handling call
0709 12:22:58.139876 (+907374us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400075b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:58.139994 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601803008}
I20260709 12:22:58.150135 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:22:58.151594 30926 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:58.125561  1217 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:58.131325 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:58.151276  1128 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:58.131054  1134 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:22:58.170663  1070 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:58.171217  1070 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.172135  1070 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:22:58.177350 30934 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1652) took 1287 ms (client timeout 1669 ms). Trace:
W20260709 12:22:58.177834 30934 rpcz_store.cc:269] 0709 12:22:56.889912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.109295 (+219383us) service_pool.cc:224] Handling call
0709 12:22:58.177159 (+1067864us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54002643d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:58.177278 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524119424}
I20260709 12:22:58.179584 30825 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:22:58.184265 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.185582 30855 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:22:58.188699  1293 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:22:58.169389  1174 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:22:58.200251 30857 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:22:58.191013 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:58.197005 31477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.203851 30930 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.196117  1171 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:22:58.195678  1210 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.221191 30855 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:58.187112  1128 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.213982  1009 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:58.199230  1186 consensus_queue.cc:1059] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:22:58.218878  1232 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.209852  1243 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:22:58.251015 30930 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
W20260709 12:22:58.266230 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48990.2us
I20260709 12:22:58.266283 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:58.267406 30933 raft_consensus.cc:2393] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:22:58.272302 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:58.228479  1210 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.258344  1051 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:58.261366  1243 consensus_queue.cc:1243] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:22:58.290779 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:22:58.287380  1265 raft_consensus.cc:3055] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:58.252799  1232 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.286223  1275 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:58.290072  1210 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:58.303378  1265 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:58.263216  1186 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:58.297710  1171 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:22:58.296656  1217 raft_consensus.cc:697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.313066  1275 raft_consensus.cc:697] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:58.322434  1275 consensus_queue.cc:237] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:58.323354  1220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:22:58.323611  1287 log.cc:927] Time spent T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.616s	user 0.000s	sys 0.031s
I20260709 12:22:58.311269  1297 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:22:58.320232  1265 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.330369  1265 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.330408  1300 raft_consensus.cc:3055] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:58.330778  1232 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:58.331589  1300 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:58.321657  1299 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:22:58.332937  1300 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.335188  1300 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.336992  1281 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:22:58.366921 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 197763us
W20260709 12:22:58.382889 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.396294 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:58.396732 30933 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:58.395992 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:58.397646 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1639) took 1625 ms. Trace:
I20260709 12:22:58.404119  1299 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:22:58.404431  1217 consensus_queue.cc:237] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:58.405236  1302 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:22:58.398319 30928 rpcz_store.cc:276] 0709 12:22:56.772055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.267269 (+495214us) service_pool.cc:224] Handling call
0709 12:22:57.267551 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.267745 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:22:57.473051 (+205306us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.307487 (+834436us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b180027e920. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf 00007f9610a39038
0709 12:22:58.376300 (+ 68813us) log.cc:844] Serialized 14 byte log entry
0709 12:22:58.377105 (+   805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:58.377267 (+   162us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:22:58.377475 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.377689 (+   214us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.397401 (+ 19712us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24672,"prepare.queue_time_us":851786,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":16032,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6226,"spinlock_wait_cycles":9592704,"thread_start_us":405897,"threads_started":2,"wal-append.queue_time_us":275079}
I20260709 12:22:58.432910 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:58.443177  1303 consensus_queue.cc:1059] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:58.460398  1296 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:58.506735  1275 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:58.507933  1275 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.320262  1128 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:22:58.528258 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.582233  1128 consensus_queue.cc:1059] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:58.583120  1304 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:22:58.529043  1171 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:22:58.589986  1070 raft_consensus.cc:3055] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:58.594291  1070 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.533938 30858 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:22:58.615665 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 230000us
I20260709 12:22:58.622139  1040 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:58.631938 30931 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:58.633813  1171 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:58.652742  1040 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.655692  1040 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:58.657354  1171 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:58.658057  1068 consensus_meta.cc:287] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.014s
I20260709 12:22:58.660647  1171 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:58.684478  1140 consensus_meta.cc:287] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.016s
W20260709 12:22:58.686013 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 87562.7us
I20260709 12:22:58.687342  1304 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:58.663523  1275 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:58.699841  1275 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:58.703605 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1471) took 2659 ms. Trace:
I20260709 12:22:58.693254  1308 consensus_queue.cc:1059] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:58.695218  1307 raft_consensus.cc:993] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: : Instructing follower 47c0d0bc235a443aad3c62643e91b081 to start an election
I20260709 12:22:58.697508 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:58.706516 30855 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 5.
I20260709 12:22:58.704161 30782 rpcz_store.cc:276] 0709 12:22:56.044483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.044637 (+   154us) service_pool.cc:224] Handling call
0709 12:22:56.044979 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.732120 (+1687141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:57.732169 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:22:57.732241 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:22:57.732298 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.703040 (+970742us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540005e954. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:58.703110 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:58.703350 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3946,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5090,"spinlock_wait_cycles":3870302080}
I20260709 12:22:58.705806  1307 raft_consensus.cc:1081] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Signalling peer 47c0d0bc235a443aad3c62643e91b081 to start an election
I20260709 12:22:58.688097 30927 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:22:58.716334 30852 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:58.716646 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:58.717842 30853 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:58.718362 30853 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:58.719554 30853 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.720706  1027 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:58.723939 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:58.725081 31506 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:22:58.728122 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:58.729179 30783 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:22:58.716871 30852 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:22:58.731454 30852 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.733240 30852 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.736449 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:58.738967  1232 raft_consensus.cc:3055] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:58.739445  1232 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:58.719585  1068 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:22:58.741205  1068 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.742604  1068 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:58.743886  1157 consensus_meta.cc:287] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.015s
I20260709 12:22:58.745934 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:22:58.746754 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 56301.7us
I20260709 12:22:58.751771 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1417) took 1502 ms. Trace:
I20260709 12:22:58.752183 30781 rpcz_store.cc:276] 0709 12:22:57.249142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.437728 (+188586us) service_pool.cc:224] Handling call
0709 12:22:57.438107 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:57.478426 (+ 40319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.751282 (+1272856us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54003dbb54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:22:58.751576 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86086528}
I20260709 12:22:58.748895 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:22:58.750610 31477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.776098 30929 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:58.705323  1308 raft_consensus.cc:3055] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:58.754220  1295 raft_consensus.cc:3055] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:22:58.780534 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:58.794092 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:58.794224  1281 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:22:58.795428  1135 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.795868 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.807209 30935 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1642) took 2034 ms (client timeout 1664 ms). Trace:
I20260709 12:22:58.808202 30930 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:22:58.813140  1254 consensus_queue.cc:1059] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:22:58.819756 30935 rpcz_store.cc:269] 0709 12:22:56.773032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:56.855695 (+ 82663us) service_pool.cc:224] Handling call
0709 12:22:58.806710 (+1951015us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54002639d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:58.806984 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218310528}
W20260709 12:22:58.830720 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 84927.6us
I20260709 12:22:58.817294  1295 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.816262  1308 raft_consensus.cc:740] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:58.834082 31477 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:58.838452 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.839975 30783 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:58.740597  1232 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.685034  1140 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.872388  1040 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.873188  1040 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.875003  1265 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:22:58.876654  1040 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:22:58.882860 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.886415 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 167423us
I20260709 12:22:58.893282 30852 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:22:58.867013  1281 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.904090  1275 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.905450  1297 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:22:58.906028  1275 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.850816  1135 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.903550 30851 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:58.893884 30852 pending_rounds.cc:85] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 4
W20260709 12:22:58.917228 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.911550 30852 pending_rounds.cc:107] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:22:58.921886 30852 raft_consensus.cc:2889] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:58.904008  1300 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:58.904032  1246 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.882077  1070 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.900525  1254 consensus_queue.cc:1059] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:22:58.941073 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1598) took 1811 ms. Trace:
W20260709 12:22:58.943773 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:58.945369  1186 consensus_meta.cc:287] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.009s
W20260709 12:22:58.948197  1007 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:22:58.937232  1300 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.955431 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:58.956440 30856 raft_consensus.cc:2376] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8. Re-sending same reply.
I20260709 12:22:58.959832  1148 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:22:58.963410  1135 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:58.964723  1232 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:58.965013  1140 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:58.967216 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1436) took 1148 ms. Trace:
I20260709 12:22:58.967690 30851 rpcz_store.cc:276] 0709 12:22:57.819793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.912656 (+ 92863us) service_pool.cc:224] Handling call
0709 12:22:58.966931 (+1054275us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54003796d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:58.967113 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2261271808}
I20260709 12:22:58.970546  1281 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.972635  1134 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:58.973241  1281 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:58.973318  1134 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:58.944049 30852 rpcz_store.cc:276] 0709 12:22:57.126879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:57.295049 (+168170us) service_pool.cc:224] Handling call
0709 12:22:57.313695 (+ 18646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.716026 (+1402331us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400169ca0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610996dc0 00007f9610a211c0 00007f9610a22231 00007f9610a1ed8f 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c
0709 12:22:58.934306 (+218280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:58.938151 (+  3845us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370000256}
I20260709 12:22:58.975605 30853 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:58.976450 30857 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
W20260709 12:22:58.990268 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.001004 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 130838us
I20260709 12:22:59.002723  1275 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:58.988051  1300 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:22:59.013630 31477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:58.961048  1308 consensus_queue.cc:260] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:58.974228  1210 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.036037 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:59.033227 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:59.039857 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:59.034191 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.042582 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:59.031212  1070 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:58.974419  1246 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:59.072582 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 57061.4us
I20260709 12:22:59.080149 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:58.976873  1295 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.082938 30931 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:59.103394 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:59.113490 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 82629.7us
W20260709 12:22:59.117120 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.123538 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:59.128218 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.128602 30783 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.126922 30856 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:59.129794 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:59.074280  1210 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:59.142805 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.163470 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 207689us
I20260709 12:22:59.163719 30851 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:22:59.136179  1308 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:59.144922  1295 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.170253 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.170993 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:22:59.171448 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 363704us
I20260709 12:22:59.171839 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:59.172595  1303 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:22:59.172839  1314 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:22:59.174649  1309 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.175506  1322 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:59.177891 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 157430us
I20260709 12:22:59.159924  1186 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59738 (request call id 6) took 3272 ms. Trace:
I20260709 12:22:59.164923 30934 raft_consensus.cc:2955] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:59.190963 30854 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:22:59.194088 31477 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:59.201436 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 63863us
I20260709 12:22:59.192094  1303 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:59.235737  1220 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:59.241927  1328 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:59.242218  1134 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:59.205307  1186 rpcz_store.cc:276] 0709 12:22:55.872284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:55.881457 (+  9173us) service_pool.cc:224] Handling call
0709 12:22:55.895760 (+ 14303us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54005d3ca0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961099c520 00007f9610a25b42 00007f9610a24800 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54 00007f960ef61be2 00007f960ef61b11 00007f960ef61a8c 00007f960ef60d42
0709 12:22:55.907219 (+ 11459us) log.cc:844] Serialized 501 byte log entry
0709 12:22:59.134601 (+3227382us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8918,"raft.run_cpu_time_us":1192,"raft.run_wall_time_us":1192,"spinlock_wait_cycles":27263744}
I20260709 12:22:59.234519  1297 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:59.249018 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:59.256482 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.260304 30782 raft_consensus.cc:2410] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:22:59.204792  1309 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.264353 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.266239 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:59.266834  1220 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:59.272985  1311 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.328s	user 0.004s	sys 0.000s
I20260709 12:22:59.274449  1220 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.275867 30854 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:22:59.261999  1297 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.266251 30853 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 12:22:59.270840  1313 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:22:59.271697 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.277916 30853 pending_rounds.cc:85] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 4
I20260709 12:22:59.280892 30783 raft_consensus.cc:2410] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:22:59.281114 30853 pending_rounds.cc:107] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:22:59.281459 30853 raft_consensus.cc:2889] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:59.287679  1134 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.288736  1134 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.279124  1297 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:22:59.310561 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 47266.5us
W20260709 12:22:59.314972 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 102263us
I20260709 12:22:59.319052 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1605) took 1516 ms. Trace:
I20260709 12:22:59.319607 30853 rpcz_store.cc:276] 0709 12:22:57.802888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.077252 (+274364us) service_pool.cc:224] Handling call
0709 12:22:58.077552 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.717554 (+640002us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b5400282920. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610996dc0 00007f9610a211c0 00007f9610a22231 00007f9610a1ed8f 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c
0709 12:22:58.975123 (+257569us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b580059fcd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961097b0aa 00007f96109fd447 00007f9610a15fe7 00007f9610a177de 00007f9610a21b49 00007f9610a22416 00007f9610a1ed8f 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4
0709 12:22:59.291202 (+316079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.318984 (+ 27782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":485144704}
I20260709 12:22:59.233620  1322 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:59.327596 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.329059 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1bb0331e5b641b99a413ba3e4475499 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 12:22:59.329293 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.329891  1334 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.311100  1220 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.355299 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:59.329141  1245 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:22:59.362823 30776 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:59.370695 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:59.382659 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1351) took 1109 ms. Trace:
I20260709 12:22:59.383231 30930 rpcz_store.cc:276] 0709 12:22:58.273284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:58.273423 (+   139us) service_pool.cc:224] Handling call
0709 12:22:58.807802 (+534379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:22:58.835811 (+ 28009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:59.382400 (+546589us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54002639d0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:22:59.382586 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196367744}
I20260709 12:22:59.385902  1134 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.386893 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.388074 30780 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:22:59.396790 30857 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:59.316530  1328 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.404953 30784 raft_consensus.cc:3055] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:59.372324  1303 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.409430 30784 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:59.398937  1336 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.413703  1303 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.420708 30680 catalog_manager.cc:5697] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 3 to 6, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 6 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:59.446676  1336 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.447744 30680 catalog_manager.cc:5697] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 3 to 5, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 5 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:22:59.414197  1299 raft_consensus.cc:3055] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:22:59.450011  1299 raft_consensus.cc:740] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:59.450099  1281 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.450837 30781 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:22:59.451318  1299 consensus_queue.cc:260] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.452539  1299 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.452777  1246 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.416507 30784 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.454342 30784 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.455212  1134 consensus_queue.cc:1059] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:22:59.456220  1134 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:22:59.456589  1134 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:22:59.454792  1065 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.458344  1065 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:22:59.461687  1065 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:59.418346  1328 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.418735 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:59.488515  1303 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:59.489997 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 71366.4us
I20260709 12:22:59.489809  1303 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.434396  1309 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.436156  1007 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.492892 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.492972  1007 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.493964 30781 raft_consensus.cc:2410] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:22:59.493537 30680 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 3 to 4, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 4 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:59.442011  1319 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.493s	user 0.003s	sys 0.001s
I20260709 12:22:59.443286  1322 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.462113  1210 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.373560  1220 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.496133  1007 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.496958  1220 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.463266  1027 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:59.449534  1336 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.463578  1296 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:59.499105  1303 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.468942  1300 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.457517  1134 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.417907  1334 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.494798  1065 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.504254  1300 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:22:59.409962  1148 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.450855  1281 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.504948  1148 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.506474  1281 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.507148  1148 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:59.488511 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.490868 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.508409 30780 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:59.491099 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:59.431646  1174 raft_consensus.cc:3055] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:22:59.509357  1174 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:22:59.501602  1134 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.510402  1174 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.512008  1148 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:22:59.518213  1174 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.519703 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:59.520848  1341 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.485530 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:22:59.492121 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:59.439512  1323 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.246s	user 0.000s	sys 0.002s
I20260709 12:22:59.504160  1334 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:59.482687 30784 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:22:59.534796 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.590785 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.602932 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 117494us
W20260709 12:22:59.609951 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:22:59.649155 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 294344us
I20260709 12:22:59.541875 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:22:59.647008 30680 catalog_manager.cc:5697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.639734 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:22:59.664054 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 386814us
I20260709 12:22:59.665129 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:22:59.668076 31477 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.541896  1281 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.577329  1070 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:22:59.671356 30934 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:22:59.690358 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:59.544883  1341 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:22:59.687880 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 227453us
I20260709 12:22:59.688999 30857 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:22:59.624665  1220 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.696223 30930 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:22:59.639122  1347 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.694353 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:59.700659 30851 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.701385 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:59.698745  1299 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.675113  1007 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.687227  1339 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:59.703593 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.688017  1322 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:59.707471 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 165875us
I20260709 12:22:59.705667 30931 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:22:59.648794  1297 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.707062 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.688162  1328 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.692343  1210 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.712067 30899 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:22:59.693809  1070 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:22:59.692549  1245 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.699759  1148 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:59.715771 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.695879 30680 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 4 to 6, now has a pending config: VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 6 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:22:59.721073 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:22:59.688499  1281 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.722105 30930 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:59.721134  1007 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.728653 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.729909 30854 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:22:59.733325  1007 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:22:59.725865  1334 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:22:59.734032  1334 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:22:59.734510  1334 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:22:59.735949 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:59.722205 30932 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:59.736622 31508 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:22:59.742429 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.743132 30931 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:59.746249  1007 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.746989  1007 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.747968  1295 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.742039  1245 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.801208 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.714295  1322 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.828936  1322 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:22:59.755486 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.771868 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:22:59.831209 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 104804us
I20260709 12:22:59.832870 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:59.834062   827 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:22:59.834923   827 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:22:59.835479   827 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:22:59.835387 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.836488 30930 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:22:59.836737   827 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.838869 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.789592 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:22:59.840257 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 50783.5us
I20260709 12:22:59.720819  1070 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:22:59.774930 30783 raft_consensus.cc:1240] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
I20260709 12:22:59.776696  1328 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:59.778266 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 50064.6us
I20260709 12:22:59.778848 30934 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
W20260709 12:22:59.789642 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.803926 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:22:59.804396 30779 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:22:59.849933 30779 pending_rounds.cc:85] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 5
I20260709 12:22:59.850277 30779 pending_rounds.cc:107] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:22:59.850553 30779 raft_consensus.cc:2889] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:22:59.806043 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.704583  1347 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:22:59.806433  1246 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:22:59.808215  1245 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.788187  1295 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.808602 30680 catalog_manager.cc:5697] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 4 to 5, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 5 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.811364  1281 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.813284  1007 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.814054 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.814673 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:22:59.704716  1220 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:22:59.884302 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 84108.2us
I20260709 12:22:59.826594  1065 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:22:59.717312  1299 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:22:59.851534 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:59.869269 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:22:59.891361 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.872180 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.892441 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.744724  1210 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.876998 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.877983 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.878123 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:59.874136 30782 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 10.
W20260709 12:22:59.818037 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 119087us
I20260709 12:22:59.886406 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.852303  1275 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:59.886229 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.895429 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:22:59.878825 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.893108 30928 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:59.902856 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:22:59.912554 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:22:59.906423 30931 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:22:59.897145  1337 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:59.927663 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:22:59.931938 30858 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.897523  1275 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:22:59.939556 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 99419.8us
I20260709 12:22:59.911278  1065 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:22:59.942550 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.945205  1347 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.906137  1303 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.946287  1303 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.948462  1303 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.951234 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:22:59.952083 30926 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 10.
I20260709 12:22:59.915202  1339 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:22:59.954108  1339 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:22:59.954514  1339 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:22:59.935210 30825 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:22:59.910619  1007 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:22:59.898134  1246 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.002497 30856 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:00.004225  1246 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:22:59.909255  1245 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:22:59.916083  1281 consensus_queue.cc:1059] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:23:00.007683  1220 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.027137  1295 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:00.027791  1356 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:00.028522  1328 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.030975  1299 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.032183  1070 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:22:59.956022  1275 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.034045  1210 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.035104  1070 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.009497  1007 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:00.036266 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:00.038223 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 134489us
I20260709 12:23:00.039819 31506 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:22:59.930867  1337 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:00.040695 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:00.045923 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 114555us
I20260709 12:23:00.054760 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.055265 30826 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:00.062997 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.055711 30932 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:00.036008  1007 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.062117 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:23:00.066018 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 154320us
I20260709 12:23:00.037268  1297 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.059316 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.069831  1299 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:00.070466 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 129036us
I20260709 12:23:00.052954  1337 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.084178 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.084859 30926 raft_consensus.cc:3060] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.086725 30858 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:00.077309 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.078343 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.088883 30932 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:00.079747 30851 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:23:00.051663  1245 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.064932  1210 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.067492  1328 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.096246 30826 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.097568 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:00.102033 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:00.077107  1299 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.107719 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:00.109298 30784 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:00.112007 30680 catalog_manager.cc:5697] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 6 to 7, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 7 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:00.148003 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 51909.3us
I20260709 12:23:00.144618 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:00.150827 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:00.099468  1210 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.103820  1246 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.152081 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.104656  1328 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:00.156924  1328 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.157861  1246 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:00.158394  1246 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.158771  1361 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:00.159241  1361 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.159552  1361 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.111476  1299 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.166492 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:00.154662 31477 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:00.167733 30858 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:00.168236 31477 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.170656 30851 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:00.154153 30680 catalog_manager.cc:5697] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 2 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:00.166800  1210 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.169987  1281 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.167969  1245 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:00.178980 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.168335  1186 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.170533  1148 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:00.182358 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 82136.8us
I20260709 12:23:00.172113  1297 raft_consensus.cc:2804] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:00.172503  1300 raft_consensus.cc:2804] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:00.183866 30680 catalog_manager.cc:5697] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 2, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:00.182114 31477 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:23:00.186401 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.186703 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:00.188602 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.191391 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.180647  1281 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.191226 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.183606  1186 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.189640  1336 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:00.204749 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 300386us
I20260709 12:23:00.190002  1297 raft_consensus.cc:697] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:00.195621  1281 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.198529  1186 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.194380  1300 raft_consensus.cc:697] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:00.204001  1336 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.227572  1337 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.230316 30825 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.234154 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:00.206748  1174 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:00.223655  1365 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.233896  1336 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.239319  1365 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.202706  1334 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.261654 30935 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:00.246846  1365 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.295693  1007 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.258411  1245 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:00.298686  1245 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.290817  1134 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:00.302006 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 75888.1us
I20260709 12:23:00.302958 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.303581  1275 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:00.316417 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.317974  1070 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.320206  1370 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.320873  1070 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.293013  1297 consensus_queue.cc:237] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.323522 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.328960 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.321026  1370 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.362047 30929 raft_consensus.cc:1240] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:00.363706 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.364645 30928 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.318348   827 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:00.364675 30926 raft_consensus.cc:2468] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:00.302053  1134 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:00.369019 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 228224us
I20260709 12:23:00.321687  1334 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:00.322715  1337 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.323736  1369 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.323015  1070 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:00.356280  1007 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.359066  1366 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:23:00.374740 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 144596us
I20260709 12:23:00.382685  1374 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.383370  1378 consensus_queue.cc:1059] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:00.383330  1374 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.370473  1148 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:23:00.386971 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 84144.7us
I20260709 12:23:00.388785 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:00.387358 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.389184 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:00.389581 30858 raft_consensus.cc:2393] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 7: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:00.390017 31506 raft_consensus.cc:2393] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:23:00.350513  1299 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.370918  1220 raft_consensus.cc:3055] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:00.381413  1369 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.396339  1365 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.396546  1246 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.375700  1328 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.398237 30825 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.398689 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:00.391371  1339 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.403451  1186 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.376398  1371 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.316365  1300 consensus_queue.cc:237] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.406657  1220 raft_consensus.cc:740] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:00.409998 30928 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:00.411453 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:00.381916  1070 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:00.384833   827 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:00.388578  1275 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:00.408339  1370 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.451030 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.451673  1065 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.452261  1299 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.452278  1065 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.454528 30826 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.455940 30928 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:00.437520  1337 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:23:00.460045 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 61926.5us
I20260709 12:23:00.458900 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.463913 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:00.466285 30778 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.460417  1065 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:00.462360 30932 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:00.461778 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:00.422150  1336 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:00.475239 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 60748.7us
I20260709 12:23:00.450736  1378 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:23:00.476691 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.441254  1070 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.486299 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.487004 30929 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:00.487779  1070 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:00.485234 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 49992.2us
I20260709 12:23:00.491061 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.491066 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.464531  1366 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:00.521407  1366 raft_consensus.cc:697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:00.494405 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.523053 30930 raft_consensus.cc:2410] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:00.524211 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:00.526029 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.527974 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:00.535941  1377 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.536829  1377 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.538887  1210 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.540083  1303 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.540604  1303 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.541853 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:00.543157  1295 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:00.543838  1295 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:00.544245  1295 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.545969  1296 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:00.542759  1303 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.548565  1378 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.549181  1378 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.549597  1378 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.558751  1295 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.561090  1295 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.500725  1186 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.501391 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:00.502126  1134 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.501932  1220 consensus_queue.cc:260] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.504733  1281 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.508663  1374 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.511794  1246 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.438887  1371 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.515383  1365 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.461488  1376 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:00.519613  1328 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.490341  1369 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.539507  1377 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.561652 30778 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:00.522704  1366 consensus_queue.cc:237] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.498598   827 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.497982  1339 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:00.578374 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.631655 30930 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:00.583684 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 130847us
I20260709 12:23:00.594209 30851 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.600800 30932 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:00.615559 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.633569 30934 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.615897 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:00.634168 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 152573us
I20260709 12:23:00.634380 30928 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.578125  1322 consensus_queue.cc:1059] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:00.617784 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:23:00.621410 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 76061us
I20260709 12:23:00.616417 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.569239 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.629731 31476 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:00.620663  1275 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.635646 30935 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:23:00.637087 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 67997.1us
I20260709 12:23:00.618225  1245 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.641270 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.641881 30932 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:00.645592 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.646354  1383 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.632977  1210 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.646588  1220 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:00.652870 30825 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.646903  1350 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:00.659674 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.660307 30931 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:00.649646  1275 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.649490  1336 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.663805 30825 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:00.674806 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.640200  1328 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:00.669669  1377 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:23:00.676702  1369 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:00.663923  1388 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:23:00.652699  1339 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:00.650452  1371 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.658294  1383 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:00.685096 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 157231us
I20260709 12:23:00.689637 30851 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:00.691206 30934 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
W20260709 12:23:00.691367 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 57937.8us
I20260709 12:23:00.699131 30826 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.700563 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:00.682042  1369 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.703178  1369 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.703486 30931 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:00.670317  1350 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:00.705381  1350 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.706954  1339 raft_consensus.cc:697] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:00.708201 30930 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:00.707978  1339 consensus_queue.cc:237] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.674926  1210 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.693531 30932 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:00.696617 30935 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:00.693607 30928 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:00.681108  1328 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:00.685926  1365 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.719053 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:00.721874 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.724417 30930 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:00.726138 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.718961 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.733868 30851 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.712594  1371 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:00.707998  1186 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:00.740981 30930 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:00.722255  1328 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.713053  1383 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.772166  1343 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:00.772913  1343 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:00.774017  1343 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.774946  1383 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:00.743088 30826 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.744472  1210 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:00.776316 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:00.777381  1365 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:23:00.778656 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 114955us
I20260709 12:23:00.745220  1281 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.746693  1371 raft_consensus.cc:697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:00.714406  1348 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.718223  1376 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:00.793323  1377 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.794137  1377 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.796656  1377 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.797521 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.798231 30934 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.798743 30928 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:00.802073 30930 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:00.803727 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.805666 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.754695  1275 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.768436 30851 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:00.757908  1186 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:00.781800 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:00.778070  1365 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:23:00.789721 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.790303 31506 raft_consensus.cc:1240] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:00.827580 31477 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.788807  1245 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:00.751299  1369 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:00.830375 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 95213.1us
I20260709 12:23:00.830925  1384 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.831477 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:00.832350  1369 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.831957  1371 consensus_queue.cc:237] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:00.779474  1361 consensus_meta.cc:287] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.006s
I20260709 12:23:00.833113  1361 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.834420  1365 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.835233  1361 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.793387  1376 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.837383  1376 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.804368  1210 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:00.818722  1366 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.742238  1378 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.845502  1245 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:00.852728  1210 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.858541  1328 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:00.860121 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 56499.5us
I20260709 12:23:00.861105 30825 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.861742  1186 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.862627  1281 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.863281  1186 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.863251  1281 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.864351 30935 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:00.866971  1275 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.868450 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.869089 30930 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:00.869292 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.869892 30932 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:00.868077 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:00.830202 30929 raft_consensus.cc:2410] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:00.833274 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:00.779668  1322 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:00.794155  1393 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:23:00.798249 30931 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:00.840093 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.859757  1245 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:00.826556 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 146645us
I20260709 12:23:00.874210 30935 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:00.824116 30934 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:00.887244 30825 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.900987 30825 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:00.904702 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.907886 30932 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:00.912464 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.870198  1389 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.865543  1281 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.844762  1220 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:00.921428 30851 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:00.844941  1336 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:00.913384 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.861094  1328 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.845824  1246 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.927482 30930 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:00.928521 30933 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:23:00.901863  1350 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:00.932469 30930 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:00.914278  1275 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:00.934792 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:00.935660 30928 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:00.937954 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:00.925027  1376 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:00.947295  1391 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.003s
I20260709 12:23:00.949381 30785 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:00.950022 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:00.951263 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:00.951714 30931 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:00.959010 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:00.959226 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:00.959931 30781 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
W20260709 12:23:00.960850 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 127695us
I20260709 12:23:00.961819 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:00.962040  1246 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.934082  1336 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:00.964833  1246 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:00.965912  1336 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.972077 30935 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:00.977142 30825 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:00.919996  1366 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:00.984287 30933 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:01.021564 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59885.1us
I20260709 12:23:01.023067 30934 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [6.4-9.6]
I20260709 12:23:00.902884  1322 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:00.943536  1376 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:01.026041 30935 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
W20260709 12:23:01.028331 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49069.2us
W20260709 12:23:01.036679  1399 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:01.037418 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:01.037518  1275 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:01.041898  1376 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:01.043965 30927 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:01.041862 30929 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:01.042598 30931 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:23:01.040768 30932 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:01.045102 30926 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:01.049374 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 57199.4us
I20260709 12:23:01.040266 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:01.041361 30930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:49618
I20260709 12:23:00.990114  1341 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:00.994947  1220 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:01.061532 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:01.121031  1322 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:01.075153 30930 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:01.123432  1334 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:01.125337 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62443.7us
I20260709 12:23:00.957949  1343 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:23:00.997427  1384 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:01.120437 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.171353 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:00.943954  1350 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:01.146483 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:01.158366 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.185700 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:01.193981 30930 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:01.186513 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:01.188752 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.158488 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.171353 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.189090 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:01.190124 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.196461 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:01.190645 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:01.190491 30784 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
W20260709 12:23:01.199512 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 159366us
I20260709 12:23:01.200744 30777 raft_consensus.cc:2410] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:23:01.199560 30929 raft_consensus.cc:2368] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7.
I20260709 12:23:01.203857 30932 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:01.173977  1275 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.211910 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:01.220288 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:01.221318 30926 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:01.222303 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:01.231846 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.232067 30851 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:01.232554 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.202873  1348 raft_consensus.cc:3055] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:01.207814  1365 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.231156 30930 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:01.217500  1246 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.244071 30856 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:01.222259  1275 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:01.320835 30853 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:01.260037  1246 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:01.238248  1371 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:01.802891  1371 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:01.400403 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:01.805362 30856 raft_consensus.cc:2410] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:23:01.318288 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:23:01.806566 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.001s	sys 0.021s
W20260709 12:23:01.807039 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.002s	sys 0.021s
I20260709 12:23:01.807351 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.254382 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:01.808172 30782 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:01.268890 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:01.216826 31502 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:01.810688  1350 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:01.238909  1348 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:01.293738 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.730398  1406 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:23:01.799232 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 592214us
I20260709 12:23:01.812119  1348 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:01.813001 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.813917 30900 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:01.241874  1378 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:01.260918 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:01.260038 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.250126 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.819073  1065 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.819767 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.820395 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.821067 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.437476 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:01.246515  1365 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:01.230526  1148 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:01.839664 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:01.840502 30857 raft_consensus.cc:2368] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:23:01.813446  1348 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:01.837033 30785 consensus_meta.cc:287] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 12:23:01.838219 30930 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:01.841482 30785 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:01.842887 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:01.434705 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:01.845012 30860 raft_consensus.cc:2393] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:01.845562 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:01.846411 30855 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:01.846674 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.847271 30785 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:23:01.845885 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:01.847394 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:01.875319 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:01.269958  1403 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:23:01.863411 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:01.934904 30855 raft_consensus.cc:2368] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6.
I20260709 12:23:01.942813 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.943797 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.944468 30778 raft_consensus.cc:3055] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:01.944814 30778 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:01.947280 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:01.827292  1366 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:01.842170  1186 consensus_meta.cc:287] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.978s	user 0.012s	sys 0.001s
I20260709 12:23:01.940973 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.949982 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.980439 30785 raft_consensus.cc:2393] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:01.952486 30855 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:01.954977 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:01.982573 30780 raft_consensus.cc:2410] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:23:01.963778 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.968431 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:01.984401 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:01.268299  1397 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:01.983619 30852 raft_consensus.cc:2368] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:23:01.965308 31477 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:01.989392 30860 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:01.945807 30778 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.009840 30778 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.005949 31506 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:02.009987 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.011539 30857 raft_consensus.cc:2410] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:01.872795  1065 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.022367 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:01.943109  1148 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:02.024648 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:02.025522 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.026298 30927 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:02.027729 30779 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.027781 30784 raft_consensus.cc:2410] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:23:02.034500 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 220697us
I20260709 12:23:02.036067  1246 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:02.036201 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.036862  1246 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:02.037405  1376 consensus_meta.cc:287] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.879s	user 0.009s	sys 0.003s
I20260709 12:23:02.037645  1383 consensus_queue.cc:1048] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:02.038092  1417 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:02.038604  1417 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.039060  1417 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.039495  1383 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:02.040095  1383 raft_consensus.cc:697] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:02.040043 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.040910 30777 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:02.042433 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:02.050658 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.051637 30780 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:02.067752 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.068756 30780 raft_consensus.cc:2410] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:02.070392 30855 raft_consensus.cc:1240] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:02.052837 30750 connection.cc:256] RPC call timeout handler was delayed by -2.4443973749998804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 12:23:02.079656 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.071830 30779 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:02.084206 30781 raft_consensus.cc:2410] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:02.041285  1383 consensus_queue.cc:237] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.085913 30855 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:23:02.090174  1405 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.421s	user 0.004s	sys 0.009s
I20260709 12:23:02.092296 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:23:02.090930 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 125736us
I20260709 12:23:02.095372  1174 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.096108  1174 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.096830 30778 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:02.099628  1174 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.021171  1186 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:23:02.071938  1343 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.019379  1065 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.113284 30785 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:02.113909 30785 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:02.106673 30750 connection.cc:256] RPC call timeout handler was delayed by -1.9178973749999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 12:23:02.074250  1377 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.110869  1424 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:02.037431  1246 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.122759 30781 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:02.066830  1148 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.104310  1366 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.072026  1397 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:23:02.131247 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.077724  1376 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.132079 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:02.136520 30855 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:02.147535 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 109084us
I20260709 12:23:02.147596 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:02.149516 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:02.150128 30860 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:02.151839 30826 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:02.153884 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:02.154598 31508 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:02.155637  1420 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:02.156450  1423 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:02.156579  1420 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:02.157135  1423 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:02.118541  1343 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.158208  1423 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.160899  1343 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.161265 30854 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:02.149058 30785 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.167753 30785 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:02.169076  1411 raft_consensus.cc:2764] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:23:02.170053  1420 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.151268  1245 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.178507  1245 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.179239 31506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42836 (request call id 233) took 1251 ms. Trace:
I20260709 12:23:02.179741 30782 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:02.179670 31506 rpcz_store.cc:276] 0709 12:23:00.928001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:00.928298 (+   297us) service_pool.cc:224] Handling call
0709 12:23:02.179001 (+1250703us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400325d54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:02.179145 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454059264}
I20260709 12:23:02.181890 31502 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42836 (request call id 235) took 1146 ms. Trace:
I20260709 12:23:02.182336 31502 rpcz_store.cc:276] 0709 12:23:01.035306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.037093 (+  1787us) service_pool.cc:224] Handling call
0709 12:23:02.181675 (+1144582us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54003f7354. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:02.181817 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398771456}
I20260709 12:23:02.183013  1246 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.147783  1424 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.188802  1417 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.189894 30783 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.194159 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:02.194327 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:02.195452 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 44138.2us
I20260709 12:23:02.199219 30785 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 12:23:02.199452 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 47729.9us
I20260709 12:23:02.199755 30785 pending_rounds.cc:85] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 5
I20260709 12:23:02.200320 30785 pending_rounds.cc:107] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:23:02.181094  1245 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:02.210146 30860 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:02.124567  1377 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.204084 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.229076 30853 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:23:02.230463 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.231298 30853 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:02.200512 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:02.213327 30776 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:23:02.200845 30785 raft_consensus.cc:2889] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.215763 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.139935  1366 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:02.217022 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:02.232864 30776 pending_rounds.cc:85] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 4
I20260709 12:23:02.217870 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:02.218176  1065 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:02.219880 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.242331 30855 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:02.220731 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.120299  1419 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:23:02.221535  1275 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.221822 30934 raft_consensus.cc:1240] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:02.259284 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1671) took 1232 ms. Trace:
I20260709 12:23:02.223445 30780 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:02.260483 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.223737  1376 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:02.210693  1427 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:02.237309 30778 raft_consensus.cc:3055] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:02.239996 30776 pending_rounds.cc:107] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:23:02.243510 30851 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:02.278218 30778 raft_consensus.cc:740] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:02.278447 30776 raft_consensus.cc:2889] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.255605 30856 raft_consensus.cc:2368] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10.
I20260709 12:23:02.256260 30783 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:02.257257 30852 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:02.277453 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.261932 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.262786 30932 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:02.257884 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.259619 30934 rpcz_store.cc:276] 0709 12:23:01.027138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.028173 (+  1035us) service_pool.cc:224] Handling call
0709 12:23:02.221508 (+1193335us) spinlock_profiling.cc:243] Waited 874 us on lock 0x7b5400223228. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f96159c3ebc 00007f96159f908c 00007f96159e393b 00007f96159e33d2 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c
0709 12:23:02.221625 (+   117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.259022 (+ 37397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.259217 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009856}
I20260709 12:23:02.270944 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1682) took 1225 ms. Trace:
I20260709 12:23:02.188946  1424 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:02.280889 30928 rpcz_store.cc:276] 0709 12:23:01.045476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.215495 (+1170019us) service_pool.cc:224] Handling call
0709 12:23:02.270858 (+ 55363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:02.279556 30779 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:02.281658 30853 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:02.287493 30929 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:02.288688 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:02.286790 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 82465.5us
I20260709 12:23:02.287926 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.199753  1297 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:23:02.291630 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:02.320327  1429 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:02.271744  1371 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:02.303891 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 103514us
I20260709 12:23:02.291182 30900 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.322330 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:02.321853 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.323416 30782 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:23:02.321288 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.291684 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:02.324558 30853 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:02.286811  1275 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:02.325513  1417 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:02.325743  1275 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:02.325871 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.326463  1148 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:02.326804 30853 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:02.327049 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:02.327276 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.327620 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.327773 30852 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.332576 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:02.327973 30856 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:02.326989  1275 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.356220 30930 raft_consensus.cc:2410] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:02.334719 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:02.336387  1377 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.337496  1419 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:02.339265 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.340268 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.341621 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1612) took 1088 ms. Trace:
I20260709 12:23:02.342011 30778 consensus_queue.cc:260] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.325533 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.379333 30851 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:02.343878 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.273154  1065 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:02.255151  1383 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 12:23:02.347743 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.350684 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1686) took 1304 ms. Trace:
W20260709 12:23:02.385605 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.385952 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.386775 30778 raft_consensus.cc:3060] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:02.352825 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.388269 30783 raft_consensus.cc:2410] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:02.354351 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:02.389537 30782 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.356969 30853 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:02.357712 30852 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:02.373286 30929 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:02.378063 30854 rpcz_store.cc:276] 0709 12:23:01.253082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.253267 (+   185us) service_pool.cc:224] Handling call
0709 12:23:02.341412 (+1088145us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400377dd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:02.341554 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294272768}
I20260709 12:23:02.385403 30927 rpcz_store.cc:276] 0709 12:23:01.046742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:01.203196 (+156454us) service_pool.cc:224] Handling call
0709 12:23:01.218127 (+ 14931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:02.027462 (+809335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.350407 (+322945us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54002139d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:02.350617 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848233216}
I20260709 12:23:02.391968 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:02.291419  1423 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.386111 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:23:02.393577 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.393740 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:02.394183 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:02.395059 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:02.380913 30859 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:23:02.278165  1427 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.345587  1365 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.351166  1366 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
W20260709 12:23:02.397099 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 64625.5us
I20260709 12:23:02.399554 30853 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:02.399766 30852 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:23:02.401948 30929 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:02.389987 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 192577us
I20260709 12:23:02.372123  1371 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:02.403400 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:02.407886 30851 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.407940 30856 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:02.409685 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.413790 30783 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:02.415428 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:02.416333 31502 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 5: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:23:02.418182 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.417946  1423 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.420444  1423 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.421262  1371 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:02.403501  1297 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.422148  1297 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.422552  1297 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.422305  1371 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:02.423386 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 438927us
I20260709 12:23:02.424448  1366 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.424925  1366 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.425331  1366 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.403347  1336 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.426048  1336 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.426424  1336 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.428768 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:02.320987  1429 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.431959 30859 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:23:02.432451 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 307952us
I20260709 12:23:02.391785  1367 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:02.434211 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:02.412231 30929 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:02.436246 30776 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:02.439409 30776 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:02.429586  1426 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.444929 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:02.445609 30783 raft_consensus.cc:3060] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.441231 30782 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:02.446266 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:02.406886  1419 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:02.404287  1427 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:02.440627 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:02.446979 30858 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:23:02.448338 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.445007  1232 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:23:02.452651 30851 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:02.393399  1065 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.462997 30778 raft_consensus.cc:1275] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:23:02.463474 30778 pending_rounds.cc:85] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 6
I20260709 12:23:02.461182 31477 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:02.411677  1432 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:02.463176 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:02.445799 30776 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.466811 30825 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.468753 30858 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:02.451243  1426 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.471517 30778 pending_rounds.cc:107] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:23:02.483224 30783 raft_consensus.cc:2468] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:02.487205 30778 raft_consensus.cc:2889] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:02.491427 30935 raft_consensus.cc:1275] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:02.499293 30776 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.500209 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:02.437440  1186 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:23:02.502818 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 95585.2us
I20260709 12:23:02.468092  1377 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:02.471912  1245 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:02.469211  1322 raft_consensus.cc:2804] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:02.511559 30899 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:02.457784  1148 consensus_queue.cc:1059] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:23:02.472169  1424 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:02.517243 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 50528.5us
I20260709 12:23:02.447139  1367 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.500615  1426 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.520128 30825 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.521631 30935 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:23:02.525970 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.527448  1367 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:02.511052  1441 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:02.530025 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 59201.4us
I20260709 12:23:02.531002  1435 consensus_queue.cc:1059] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:02.531910 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:02.522349 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 74093.6us
I20260709 12:23:02.561972  1275 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:02.562616 30825 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.563871  1275 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:02.565165 30825 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.576422 30825 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.514529  1377 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:02.519315  1424 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.514639  1433 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:02.584547 30825 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:02.581390 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:02.617385 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 57662.7us
I20260709 12:23:02.618145 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.619385 30929 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:02.611704  1377 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.534881  1322 raft_consensus.cc:697] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
W20260709 12:23:02.654495 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 122752us
I20260709 12:23:02.559206  1439 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:02.535584  1449 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:02.621843  1246 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:02.661831 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.520776  1245 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.662581 30929 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
W20260709 12:23:02.667943 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 83492us
I20260709 12:23:02.622108  1432 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:02.670575 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:02.655762  1371 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:02.657466  1449 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:02.659338  1384 raft_consensus.cc:2764] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 12:23:02.699069  1434 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 12:23:02.699954  1444 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:02.561087  1441 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.616895  1424 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:02.615330  1275 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:02.746263  1443 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:23:02.655309  1437 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:23:02.745544  1441 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.580552  1419 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:02.755000  1436 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:23:02.756311  1424 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:02.703408  1432 raft_consensus.cc:697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:02.759006  1432 consensus_queue.cc:237] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.760319  1322 consensus_queue.cc:237] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:02.764868 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.687242  1438 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:02.695287  1420 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:02.779923 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.773331 30777 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:23:02.801894 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:02.708665  1449 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:02.687628  1409 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:23:02.566382  1411 consensus_queue.cc:1059] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
W20260709 12:23:02.828687 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:02.780783 30935 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:02.805023 30933 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:02.892511  1427 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:02.893980 30855 raft_consensus.cc:2393] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:02.709779  1371 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:02.955036 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 284539us
I20260709 12:23:02.963351  1464 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:02.964469  1464 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:02.781194 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 269848us
I20260709 12:23:02.967837  1464 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:02.972672  1065 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:03.073163 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 106310us
I20260709 12:23:02.957194  1429 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:02.895382  1427 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:03.299693 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 681589us
W20260709 12:23:03.267707 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.303020 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.292734 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 632100us
W20260709 12:23:02.935206  1366 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.002s
I20260709 12:23:03.308203 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.320320 30929 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
W20260709 12:23:03.316340 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 550740us
I20260709 12:23:02.895478  1245 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:02.898161  1446 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:23:03.324506 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 366936us
I20260709 12:23:03.325583 30825 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:03.272653  1433 consensus_meta.cc:287] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.000s
W20260709 12:23:03.142833  1452 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:23:03.000896 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.010634  1336 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.002s
W20260709 12:23:03.031678  1450 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
W20260709 12:23:03.098191  1297 consensus_meta.cc:287] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 12:23:03.328117 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.126974  1186 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:03.304454 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.142833  1463 log.cc:927] Time spent T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:23:03.332626 30928 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:03.332815 30932 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:23:03.344735 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.355870 30935 raft_consensus.cc:2410] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:23:03.031203  1437 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:03.346798 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.347270 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.347474 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:03.347680 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.348510 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:03.350518 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:03.356793 30900 connection.cc:256] RPC call timeout handler was delayed by -2.9598481360003461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 12:23:03.360093 30930 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
W20260709 12:23:03.360412 30900 connection.cc:256] RPC call timeout handler was delayed by -2.6862481360003585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260709 12:23:03.360566 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.360961 30825 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:03.067050  1424 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:03.359581 30776 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:03.363520 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.364550 30934 raft_consensus.cc:2410] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:23:03.333472  1433 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:03.329209  1438 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:23:03.370540 30930 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:02.896225  1454 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.515s
W20260709 12:23:03.358186  1426 consensus_meta.cc:287] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.778s	user 0.013s	sys 0.004s
I20260709 12:23:03.373090 30931 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:03.323496  1459 consensus_queue.cc:1059] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:23:03.376684  1424 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:03.384503 30931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
I20260709 12:23:03.385299 30931 raft_consensus.cc:606] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:03.385654 30931 raft_consensus.cc:614] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:03.384507  1459 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:23:03.388078  1459 raft_consensus.cc:3055] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:03.374913 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:03.328305  1429 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:23:03.333578  1460 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:23:03.380903  1428 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.358709  1441 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.393169 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1650) took 1171 ms. Trace:
I20260709 12:23:03.395653 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.399997 30854 rpcz_store.cc:276] 0709 12:23:02.221488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.398172 (+176684us) service_pool.cc:224] Handling call
0709 12:23:02.398473 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.431005 (+ 32532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.431036 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.431499 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.663864 (+232365us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:02.692814 (+ 28950us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.693114 (+   300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.947357 (+254243us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b18001a8cc0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:02.951322 (+  3965us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18001a8cc0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9002a6 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419
0709 12:23:02.951869 (+   547us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b54003a84d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:02.951899 (+    30us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.392940 (+441041us) raft_consensus.cc:1685] finished
0709 12:23:03.392959 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.393097 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4086,"prepare.queue_time_us":30431,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":6607,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":9457,"spinlock_wait_cycles":124578432,"thread_start_us":198104,"threads_started":1,"wal-append.queue_time_us":913134}
I20260709 12:23:03.381541 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:03.332587  1464 consensus_queue.cc:1059] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:23:03.329701  1366 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.391448 30750 leader_election.cc:400] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7.
I20260709 12:23:03.467986 30750 leader_election.cc:403] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:23:03.371245  1420 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:03.349661  1065 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:23:03.458937 30933 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:23:03.388576  1438 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:23:03.355347  1297 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.388484  1459 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:03.361864  1186 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.394161  1441 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.350023  1336 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.368256  1411 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:23:03.507457  1411 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:03.508044  1411 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:03.509330  1411 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.510224  1459 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.511361  1411 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:03.511770  1459 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:03.395936  1377 consensus_meta.cc:287] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.739s	user 0.013s	sys 0.000s
W20260709 12:23:03.470359 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 79137.7us
I20260709 12:23:03.513681  1377 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.514297 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1646) took 1294 ms. Trace:
I20260709 12:23:03.514699 30855 rpcz_store.cc:276] 0709 12:23:02.220335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.256335 (+ 36000us) service_pool.cc:224] Handling call
0709 12:23:03.514073 (+1257738us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54004376d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:03.514228 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390028672}
I20260709 12:23:03.472905 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 375) took 1184 ms. Trace:
I20260709 12:23:03.515960 30853 rpcz_store.cc:276] 0709 12:23:02.288338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.400365 (+112027us) service_pool.cc:224] Handling call
0709 12:23:02.400628 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.435536 (+ 34908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.435564 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.443944 (+  8380us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.660932 (+216988us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:02.660990 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.661084 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.472675 (+811591us) raft_consensus.cc:1685] finished
0709 12:23:03.472695 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.472833 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77351,"raft.queue_time_us":50575,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9812,"thread_start_us":160123,"threads_started":1,"wal-append.queue_time_us":388074}
W20260709 12:23:03.473917 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 115558us
I20260709 12:23:03.519150 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:03.466737  1464 raft_consensus.cc:3055] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:03.393735  1428 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.475603 30778 raft_consensus.cc:1275] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:23:03.476372 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.567463 30778 pending_rounds.cc:85] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 2
I20260709 12:23:03.540408 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.568040 30778 pending_rounds.cc:107] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:23:03.568359 30778 raft_consensus.cc:2889] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:03.568694 30782 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:23:03.569270 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.541203 31506 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 8. Ops: []
I20260709 12:23:03.547463 30825 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:03.525895  1378 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:03.522250 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:03.572567 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:03.465397  1435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.015s	sys 0.004s
I20260709 12:23:03.381515  1426 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.478252 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 379) took 1188 ms. Trace:
I20260709 12:23:03.472213  1424 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7.
I20260709 12:23:03.367828  1437 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.466536  1473 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:23:03.499143  1397 raft_consensus.cc:3055] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:23:03.478855  1450 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:03.504496  1465 raft_consensus.cc:3055] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:03.481068  1367 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:03.622069 30930 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:03.463797  1371 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:03.481212  1383 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:03.468186  1433 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:03.574033 30784 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:03.473366  1420 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:03.575440 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 222372us
I20260709 12:23:03.575742 30825 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:03.532377  1449 consensus_meta.cc:287] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 12:23:03.588932 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:03.533882  1458 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.519461  1366 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:03.519538  1377 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:03.576455  1435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.015s	sys 0.004s
I20260709 12:23:03.571216 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:03.576591 30856 rpcz_store.cc:276] 0709 12:23:02.289456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.411573 (+122117us) service_pool.cc:224] Handling call
0709 12:23:02.434873 (+ 23300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.452083 (+ 17210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.452132 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.461559 (+  9427us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.898748 (+437189us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:02.898805 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.898901 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.477925 (+579024us) raft_consensus.cc:1685] finished
0709 12:23:03.477956 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.478163 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26857,"raft.queue_time_us":16897,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":390920,"threads_started":1,"wal-append.queue_time_us":488580}
I20260709 12:23:03.530357  1468 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:03.590035  1365 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:03.625838 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:03.587901  1409 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.525298  1336 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:03.567260  1464 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:03.658089  1475 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:03.658854  1464 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.660236  1464 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:03.666719 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:03.667668 30860 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:03.649410 30899 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:03.628094 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 105911us
W20260709 12:23:03.630811 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 55140.1us
I20260709 12:23:03.534076  1441 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:03.576742  1384 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.671978 30825 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:03.634491 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:03.632045  1458 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:03.640194  1472 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:03.640595  1474 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.624830  1420 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:03.589677  1246 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:23:03.622414  1454 raft_consensus.cc:2764] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:03.650403  1390 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.638381  1383 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:03.646090  1468 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:03.651340 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:03.653906  1148 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.654474  1422 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:03.633880  1449 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.647998 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1474) took 1414 ms. Trace:
I20260709 12:23:03.656489 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:03.701188 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.621590  1397 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:03.657167  1366 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:03.672905 31508 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:23:03.675398 30825 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:03.626986  1465 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:03.636345  1378 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:03.681593 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:03.716116 30857 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:03.716262 30825 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:03.716936  1378 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.717422  1378 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.686131  1429 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:03.687281 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:03.647578  1433 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:03.693900 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:03.719332 30825 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:03.723913 30851 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:03.724392 30825 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:03.694903 30853 raft_consensus.cc:1275] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:03.701890 30933 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:03.703562 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.697741 30781 rpcz_store.cc:276] 0709 12:23:02.234092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.393198 (+159106us) service_pool.cc:224] Handling call
0709 12:23:02.409991 (+ 16793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.434875 (+ 24884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.434905 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.447738 (+ 12833us) log.cc:844] Serialized 26 byte log entry
0709 12:23:02.568203 (+120465us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:02.652180 (+ 83977us) log.cc:844] Serialized 14 byte log entry
0709 12:23:02.955055 (+302875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:02.955138 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.647777 (+692639us) raft_consensus.cc:1685] finished
0709 12:23:03.647798 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.647933 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4206,"prepare.queue_time_us":84073,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3443,"raft.queue_time_us":554554,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":26556,"thread_start_us":380810,"threads_started":2,"wal-append.queue_time_us":244530}
I20260709 12:23:03.705039 30932 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:03.708954 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:03.709111  1367 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:03.709618  1481 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:23:03.709779  1462 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:23:03.736469 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.737277 30785 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:03.710743 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:03.738761 30932 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:03.739401 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.740026 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 396) took 1118 ms. Trace:
I20260709 12:23:03.711656 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:03.658106  1371 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:23:03.712829 30929 raft_consensus.cc:2393] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:03.678809  1475 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:03.723482  1429 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.730973 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.731381 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:03.739516  1477 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:03.711140 30927 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:23:03.741638 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.766351 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.727422  1433 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:03.733729  1439 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:03.717943  1275 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:03.749191 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.750524 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:03.775573 30782 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:03.740424 30783 rpcz_store.cc:276] 0709 12:23:02.622140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.622308 (+   168us) service_pool.cc:224] Handling call
0709 12:23:02.622643 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:02.942966 (+320323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:02.943002 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:02.958669 (+ 15667us) log.cc:844] Serialized 26 byte log entry
0709 12:23:03.334943 (+376274us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:03.334988 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:03.335055 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:03.739819 (+404764us) raft_consensus.cc:1685] finished
0709 12:23:03.739841 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:03.739968 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33081,"raft.queue_time_us":472118,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":29001,"thread_start_us":495851,"threads_started":2,"wal-append.queue_time_us":410411}
I20260709 12:23:03.686035 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1403) took 1425 ms. Trace:
I20260709 12:23:03.760396 30851 raft_consensus.cc:2468] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:03.709659  1365 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:23:03.722550  1422 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.713492  1148 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.732180  1367 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:03.786803 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.763353 30778 raft_consensus.cc:3055] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:03.787581 30778 raft_consensus.cc:740] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:03.766219 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:03.768026 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.743316 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:03.699225  1377 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:23:03.760959 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.793160 30778 consensus_queue.cc:260] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.735522  1245 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:03.746641 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:03.778385 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:03.697499  1390 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.781816 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:03.777343 30926 rpcz_store.cc:276] 0709 12:23:02.260849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:02.260956 (+   107us) service_pool.cc:224] Handling call
0709 12:23:03.685865 (+1424909us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002251d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:03.685978 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2927107968}
I20260709 12:23:03.675562  1409 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.730427  1322 consensus_queue.cc:1048] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:23:03.789505 30933 raft_consensus.cc:2368] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:23:03.688541  1474 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.679378  1384 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:03.790735 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 87245.4us
I20260709 12:23:03.726920  1441 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:23:03.799654  1383 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.825377 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:03.768568  1429 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.781062 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:03.801424 30778 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:03.828244 31507 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:23:03.822618  1297 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:03.795305  1477 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:03.803221 30782 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:23:03.806182 30935 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:03.790376  1367 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:03.795459  1468 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.781239  1397 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.821949  1440 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:23:03.792346 31508 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:23:03.768755  1454 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:03.827251 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:03.834692 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 453204us
I20260709 12:23:03.869011 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:03.869670 30857 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:03.837975 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:03.842337 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:03.872400 30933 raft_consensus.cc:2393] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:03.844965 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:03.847380 30855 raft_consensus.cc:1240] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:03.823861  1245 raft_consensus.cc:697] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:03.848327 30853 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:23:03.884436 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:03.881656 31506 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:03.888518 30854 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:03.886423 30856 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
W20260709 12:23:03.881940 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 200024us
I20260709 12:23:03.847453  1458 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:03.803860  1465 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.916271  1426 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:03.915977  1245 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:03.916802  1474 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:03.916977  1449 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:03.824860  1433 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:03.873247  1454 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.028548 30929 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:23:03.945437 30778 raft_consensus.cc:1275] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:23:04.072558 30782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "47c0d0bc235a443aad3c62643e91b081"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:23:04.039353 30781 raft_consensus.cc:3055] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:04.103785 30782 raft_consensus.cc:606] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Received request to transfer leadership to TS 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:04.104281 30781 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:04.038522 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.103557 30778 pending_rounds.cc:85] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 5
I20260709 12:23:04.105109 30778 pending_rounds.cc:107] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 9.6
W20260709 12:23:04.073408 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.105472 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:04.106012 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.105499 30778 raft_consensus.cc:2889] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:03.920465 30935 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:04.109494 30825 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:04.116829 30825 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:03.987413 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:04.120046 30926 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:23:03.923125 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 98953.6us
I20260709 12:23:04.126552 30783 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:23:03.884061  1421 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:04.133399 31476 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:04.131987 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:04.208137 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 76253.8us
W20260709 12:23:04.181039 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.209739 30825 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:04.212234 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:04.213325 30852 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:04.011276  1435 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:04.072248  1422 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:04.212788 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:04.102988  1390 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:04.016345  1186 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:04.115939  1454 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:04.134086  1455 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:23:04.135370  1475 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:04.135609  1458 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.237087 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 103776us
W20260709 12:23:04.237069 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 114186us
I20260709 12:23:04.279451 31477 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:04.121243  1428 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:03.917317  1437 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:04.129103  1365 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:04.225036  1275 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:04.133265  1489 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:04.206568  1397 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:04.115017  1468 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:04.283034 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.288172 30926 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
W20260709 12:23:04.276707 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.221104  1439 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:04.222371  1487 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.312193 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 99486.1us
W20260709 12:23:04.313870 30750 connection.cc:256] RPC call timeout handler was delayed by -1.6698554770000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 12:23:04.137207 30781 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.222736  1435 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:04.318393 30750 connection.cc:256] RPC call timeout handler was delayed by -1.6590554770000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:23:04.320869 30750 connection.cc:256] RPC call timeout handler was delayed by -1.6383554770000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 12:23:04.321583 30750 connection.cc:256] RPC call timeout handler was delayed by -1.6284554769999886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:23:04.321979 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5987554769999406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 12:23:04.322307 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5870554769999217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:23:04.322669 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5375554770002964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:23:04.323072 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5114554770002542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:23:04.323454 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4817554770002062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 12:23:04.323841 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4421554770001421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:23:04.324167 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4412554770001407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 12:23:04.289199  1347 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:04.327049 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4367554770001334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 12:23:04.282948  1459 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:04.327572 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4160554770001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 12:23:04.282584  1409 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:04.333125 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4025554770000781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260709 12:23:04.334285 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3620554770000126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 12:23:04.335143 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3593554770000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 12:23:04.335600 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3584554770000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:23:04.336066 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3566554770000039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:23:04.336578 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3494554769999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
W20260709 12:23:04.337106 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3269554769999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
W20260709 12:23:04.337580 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3197554769999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 12:23:04.338153 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3116554769999311s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 12:23:04.320247 30781 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:04.338699 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3017554769999151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:23:04.340087 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2567554770002971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 12:23:04.276640  1426 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:23:04.342633 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2423554770002738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 12:23:04.343447 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2216554770002404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 12:23:04.344239 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1226554770000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 12:23:04.344578 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1199554770000759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 12:23:04.345814 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1190554770000745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 12:23:04.208281  1421 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:04.346499 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1127554770000643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 12:23:04.376371 30750 connection.cc:256] RPC call timeout handler was delayed by -1.0623554769999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.225s for a response
I20260709 12:23:04.300928  1458 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:04.372112 30899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.065s	sys 0.105s
W20260709 12:23:04.383364 30899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.066s	sys 0.105s
I20260709 12:23:04.322733  1440 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:04.317528  1497 raft_consensus.cc:2804] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:04.321092  1275 raft_consensus.cc:697] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:04.395021  1275 consensus_queue.cc:237] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.353334 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:04.398408 30782 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:04.399690 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.400432 30782 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
W20260709 12:23:04.401821  1491 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:23:04.344901  1459 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.402842 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:04.404079  1322 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:04.404469  1322 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.404826  1322 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:04.405078  1459 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:04.405838 30783 pending_rounds.cc:85] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 3
I20260709 12:23:04.406194 30783 pending_rounds.cc:107] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:23:03.917815  1477 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.318624  1441 consensus_queue.cc:1048] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:23:04.397993  1498 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
W20260709 12:23:04.441303 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.406598 30783 raft_consensus.cc:2889] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:04.446308 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.447006 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.382251 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 91495.5us
I20260709 12:23:04.327601  1186 consensus_queue.cc:1048] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 12:23:04.377724 31474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.000s	sys 0.017s
I20260709 12:23:04.388196  1438 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:04.386453  1300 consensus_queue.cc:1048] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 12:23:04.421489  1484 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.014s
I20260709 12:23:04.408401  1246 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:04.422857  1378 consensus_meta.cc:287] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 12:23:04.408633  1460 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:04.439262 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:04.440040  1500 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:04.450345 31474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.001s	sys 0.017s
W20260709 12:23:04.485891 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 105744us
I20260709 12:23:04.480262 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:04.487450 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:04.488062 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 48914us
I20260709 12:23:04.488984 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:04.408844  1440 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:04.387302  1384 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:04.496889 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:04.416208  1497 raft_consensus.cc:697] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:04.320825  1489 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:04.453045  1449 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.332690  1487 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:04.490886  1484 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.001s	sys 0.014s
I20260709 12:23:04.492178  1422 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:04.513365 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:04.485015  1437 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.495091  1246 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:04.520001 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.480597  1232 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:23:04.414357  1435 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.522068  1478 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.518761  1449 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.496217  1500 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:04.531697  1458 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:04.500461  1455 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:04.542429 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:04.543862 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.499394  1440 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:04.545936 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:04.658226 30929 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
W20260709 12:23:04.664695  1464 consensus_meta.cc:287] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.004s	user 0.031s	sys 0.002s
W20260709 12:23:04.614641  1420 consensus_meta.cc:287] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.919s	user 0.010s	sys 0.002s
W20260709 12:23:04.618041  1411 consensus_meta.cc:287] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.106s	user 0.015s	sys 0.000s
I20260709 12:23:04.686086 30784 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:23:04.686664 30784 pending_rounds.cc:85] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 4
I20260709 12:23:04.686982 30784 pending_rounds.cc:107] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:23:04.687300 30784 raft_consensus.cc:2889] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:04.694839 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 205910us
I20260709 12:23:04.695900 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:04.665498  1464 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.492197  1378 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.492142  1336 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:23:04.555637  1437 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.566723  1497 consensus_queue.cc:237] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:04.764321 30928 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:04.560735 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:04.765415 30926 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:04.496860  1460 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.491835  1428 consensus_queue.cc:1059] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:23:04.557432  1475 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:04.556924  1511 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:04.559576 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:04.521392  1459 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:04.523682 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:04.619799 30934 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.004s	sys 0.056s
W20260709 12:23:04.781424 30934 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.004s	sys 0.056s
W20260709 12:23:04.594169  1429 consensus_meta.cc:287] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.746s	user 0.002s	sys 0.008s
I20260709 12:23:04.631937 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.544516  1432 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:04.648628  1322 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:04.681593 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.488883  1438 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.749429 30781 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:23:04.800293 30781 pending_rounds.cc:85] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 4
I20260709 12:23:04.800585 30781 pending_rounds.cc:107] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:23:04.800825 30781 raft_consensus.cc:2889] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:04.750521 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 54768.8us
I20260709 12:23:04.682113  1435 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:04.767155 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.767488 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 135514us
I20260709 12:23:04.688038  1503 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:04.781445 30935 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:04.630081  1246 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:04.792122  1245 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:04.811240  1513 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:04.811025  1245 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.813261 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.813520  1245 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:04.682869  1420 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.813920  1390 raft_consensus.cc:3055] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:04.814411  1390 raft_consensus.cc:740] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:04.814612 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.815285  1390 consensus_queue.cc:260] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:04.815832 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.816120  1420 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:04.817095 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:23:04.797979 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 93899.4us
I20260709 12:23:04.798305 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.818089 30776 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:04.818780  1148 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:04.625102  1478 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.820951  1378 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:04.821116  1478 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:04.801609 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:04.806692 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.824445 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:04.826836 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:04.753362  1464 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:04.847645 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.878867 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.802886  1411 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:04.805936  1428 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:04.890436 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 366829us
I20260709 12:23:04.896282 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:04.877835  1420 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:23:04.892946  1489 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:04.881603  1275 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:04.835950  1232 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:04.890792 30899 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:04.794816  1429 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.835152  1378 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:04.913450 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1424) took 1212 ms. Trace:
I20260709 12:23:04.916285  1432 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:04.934819 30750 leader_election.cc:400] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:23:04.935230 30750 leader_election.cc:403] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:23:04.936203 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:04.937089 30778 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:04.946180 30927 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:04.912240  1489 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:04.914932  1378 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.942800  1432 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:04.949164  1468 consensus_meta.cc:287] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.002s
I20260709 12:23:04.949868  1449 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:04.953297  1510 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:04.953558  1464 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:04.836812  1503 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:04.955094  1519 log.cc:927] Time spent T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:23:04.956034  1516 log.cc:927] Time spent T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:23:04.958767  1460 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:04.959884  1524 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:04.913954 30934 rpcz_store.cc:276] 0709 12:23:03.701424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.701931 (+   507us) service_pool.cc:224] Handling call
0709 12:23:03.710089 (+  8158us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:03.725113 (+ 15024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.725147 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:03.725928 (+   781us) log.cc:844] Serialized 78 byte log entry
0709 12:23:03.907294 (+181366us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:04.781956 (+874662us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.793525 (+ 11569us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.912908 (+119383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.913007 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:04.913104 (+    97us) raft_consensus.cc:1685] finished
0709 12:23:04.913116 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:04.913353 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83736,"prepare.queue_time_us":421324,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":99,"raft.queue_time_us":84471,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4287,"spinlock_wait_cycles":47781504,"thread_start_us":1037478,"threads_started":3,"wal-append.queue_time_us":375066}
I20260709 12:23:04.983458  1432 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:04.959708 30679 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 2 to 5, term changed from 6 to 7, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65), VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66), VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67), VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 7 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:04.974071  1367 consensus_meta.cc:287] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 1.094s	user 0.007s	sys 0.006s
I20260709 12:23:04.991379 30777 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
W20260709 12:23:04.999361 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.024597 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:04.954041  1496 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:23:04.916713  1275 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:04.978410  1459 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:23:04.948158  1522 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:05.014732  1487 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.024159 30930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab"
dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:36358
W20260709 12:23:05.008636 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.518s (SENT) [suppressed 34 similar messages]
W20260709 12:23:05.035315 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 110384us
I20260709 12:23:05.026293  1377 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.022395  1510 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:05.068101 30826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.334s	user 0.019s	sys 0.022s
W20260709 12:23:05.068559 30826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.335s	user 0.019s	sys 0.022s
W20260709 12:23:05.030807 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 140266us
I20260709 12:23:05.084913 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.125211 30860 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:05.038862  1500 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:05.083654  1522 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:05.145428 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.142792  1522 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:05.155575 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.157407  1517 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:05.158085  1517 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.158536  1517 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.160696 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.027501  1367 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:05.144812 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:05.203207 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.218711  1530 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 12:23:05.229322 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.232218  1536 log.cc:927] Time spent T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:23:05.065053  1464 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:05.274888  1535 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 12:23:05.279685  1440 consensus_meta.cc:287] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.004s
I20260709 12:23:05.286275  1541 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.070115  1377 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:05.299149 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.027263  1524 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:05.159857  1468 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.125968  1322 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.464473 30853 pending_rounds.cc:85] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 4
W20260709 12:23:05.293186  1534 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:23:05.143715  1459 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:05.436295  1496 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:23:05.458490 30855 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:05.465037 30853 pending_rounds.cc:107] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:23:05.620287 30853 raft_consensus.cc:2889] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:05.465842 30930 raft_consensus.cc:606] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:05.470979 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 462345us
W20260709 12:23:05.524001 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.509636 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 473490us
I20260709 12:23:05.473022  1275 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.446947  1464 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.469081  1438 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.551445  1429 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:05.623095 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.623178 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:05.457894  1440 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.626876 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:05.613276  1477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.029s
I20260709 12:23:05.639324 30856 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.473585  1468 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.461323  1541 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:05.644582 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.623149  1459 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:05.652441 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:05.653223  1459 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:05.655167  1440 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:05.656330  1538 log.cc:927] Time spent T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:23:05.638739  1419 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.658152 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 404) took 1332 ms. Trace:
I20260709 12:23:05.658186  1419 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.658543 30776 rpcz_store.cc:276] 0709 12:23:04.326096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.818722 (+492626us) service_pool.cc:224] Handling call
0709 12:23:04.819023 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.825354 (+  6331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.825383 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.825827 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:23:05.014159 (+188332us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:05.032020 (+ 17861us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.032312 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.032385 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.657922 (+625537us) raft_consensus.cc:1685] finished
0709 12:23:05.657943 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.658090 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19673,"prepare.run_cpu_time_us":11461,"prepare.run_wall_time_us":28603,"raft.queue_time_us":4831,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":6842112,"thread_start_us":116590,"threads_started":1,"wal-append.queue_time_us":218741}
I20260709 12:23:05.660760 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:05.661391 30776 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:05.662916  1454 consensus_meta.cc:287] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.382s	user 0.011s	sys 0.001s
I20260709 12:23:05.663458  1454 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:05.666718  1542 log.cc:927] Time spent T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:23:05.669199  1539 log.cc:927] Time spent T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:23:05.676983 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.678076 30899 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:05.677620 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:05.679314 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.679951  1473 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.681522 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 396) took 1066 ms. Trace:
I20260709 12:23:05.686141  1475 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.685947 30854 rpcz_store.cc:276] 0709 12:23:04.615257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.615542 (+   285us) service_pool.cc:224] Handling call
0709 12:23:04.632855 (+ 17313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:04.633126 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:04.877827 (+244701us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.681167 (+803340us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.681225 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:05.681283 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.681350 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.681467 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":757287,"prepare.queue_time_us":366534,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":2362,"raft.queue_time_us":705195,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":236124,"threads_started":2,"wal-append.queue_time_us":149843}
I20260709 12:23:05.682540  1465 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.683393  1245 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.682209 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:05.689604 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 403) took 1363 ms. Trace:
I20260709 12:23:05.630008  1378 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.692718 30782 rpcz_store.cc:276] 0709 12:23:04.325803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.402283 (+ 76480us) service_pool.cc:224] Handling call
0709 12:23:04.402635 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:04.544180 (+141545us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:04.766891 (+222711us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.839133 (+ 72242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:04.839185 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:04.839234 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.689286 (+850052us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400121bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:05.689346 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.689523 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266041,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1501,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":13522,"spinlock_wait_cycles":324858112,"thread_start_us":232302,"threads_started":2,"wal-append.queue_time_us":145005}
W20260709 12:23:05.648931  1435 consensus_meta.cc:287] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.841s	user 0.011s	sys 0.000s
I20260709 12:23:05.699590 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:05.700999 30785 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:23:05.701414 30785 pending_rounds.cc:85] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 4
I20260709 12:23:05.701680 30785 pending_rounds.cc:107] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:23:05.701823 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:05.702090 30785 raft_consensus.cc:2889] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:05.686815  1475 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.698107  1429 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:05.709817  1478 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:05.719769 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1502) took 1324 ms. Trace:
I20260709 12:23:05.721464 30781 rpcz_store.cc:276] 0709 12:23:04.395872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.822919 (+427047us) service_pool.cc:224] Handling call
0709 12:23:04.823346 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.824353 (+  1007us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:04.824384 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.824887 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:23:04.931759 (+106872us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:04.931820 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.931917 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.719526 (+787609us) raft_consensus.cc:1685] finished
0709 12:23:05.719552 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.719706 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":536,"raft.queue_time_us":1577,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":42277,"thread_start_us":106460,"threads_started":1,"wal-append.queue_time_us":194096}
I20260709 12:23:05.722528 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1485) took 1989 ms. Trace:
I20260709 12:23:05.725571 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:05.726475 30782 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 5.
I20260709 12:23:05.727743  1419 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:05.697494  1245 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:05.733386 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.733656  1367 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:23:05.735946  1419 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.736176 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:05.736953  1478 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:05.722903 30784 rpcz_store.cc:276] 0709 12:23:03.733075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.733320 (+   245us) service_pool.cc:224] Handling call
0709 12:23:03.754959 (+ 21639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:04.703043 (+948084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.722295 (+1019252us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54003b42d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:05.722469 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140092288}
I20260709 12:23:05.744469 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:05.745023 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:05.746785 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:05.747624 30781 raft_consensus.cc:2410] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:05.749611 30776 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
W20260709 12:23:05.711205 30826 connection.cc:256] RPC call timeout handler was delayed by -1.6454526870002155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 12:23:05.754177 30826 connection.cc:256] RPC call timeout handler was delayed by -1.464395586000137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3309s for a response
I20260709 12:23:05.755425 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:05.758680 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1578) took 1311 ms. Trace:
I20260709 12:23:05.761611 30781 rpcz_store.cc:276] 0709 12:23:04.447868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.756909 (+1309041us) service_pool.cc:224] Handling call
0709 12:23:05.757291 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.757514 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.757551 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.757607 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:05.757660 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.757728 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.758608 (+   880us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.721338  1429 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.761096 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:23:05.759591  1544 log.cc:927] Time spent T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:23:05.760267 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:05.718724  1454 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.736541  1419 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.774475  1419 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:05.774845  1541 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:05.770284  1484 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:05.780241 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1429) took 2074 ms. Trace:
I20260709 12:23:05.780819 30928 rpcz_store.cc:276] 0709 12:23:03.706039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.730713 (+ 24674us) service_pool.cc:224] Handling call
0709 12:23:05.780029 (+2049316us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b540027b354. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:05.780168 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296669056}
I20260709 12:23:05.783515 30784 raft_consensus.cc:1240] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:23:05.783733 30781 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:05.784435 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1581) took 1335 ms. Trace:
I20260709 12:23:05.785683 30781 rpcz_store.cc:276] 0709 12:23:04.448973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.767147 (+1318174us) service_pool.cc:224] Handling call
0709 12:23:05.767519 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.784138 (+ 16619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.784377 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.786916 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:05.769171 30782 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.768646 30899 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:05.750974  1478 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:05.766770 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:05.762691  1510 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.769966  1543 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.790242 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:05.788208 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1579) took 1340 ms. Trace:
W20260709 12:23:05.794154 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.794273 30784 rpcz_store.cc:276] 0709 12:23:04.448290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.766066 (+1317776us) service_pool.cc:224] Handling call
0709 12:23:05.783277 (+ 17211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:05.787927 (+  4650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.788148 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.769107  1429 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:05.770825  1367 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.795987  1366 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:05.799816  1366 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.800316  1366 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.800418  1478 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:05.792843  1541 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:05.801966  1541 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:05.802522  1541 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:05.802779  1475 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.803747  1524 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:05.784933  1484 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:05.805335  1484 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:05.807291 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1582) took 1358 ms. Trace:
I20260709 12:23:05.807814 30784 rpcz_store.cc:276] 0709 12:23:04.449299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.806020 (+1356721us) service_pool.cc:224] Handling call
0709 12:23:05.806462 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.806826 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.806866 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.806924 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:05.806978 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.807055 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.807210 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.809836  1477 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:05.809948  1367 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:05.812655  1367 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:05.813293 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.771174  1540 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:05.782776  1245 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:05.792019  1517 consensus_meta.cc:287] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.009s
I20260709 12:23:05.820266  1440 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:05.821039  1477 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:05.822125 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:05.822659  1510 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:05.766168  1427 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:23:05.787845 30781 raft_consensus.cc:2410] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:05.841084 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:05.826051  1540 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.832252 30856 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:05.854074 30779 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:23:05.858526 30779 pending_rounds.cc:85] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 3
I20260709 12:23:05.858875 30779 pending_rounds.cc:107] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:23:05.859207 30779 raft_consensus.cc:2889] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:05.866142 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1589) took 1305 ms. Trace:
I20260709 12:23:05.866601 30781 rpcz_store.cc:276] 0709 12:23:04.560387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.865299 (+1304912us) service_pool.cc:224] Handling call
0709 12:23:05.865598 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.865809 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.865835 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.865877 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:05.865907 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.865960 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.866071 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.868492 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1590) took 1252 ms. Trace:
W20260709 12:23:05.853947 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 64248.4us
I20260709 12:23:05.868880 30781 rpcz_store.cc:276] 0709 12:23:04.616204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.867710 (+1251506us) service_pool.cc:224] Handling call
0709 12:23:05.867986 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.868179 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.868205 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.868248 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:05.868278 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.868338 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.868440 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.846964 30854 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
W20260709 12:23:05.857967 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 101030us
I20260709 12:23:05.870389 30781 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:05.857554  1540 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:05.836583  1454 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:05.875852 30782 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
W20260709 12:23:05.877954 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 254833us
I20260709 12:23:05.873265 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.878998 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1591) took 1261 ms. Trace:
I20260709 12:23:05.847679  1367 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:05.882995 30781 rpcz_store.cc:276] 0709 12:23:04.617233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.869945 (+1252712us) service_pool.cc:224] Handling call
0709 12:23:05.870219 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.878584 (+  8365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.878937 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.883301 30899 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:05.897984 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:05.867240  1438 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:05.903357 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.909947 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:05.910676 30782 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:05.907609 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:05.871966  1547 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.918251 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:05.918077  1547 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.918978 30856 raft_consensus.cc:2376] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:23:05.919937 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.921065 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.798750  1543 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.917512 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 408) took 1089 ms. Trace:
I20260709 12:23:05.855037  1475 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:23:05.837616  1517 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.877094  1464 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.924739 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:05.926678 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:05.926433 30781 rpcz_store.cc:276] 0709 12:23:04.827991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.916376 (+1088385us) service_pool.cc:224] Handling call
0709 12:23:05.916791 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.917035 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.917078 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.917145 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:05.917193 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.917282 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.917430 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:05.931619  1552 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:05.933873 30899 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:05.932672  1522 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:05.940591  1473 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:05.879763  1383 consensus_queue.cc:1059] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 12:23:05.904956  1468 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:05.950968 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:05.908824  1550 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.959095 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1593) took 1118 ms. Trace:
I20260709 12:23:05.970355 30781 rpcz_store.cc:276] 0709 12:23:04.840988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.955331 (+1114343us) service_pool.cc:224] Handling call
0709 12:23:05.958609 (+  3278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.958817 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.958847 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.958884 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:05.958906 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.958944 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.959043 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:05.960704 30777 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54660 (request call id 1492) took 2214 ms (client timeout 2798 ms). Trace:
W20260709 12:23:05.961494 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 80819.3us
I20260709 12:23:05.900490  1454 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:05.971482 30777 rpcz_store.cc:269] 0709 12:23:03.739352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.740633 (+  1281us) service_pool.cc:224] Handling call
0709 12:23:05.953646 (+2213013us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540014dcd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:05.953805 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817661056}
W20260709 12:23:05.975521  1508 log.cc:927] Time spent T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.347s	user 0.006s	sys 0.041s
I20260709 12:23:05.977999 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1431) took 2271 ms. Trace:
I20260709 12:23:05.978423 30931 rpcz_store.cc:276] 0709 12:23:03.706558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.769011 (+ 62453us) service_pool.cc:224] Handling call
0709 12:23:03.769461 (+   450us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:03.792916 (+ 23455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:03.792952 (+    36us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:03.804221 (+ 11269us) log.cc:844] Serialized 78 byte log entry
0709 12:23:04.323882 (+519661us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:04.371365 (+ 47483us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.411890 (+ 40525us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.412126 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:04.412234 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:05.838531 (+1426297us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:05.977663 (+139132us) raft_consensus.cc:1685] finished
0709 12:23:05.977691 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.977906 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45427,"prepare.queue_time_us":96290,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":76,"raft.queue_time_us":48250,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":8824,"spinlock_wait_cycles":78156928,"thread_start_us":503221,"threads_started":2,"wal-append.queue_time_us":657236}
I20260709 12:23:05.980589  1437 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:05.985190  1438 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:05.988199 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:05.988626 30750 leader_election.cc:400] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 5. Current term is 6.
I20260709 12:23:05.986927  1543 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:05.990897 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1594) took 1111 ms. Trace:
I20260709 12:23:05.996958 30781 rpcz_store.cc:276] 0709 12:23:04.879592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.974434 (+1094842us) service_pool.cc:224] Handling call
0709 12:23:05.989919 (+ 15485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.990100 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.990135 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.990186 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:05.990243 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:05.990398 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:05.990656 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:05.999055 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:06.002568 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 77965.8us
I20260709 12:23:06.003908 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1596) took 1123 ms. Trace:
I20260709 12:23:06.004323 30781 rpcz_store.cc:276] 0709 12:23:04.880106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.000626 (+1120520us) service_pool.cc:224] Handling call
0709 12:23:06.003344 (+  2718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.003536 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.003558 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.003599 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:06.003637 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.003714 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.003847 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.008783 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1595) took 1128 ms. Trace:
I20260709 12:23:06.009207 30777 rpcz_store.cc:276] 0709 12:23:04.879878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.996044 (+1116166us) service_pool.cc:224] Handling call
0709 12:23:06.008253 (+ 12209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.008427 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.008454 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.008500 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:06.008535 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.008595 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.008716 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.011526 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.012193 30781 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:05.945333  1554 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:23:06.027333  1366 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:05.994901  1550 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:06.028743 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.487630 30777 raft_consensus.cc:2410] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:06.086234  1421 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:06.490808 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.491412 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.491767 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.034106  1384 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:06.369048 30781 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:06.494625 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.240203  1540 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:06.357635 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.495872 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.495995 30860 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
W20260709 12:23:06.292165  1432 consensus_meta.cc:287] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.270s	user 0.012s	sys 0.000s
I20260709 12:23:06.062800  1553 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:06.226598  1522 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:06.497855  1553 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:06.458263 30899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.004s	sys 0.002s
W20260709 12:23:06.498755 30899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.005s	sys 0.002s
W20260709 12:23:06.237023 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.499439 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 565642us
W20260709 12:23:06.499811 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.500566 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.428930  1541 consensus_meta.cc:287] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.006s
W20260709 12:23:06.482602 30928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.008s	sys 0.007s
I20260709 12:23:06.503113  1541 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:06.234467 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1586) took 1776 ms. Trace:
I20260709 12:23:06.506968 30784 rpcz_store.cc:276] 0709 12:23:04.457572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.809056 (+1351484us) service_pool.cc:224] Handling call
0709 12:23:05.809515 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.817960 (+  8445us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:05.910804 (+ 92844us) log.cc:844] Serialized 14 byte log entry
0709 12:23:06.233974 (+323170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.234052 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:06.234126 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.234222 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.234386 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":113834,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":3665,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":379101,"threads_started":2,"wal-append.queue_time_us":588810}
I20260709 12:23:06.498267  1553 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:06.481237 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.496512 30781 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
W20260709 12:23:06.555826 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:06.556658 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.560235 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:06.489303 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:06.510731 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 387637us
W20260709 12:23:06.503861 30928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.008s	sys 0.007s
W20260709 12:23:06.498942 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 510430us
I20260709 12:23:06.497236 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:06.378762  1429 consensus_meta.cc:287] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
I20260709 12:23:06.565747 30933 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:06.568717 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.566380 30856 raft_consensus.cc:2368] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9.
I20260709 12:23:06.569083  1429 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:06.570072 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.570187  1554 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:06.570626  1554 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:06.570884  1366 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:06.571208 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:06.571467  1429 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:06.571699 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1498) took 2533 ms. Trace:
I20260709 12:23:06.561708  1484 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.572227 30785 rpcz_store.cc:276] 0709 12:23:04.037916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.038069 (+   153us) service_pool.cc:224] Handling call
0709 12:23:04.074200 (+ 36131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.702569 (+1628369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.571450 (+868881us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400246654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:06.571642 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3740203904}
I20260709 12:23:06.572551  1484 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:06.575006  1541 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:06.567967 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 362) took 2022 ms. Trace:
I20260709 12:23:06.497457  1432 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:06.561421  1481 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:06.576894  1481 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:06.578290  1432 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:06.571756  1454 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:06.567062 30860 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:06.589354 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.578702  1495 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.590437  1495 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:06.591063 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.591818 30860 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:06.592805 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.580514  1481 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:06.579020 30932 rpcz_store.cc:276] 0709 12:23:04.545775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.546071 (+   296us) service_pool.cc:224] Handling call
0709 12:23:04.546420 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.773966 (+227546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.774016 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.802351 (+ 28335us) log.cc:844] Serialized 26 byte log entry
0709 12:23:05.027522 (+225171us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:05.125200 (+ 97678us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.144136 (+ 18936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.563505 (+1419369us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54000b7054. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:06.563556 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:06.563616 (+    60us) raft_consensus.cc:1685] finished
0709 12:23:06.567685 (+  4069us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.567884 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138528,"prepare.queue_time_us":55365,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":139459,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":26115,"spinlock_wait_cycles":327313280,"thread_start_us":137952,"threads_started":1,"wal-append.queue_time_us":598181}
W20260709 12:23:06.594097 30782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.014s	sys 0.005s
I20260709 12:23:06.572332 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.596220 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.593657 30860 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:06.596623 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.581604 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.597855 30785 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.482420  1517 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:06.593320  1495 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:06.595934 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.497151  1540 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:06.565586 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.639364 30784 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:06.639453 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.640396 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.641191 30784 raft_consensus.cc:2410] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:23:06.602834 30777 raft_consensus.cc:2410] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:23:06.597417 30782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.014s	sys 0.005s
I20260709 12:23:06.606441 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.654287 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.655831 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:06.656448 30935 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.498508  1522 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:06.658033 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.665122 30781 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
W20260709 12:23:06.659176 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 94975.2us
I20260709 12:23:06.662679 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.675377 30784 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:06.663880 30860 raft_consensus.cc:2393] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:06.663345 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.677342 30777 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:06.678182 30785 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:06.678689 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1479) took 1003 ms. Trace:
I20260709 12:23:06.680446 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.681180 30785 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:06.681679 30750 leader_election.cc:400] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:23:06.679541 30860 rpcz_store.cc:276] 0709 12:23:05.674881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.606022 (+931141us) service_pool.cc:224] Handling call
0709 12:23:06.678628 (+ 72606us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.686589 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:06.686862 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 77178.7us
I20260709 12:23:06.687459 30860 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:06.687969 30935 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:06.690451 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.691234 30785 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:06.691776 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.692375 30784 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:06.692559 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.688287 30899 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:06.693646 30785 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:06.695144 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.695076 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:06.696151 30785 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:06.696542 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.658895  1297 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.699843 30932 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:06.658895  1550 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:06.663568  1484 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:06.714634 30785 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:06.717062 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 410) took 1422 ms. Trace:
I20260709 12:23:06.717576 30785 rpcz_store.cc:276] 0709 12:23:05.294779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.715970 (+1421191us) service_pool.cc:224] Handling call
0709 12:23:06.716371 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.716608 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.716645 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.716706 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:06.716754 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.716841 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.716989 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.721280 30777 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:06.700344 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:06.722114 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:06.722584 30781 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:06.697860 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.723600 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1489) took 1045 ms. Trace:
I20260709 12:23:06.724064 30860 rpcz_store.cc:276] 0709 12:23:05.678434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.697585 (+1019151us) service_pool.cc:224] Handling call
0709 12:23:06.723517 (+ 25932us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.725275 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.726251 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1487) took 1048 ms. Trace:
I20260709 12:23:06.726677 30860 rpcz_store.cc:276] 0709 12:23:05.677506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.724906 (+1047400us) service_pool.cc:224] Handling call
0709 12:23:06.726180 (+  1274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.727751 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:06.728406 30860 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:06.735476 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 407) took 2083 ms. Trace:
I20260709 12:23:06.736096 30782 rpcz_store.cc:276] 0709 12:23:04.652514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.912190 (+1259676us) service_pool.cc:224] Handling call
0709 12:23:05.912620 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:05.925602 (+ 12982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.925645 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:05.926884 (+  1239us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.641927 (+715043us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:06.641991 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.642093 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:06.735186 (+ 93093us) raft_consensus.cc:1685] finished
0709 12:23:06.735215 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.735389 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12824,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12051,"thread_start_us":675226,"threads_started":1,"wal-append.queue_time_us":737596}
I20260709 12:23:06.686498  1429 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:06.741279 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 66564.6us
I20260709 12:23:06.741215 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1603) took 1031 ms. Trace:
I20260709 12:23:06.743515 30777 rpcz_store.cc:276] 0709 12:23:05.710302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.734253 (+1023951us) service_pool.cc:224] Handling call
0709 12:23:06.734697 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.734948 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.734985 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.735044 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:06.735095 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.740979 (+  5884us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.741136 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.702653 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1597) took 1822 ms. Trace:
I20260709 12:23:06.745632 30784 rpcz_store.cc:276] 0709 12:23:04.880385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.701526 (+1821141us) service_pool.cc:224] Handling call
0709 12:23:06.701971 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.702200 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.702241 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.702302 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:06.702350 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.702426 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.702573 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.748142 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1602) took 1053 ms. Trace:
I20260709 12:23:06.722747 30935 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.749231 30785 rpcz_store.cc:276] 0709 12:23:05.694857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.747080 (+1052223us) service_pool.cc:224] Handling call
0709 12:23:06.747460 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.747693 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.747732 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:06.747788 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:06.747852 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.747927 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:06.748063 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.750564 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:06.700527  1481 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:06.749220  1567 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:23:06.775657 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.571494  1554 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:06.657698  1553 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:06.781975 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62263.9us
W20260709 12:23:06.786978 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 92525.8us
I20260709 12:23:06.714250  1297 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:06.753841  1429 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:06.856805 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.789019 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:07.019485 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.972409  1547 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:06.797730 30777 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:23:07.020260 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 269617us
W20260709 12:23:07.037542 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.036533 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:06.885401 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1477) took 1211 ms. Trace:
I20260709 12:23:06.987800 30785 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:07.042865 30856 rpcz_store.cc:276] 0709 12:23:05.674254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.920824 (+246570us) service_pool.cc:224] Handling call
0709 12:23:06.885174 (+964350us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540015ca54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:06.885335 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482548608}
I20260709 12:23:07.043354 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1506) took 1045 ms. Trace:
I20260709 12:23:07.022253 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:07.043761 30785 rpcz_store.cc:276] 0709 12:23:05.997823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.987140 (+989317us) service_pool.cc:224] Handling call
0709 12:23:06.987562 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.043080 (+ 55518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.043299 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.044411 30933 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:07.044512 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:06.802783 30931 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:07.045158 30785 raft_consensus.cc:1275] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:23:07.042310 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1505) took 1053 ms. Trace:
I20260709 12:23:06.887779 30935 raft_consensus.cc:2410] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:07.045771 30777 rpcz_store.cc:276] 0709 12:23:05.989280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.778111 (+788831us) service_pool.cc:224] Handling call
0709 12:23:06.797308 (+ 19197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.042008 (+244700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.042250 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:06.983239 30784 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:07.047348 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1511) took 1031 ms. Trace:
I20260709 12:23:07.047648 30784 rpcz_store.cc:276] 0709 12:23:06.015913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.982537 (+966624us) service_pool.cc:224] Handling call
0709 12:23:06.982977 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.047109 (+ 64132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.047299 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.025192 30860 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:07.045885 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1512) took 1029 ms. Trace:
I20260709 12:23:06.777684  1454 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:07.048506 30785 rpcz_store.cc:276] 0709 12:23:06.016212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.044589 (+1028377us) service_pool.cc:224] Handling call
0709 12:23:07.044862 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.045646 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.045834 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.051968 30934 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:07.052604 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1436) took 1051 ms. Trace:
I20260709 12:23:07.050534 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1493) took 1371 ms. Trace:
I20260709 12:23:07.054169 30860 rpcz_store.cc:276] 0709 12:23:05.679587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.727469 (+1047882us) service_pool.cc:224] Handling call
0709 12:23:07.050480 (+323011us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:07.020869 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.056999 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:07.057678 30784 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:07.053352 30933 rpcz_store.cc:276] 0709 12:23:06.001041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.051888 (+1050847us) service_pool.cc:224] Handling call
0709 12:23:07.052154 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.052316 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.052341 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.052379 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.052409 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.052458 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.052550 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.025009  1297 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.063354 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:06.849709  1579 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:06.890712  1433 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.060942 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:06.804610  1377 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.064522 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1501) took 1059 ms. Trace:
I20260709 12:23:07.023658  1554 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:06.993626  1503 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.067423 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.070420 30860 rpcz_store.cc:276] 0709 12:23:06.005517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.063005 (+1057488us) service_pool.cc:224] Handling call
0709 12:23:07.064448 (+  1443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.086215 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:07.087052 30860 raft_consensus.cc:2376] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:23:07.087685 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1503) took 1074 ms. Trace:
I20260709 12:23:07.088107 30860 rpcz_store.cc:276] 0709 12:23:06.012859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.085909 (+1073050us) service_pool.cc:224] Handling call
0709 12:23:07.087608 (+  1699us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.059279  1547 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:07.091243 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:06.802554  1550 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:07.092633 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1490) took 1413 ms. Trace:
I20260709 12:23:07.097312 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1500) took 2778 ms. Trace:
I20260709 12:23:07.115991 30783 rpcz_store.cc:276] 0709 12:23:04.319196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.319376 (+   180us) service_pool.cc:224] Handling call
0709 12:23:04.319760 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:04.471099 (+151339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:04.471146 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:04.471728 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:23:04.673592 (+201864us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:04.673635 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.084189 (+2410554us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b54003dbb54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:07.084260 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.084322 (+    62us) raft_consensus.cc:1685] finished
0709 12:23:07.084340 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.097245 (+ 12905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197370752,"thread_start_us":201471,"threads_started":1,"wal-append.queue_time_us":327502,"wal-append.run_cpu_time_us":2930,"wal-append.run_wall_time_us":1635859}
W20260709 12:23:07.118296 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.118716 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.783006  1481 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.104184 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1604) took 1373 ms. Trace:
I20260709 12:23:07.111061 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1484) took 3378 ms. Trace:
W20260709 12:23:07.112650 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 68208.9us
I20260709 12:23:07.123075 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:07.097941  1584 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:07.095846  1547 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:07.109615  1533 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 1.968s	user 0.008s	sys 0.015s
I20260709 12:23:07.096336 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1481) took 1420 ms. Trace:
W20260709 12:23:07.114688 30927 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1696) took 3358 ms (client timeout 1559 ms). Trace:
I20260709 12:23:07.131660 30860 rpcz_store.cc:276] 0709 12:23:05.675717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.088934 (+1413217us) service_pool.cc:224] Handling call
0709 12:23:07.096254 (+  7320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:07.131755 30927 rpcz_store.cc:269] 0709 12:23:03.754196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.766455 (+ 12259us) service_pool.cc:224] Handling call
0709 12:23:07.110180 (+3343725us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002a2454. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:07.112882 (+  2702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631523712}
I20260709 12:23:07.115370 30856 rpcz_store.cc:276] 0709 12:23:05.678728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.057752 (+1379024us) service_pool.cc:224] Handling call
0709 12:23:07.092570 (+ 34818us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:07.124862 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.122684 30779 rpcz_store.cc:276] 0709 12:23:03.732685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.746407 (+ 13722us) service_pool.cc:224] Handling call
0709 12:23:03.772904 (+ 26497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.871767 (+2098863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.110786 (+1239019us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54001d9554. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:07.110992 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4770996992}
I20260709 12:23:07.134025 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:07.124035 30782 rpcz_store.cc:276] 0709 12:23:05.730575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.739070 (+1008495us) service_pool.cc:224] Handling call
0709 12:23:06.739447 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:06.739685 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:06.783833 (+ 44148us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.103685 (+319852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.103766 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.103843 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.103939 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.104106 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39638,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":103,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2560,"thread_start_us":363177,"threads_started":2}
I20260709 12:23:07.139582 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.121143  1553 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:07.133069  1550 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.129896  1547 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.126230  1584 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.147965 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.155818 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1480) took 1480 ms. Trace:
I20260709 12:23:07.140684 30860 raft_consensus.cc:2376] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10. Re-sending same reply.
I20260709 12:23:07.150501  1429 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.151428  1481 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.156150 30856 rpcz_store.cc:276] 0709 12:23:05.675153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.138274 (+1463121us) service_pool.cc:224] Handling call
0709 12:23:07.155756 (+ 17482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.156764 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1464) took 1501 ms. Trace:
I20260709 12:23:07.141494  1377 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:07.159844 30860 rpcz_store.cc:276] 0709 12:23:05.655540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.139338 (+1483798us) service_pool.cc:224] Handling call
0709 12:23:07.156672 (+ 17334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.161875 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.163059 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.163544 30860 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:07.164076 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1486) took 1486 ms. Trace:
I20260709 12:23:07.164399 30860 rpcz_store.cc:276] 0709 12:23:05.677218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.161615 (+1484397us) service_pool.cc:224] Handling call
0709 12:23:07.164025 (+  2410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.164721 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1482) took 1488 ms. Trace:
I20260709 12:23:07.158377  1584 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.165094 30856 rpcz_store.cc:276] 0709 12:23:05.676047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.158595 (+1482548us) service_pool.cc:224] Handling call
0709 12:23:07.164668 (+  6073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.166066 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:07.166370  1587 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:07.166878 30856 raft_consensus.cc:2410] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:23:07.167333 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1476) took 1493 ms. Trace:
I20260709 12:23:07.167609 30856 rpcz_store.cc:276] 0709 12:23:05.673938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.165802 (+1491864us) service_pool.cc:224] Handling call
0709 12:23:07.167278 (+  1476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.168231 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1504) took 1179 ms. Trace:
I20260709 12:23:07.168592 30781 rpcz_store.cc:276] 0709 12:23:05.988982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.743781 (+754799us) service_pool.cc:224] Handling call
0709 12:23:06.744047 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.744376 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.744403 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.744826 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.824303 (+ 79477us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:06.824351 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.824457 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.168032 (+343575us) raft_consensus.cc:1685] finished
0709 12:23:07.168052 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.168172 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12984,"raft.queue_time_us":671,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4677,"thread_start_us":41374,"threads_started":1,"wal-append.queue_time_us":349002}
W20260709 12:23:07.180886 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.161438  1377 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.184024  1377 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.190968  1550 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:07.192027  1581 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:23:07.195343 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1514) took 1119 ms. Trace:
I20260709 12:23:07.195781 30785 rpcz_store.cc:276] 0709 12:23:06.076169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.049685 (+973516us) service_pool.cc:224] Handling call
0709 12:23:07.050038 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:07.050384 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:07.062912 (+ 12528us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.115954 (+ 53042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:07.116985 (+  1031us) log.cc:844] Serialized 26 byte log entry
0709 12:23:07.117128 (+   143us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:07.117187 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.117263 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.186415 (+ 69152us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:07.195014 (+  8599us) raft_consensus.cc:1685] finished
0709 12:23:07.195126 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.195278 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11107,"prepare.queue_time_us":15639,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":13031,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":5545,"spinlock_wait_cycles":3514624,"thread_start_us":19577,"threads_started":1,"wal-append.queue_time_us":70070}
W20260709 12:23:07.199029  1573 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.738s	user 0.000s	sys 0.001s
I20260709 12:23:07.200951 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:07.202229  1591 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:23:07.160531  1588 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:07.203028  1588 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.203397  1588 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:07.205428 30857 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:07.206220 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1499) took 1295 ms. Trace:
I20260709 12:23:07.205663 30780 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:23:07.207258 30780 pending_rounds.cc:85] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 6
I20260709 12:23:07.207566 30780 pending_rounds.cc:107] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:23:07.207876 30780 raft_consensus.cc:2889] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:07.206631 30857 rpcz_store.cc:276] 0709 12:23:05.910480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.200635 (+1290155us) service_pool.cc:224] Handling call
0709 12:23:07.206142 (+  5507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.165308 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.229902 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1459) took 1586 ms. Trace:
I20260709 12:23:07.230511 30860 rpcz_store.cc:276] 0709 12:23:05.644025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.165066 (+1521041us) service_pool.cc:224] Handling call
0709 12:23:07.229806 (+ 64740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.235343  1584 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.257205  1584 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.338678 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:07.339040 30931 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1441) took 1258 ms (client timeout 1564 ms). Trace:
W20260709 12:23:07.339430 30931 rpcz_store.cc:269] 0709 12:23:06.080223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:06.559892 (+479669us) service_pool.cc:224] Handling call
0709 12:23:07.338820 (+778928us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002639d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:07.338975 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544112000}
I20260709 12:23:07.342013 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36358 (request call id 13) took 2254 ms. Trace:
I20260709 12:23:07.342599 30930 rpcz_store.cc:276] 0709 12:23:05.006628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.006803 (+   175us) service_pool.cc:224] Handling call
0709 12:23:07.260881 (+2254078us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54002bbe54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a19853 00007f96159e760a 00007f960ef6d7d4 00007f960ef6d762 00007f960ef6d691 00007f960ef6d60c 00007f960ef6c8c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:07.260994 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996575616}
I20260709 12:23:07.356673 30776 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:07.363624  1547 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.368326 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1495) took 1498 ms. Trace:
I20260709 12:23:07.368775 30858 rpcz_store.cc:276] 0709 12:23:05.870024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.238414 (+1368390us) service_pool.cc:224] Handling call
0709 12:23:07.368254 (+129840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.378484 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1453) took 2293 ms. Trace:
I20260709 12:23:07.378947 30853 rpcz_store.cc:276] 0709 12:23:05.084869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.085801 (+   932us) service_pool.cc:224] Handling call
0709 12:23:05.464233 (+378432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:05.620986 (+156753us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:05.825794 (+204808us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.923812 (+ 98018us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:05.924502 (+   690us) log.cc:844] Serialized 26 byte log entry
0709 12:23:05.924728 (+   226us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:05.925051 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 12:23:06.883334 (+958283us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b180021f6a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:07.377866 (+494532us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b180021f6a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:23:07.378093 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.378173 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.378217 (+    44us) raft_consensus.cc:1685] finished
0709 12:23:07.378229 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.378397 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3998,"prepare.queue_time_us":235844,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":2009,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":11796992,"thread_start_us":227325,"threads_started":2,"wal-append.queue_time_us":73503,"wal-append.run_cpu_time_us":2403,"wal-append.run_wall_time_us":1008917}
I20260709 12:23:07.381752 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1450) took 2302 ms. Trace:
I20260709 12:23:07.382229 30859 rpcz_store.cc:276] 0709 12:23:05.079074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.079277 (+   203us) service_pool.cc:224] Handling call
0709 12:23:05.570899 (+491622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.571167 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:05.793340 (+222173us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.381376 (+1588036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.381439 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:07.381493 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.381568 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.381692 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1448489,"prepare.queue_time_us":285273,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":1448805,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":247212,"threads_started":2,"wal-append.queue_time_us":163846,"wal-append.run_cpu_time_us":1761,"wal-append.run_wall_time_us":1256962}
W20260709 12:23:07.383513 30825 connection.cc:256] RPC call timeout handler was delayed by -1.1333678089999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2798s for a response
I20260709 12:23:07.384279 30854 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:07.384730  1390 raft_consensus.cc:3060] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.384927 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1460) took 1730 ms. Trace:
I20260709 12:23:07.386880  1245 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.387228  1510 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.387429  1245 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.387722  1510 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.389779 30825 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:07.389943 30855 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1454) took 2213 ms (client timeout 1904 ms). Trace:
W20260709 12:23:07.390372 30855 rpcz_store.cc:269] 0709 12:23:05.141772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.142997 (+  1225us) service_pool.cc:224] Handling call
0709 12:23:07.355350 (+2212353us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400075b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:07.355510 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494542592}
I20260709 12:23:07.390894 30825 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:07.385303 30854 rpcz_store.cc:276] 0709 12:23:05.654312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.383574 (+1729262us) service_pool.cc:224] Handling call
0709 12:23:07.383917 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.384659 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.384868 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.394707 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 406) took 2982 ms. Trace:
W20260709 12:23:07.402946 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 714675us
W20260709 12:23:07.404289 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 270362us
I20260709 12:23:07.405287 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:07.396231 30778 rpcz_store.cc:276] 0709 12:23:04.412512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.982596 (+570084us) service_pool.cc:224] Handling call
0709 12:23:05.012945 (+ 30349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:05.020734 (+  7789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:05.020764 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:05.020807 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:05.020842 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.394340 (+2373498us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b54001838d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:07.394385 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.394647 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17459968}
I20260709 12:23:07.406601 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:07.408726 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.412496 30932 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:07.416218 30785 raft_consensus.cc:1240] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:23:07.412992 30932 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.417912 30782 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:07.421696 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 364) took 1480 ms. Trace:
I20260709 12:23:07.422159 30928 rpcz_store.cc:276] 0709 12:23:05.940964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.952387 (+ 11423us) service_pool.cc:224] Handling call
0709 12:23:05.952732 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:06.563929 (+611197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.563962 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:06.566641 (+  2679us) log.cc:844] Serialized 26 byte log entry
0709 12:23:06.666510 (+ 99869us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:06.667068 (+   558us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.401683 (+734615us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b18002c24e0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:23:07.401963 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.402073 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.402134 (+    61us) raft_consensus.cc:1685] finished
0709 12:23:07.421437 (+ 19303us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.421618 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31988,"prepare.queue_time_us":170,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":843079,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":14570,"spinlock_wait_cycles":2209152,"thread_start_us":692443,"threads_started":2,"wal-append.queue_time_us":113851}
I20260709 12:23:07.426083 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1434) took 1453 ms. Trace:
I20260709 12:23:07.426553 30926 rpcz_store.cc:276] 0709 12:23:05.972910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.995687 (+ 22777us) service_pool.cc:224] Handling call
0709 12:23:06.006854 (+ 11167us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:06.081849 (+ 74995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:06.081880 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:06.082535 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 12:23:06.461747 (+379212us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:06.461835 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:06.461936 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.198244 (+736308us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:07.403578 (+205334us) raft_consensus.cc:1685] finished
0709 12:23:07.403612 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.426012 (+ 22400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74546,"raft.queue_time_us":76737,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":60,"spinlock_wait_cycles":103660288,"thread_start_us":375275,"threads_started":1,"wal-append.queue_time_us":374696}
I20260709 12:23:07.429190 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:07.431160 30785 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:07.434427 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 393) took 2894 ms. Trace:
I20260709 12:23:07.434929 30851 rpcz_store.cc:276] 0709 12:23:04.539676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.540265 (+   589us) service_pool.cc:224] Handling call
0709 12:23:04.615259 (+ 74994us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:04.615467 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:04.842874 (+227407us) log.cc:844] Serialized 14 byte log entry
0709 12:23:06.888433 (+2045559us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800299b60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf23a
0709 12:23:07.434053 (+545620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.434115 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:07.434166 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.434227 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.434359 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":554990,"prepare.queue_time_us":310571,"prepare.run_cpu_time_us":2327,"prepare.run_wall_time_us":11267,"spinlock_wait_cycles":25262336,"thread_start_us":279608,"threads_started":2,"wal-append.queue_time_us":154936,"wal-append.run_cpu_time_us":3016,"wal-append.run_wall_time_us":1410796}
I20260709 12:23:07.445269 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:07.402655  1377 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.443439  1365 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.447718  1365 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.448661  1377 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.449856  1439 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:07.399969  1275 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:07.454155 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.400264  1487 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:07.426604  1433 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.460011 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.466373 30851 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:07.431851  1569 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:07.426119  1366 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:07.430943  1474 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.471850 30778 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:07.419925 30932 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.476639 30932 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:07.486320 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 55763.8us
W20260709 12:23:07.488447 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 97613us
I20260709 12:23:07.490149 30825 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:07.439903  1540 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:07.450543  1439 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.495966 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1455) took 1095 ms. Trace:
I20260709 12:23:07.497190 30933 rpcz_store.cc:276] 0709 12:23:06.400679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.067997 (+667318us) service_pool.cc:224] Handling call
0709 12:23:07.068388 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.068666 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:07.069886 (+  1220us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.495500 (+425614us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.495576 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.495653 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.495740 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.495889 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":381690,"prepare.queue_time_us":954,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":46,"thread_start_us":43506,"threads_started":1,"wal-append.queue_time_us":51987}
I20260709 12:23:07.501628 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:07.505692 30785 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.491020 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:07.512014 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1463) took 1856 ms. Trace:
W20260709 12:23:07.513433 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 110847us
I20260709 12:23:07.473783  1503 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:07.516284 31506 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:07.517665  1365 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.483013  1377 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:07.515704 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:07.467941  1433 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.475360  1569 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.475839  1474 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.521797 30899 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:07.484359  1440 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.534905 31508 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:07.511823  1438 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:07.516908 30932 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:23:07.512436 30851 rpcz_store.cc:276] 0709 12:23:05.655272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.467353 (+1812081us) service_pool.cc:224] Handling call
0709 12:23:07.495326 (+ 27973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.511637 (+ 16311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.511669 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.511720 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:07.511754 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.511813 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.511949 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.538249 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:07.539834 30932 pending_rounds.cc:85] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 7
I20260709 12:23:07.483768  1547 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.493279  1245 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.525801 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:07.488062  1366 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.511113  1510 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.468101  1275 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.540201 30932 pending_rounds.cc:107] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:23:07.540172 31510 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:07.555565 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.573328 30932 raft_consensus.cc:2889] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:07.477572  1487 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.542621 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:23:07.575853 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 54161us
I20260709 12:23:07.576362 30778 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.517939  1475 raft_consensus.cc:2764] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:07.522670 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:07.562211 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:07.578075 30928 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.518414  1420 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:23:07.530699  1377 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.564684 30785 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:07.565552 30934 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:23:07.600412 30934 pending_rounds.cc:85] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 5
I20260709 12:23:07.600682 30934 pending_rounds.cc:107] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:23:07.600914 30934 raft_consensus.cc:2889] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:07.565891 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:07.559677 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:07.512164  1540 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:07.545130 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 44088.5us
I20260709 12:23:07.604765 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:07.576574 30899 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:07.563230 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:07.579704 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:07.607071 30776 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:07.580039  1378 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.580874 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:07.611647 30930 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 6: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:07.534734  1569 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.581032  1543 raft_consensus.cc:3055] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:07.612524  1543 raft_consensus.cc:740] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.613726  1543 consensus_queue.cc:260] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.615182  1543 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:07.581472 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.554698  1580 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:07.582441  1475 consensus_queue.cc:1059] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.616784  1580 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.617249  1580 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.617549  1475 raft_consensus.cc:3055] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:07.585664  1275 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.542785  1440 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.539776  1438 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:07.640558 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 65443.3us
I20260709 12:23:07.588280  1366 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.594393 30928 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:07.570497 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:07.564283 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.534337  1433 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:07.534162  1474 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:07.540648  1427 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:23:07.643461 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.537163  1503 raft_consensus.cc:697] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:07.605628 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:07.640478 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 63980.5us
I20260709 12:23:07.645030 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1513) took 1591 ms. Trace:
I20260709 12:23:07.645262 30899 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:07.646346 31508 raft_consensus.cc:2393] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:23:07.567023  1365 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:23:07.555167  1476 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:07.645444 30777 rpcz_store.cc:276] 0709 12:23:06.053675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.046669 (+992994us) service_pool.cc:224] Handling call
0709 12:23:07.065581 (+ 18912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.065845 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:07.413229 (+347384us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.643081 (+229852us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.644696 (+  1615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.644745 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:07.644793 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.644863 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.644975 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36937,"prepare.queue_time_us":64398,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":4531,"raft.queue_time_us":81,"thread_start_us":530858,"threads_started":2}
I20260709 12:23:07.618108  1475 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:07.599031  1429 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:07.619282  1377 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:07.648903 31510 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:07.664284  1426 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:07.665097 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.668821 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.618842 30778 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:07.567251  1441 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:23:07.571955  1566 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:07.644217  1438 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:07.627337  1478 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:07.657609 30750 leader_election.cc:400] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10.
I20260709 12:23:07.653981  1384 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:07.660122 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1612) took 1109 ms. Trace:
I20260709 12:23:07.656090  1427 raft_consensus.cc:697] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:07.662530  1429 raft_consensus.cc:697] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.663524  1365 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:07.648105  1422 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:07.681885 30899 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:07.682051 30900 leader_election.cc:336] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.651s (SENT)
I20260709 12:23:07.653889  1489 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:07.658591  1475 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.638520  1484 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:23:07.649513  1537 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:23:07.698077 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:07.688158 30779 rpcz_store.cc:276] 0709 12:23:06.550741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.145524 (+594783us) service_pool.cc:224] Handling call
0709 12:23:07.152503 (+  6979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:07.159058 (+  6555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.159103 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:07.160453 (+  1350us) log.cc:844] Serialized 26 byte log entry
0709 12:23:07.409639 (+249186us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:07.409698 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.409814 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:07.659916 (+250102us) raft_consensus.cc:1685] finished
0709 12:23:07.659937 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.660062 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6100,"raft.queue_time_us":6766,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":682,"spinlock_wait_cycles":415104,"thread_start_us":248216,"threads_started":1,"wal-append.queue_time_us":437958}
I20260709 12:23:07.674199  1476 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.714252  1065 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:07.715526  1476 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:07.715992  1065 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:07.716418  1065 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.718080  1422 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.707487  1489 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.718842  1489 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.719117  1422 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.722151  1537 raft_consensus.cc:3055] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:07.722626  1537 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.722353  1427 consensus_queue.cc:237] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.723488  1537 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.724718  1537 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:07.726768  1429 consensus_queue.cc:237] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.710378  1569 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.732254  1569 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:07.729684  1580 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.686266  1566 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.735678  1580 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.717262  1065 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.736348  1566 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.736938  1065 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.741969 30929 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:07.744532  1487 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.745254  1500 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.745920  1500 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:07.691237  1365 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:07.751358  1365 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.752954  1365 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:07.754143  1384 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.755427  1384 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:07.757166 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.758548 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 394) took 3218 ms. Trace:
I20260709 12:23:07.758973 30852 rpcz_store.cc:276] 0709 12:23:04.540090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.540211 (+   121us) service_pool.cc:224] Handling call
0709 12:23:04.592919 (+ 52708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:04.621963 (+ 29044us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:04.839068 (+217105us) log.cc:844] Serialized 14 byte log entry
0709 12:23:04.930217 (+ 91149us) log.cc:844] Serialized 14 byte log entry
0709 12:23:05.679358 (+749141us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b1800358c60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f96148f358f 00007f960d932571 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd
0709 12:23:06.882318 (+1202960us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b1800358c60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:06.954652 (+ 72334us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b1800358c60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:07.018802 (+ 64150us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800358c60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287
0709 12:23:07.022001 (+  3199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.022055 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:07.022108 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.109062 (+ 86954us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:07.758281 (+649219us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b54004367d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:07.758331 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.758485 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":560041,"prepare.queue_time_us":2295898,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":32169,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":8462,"spinlock_wait_cycles":247419520,"thread_start_us":333601,"threads_started":3,"wal-append.queue_time_us":198164}
W20260709 12:23:07.761730 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 112985us
W20260709 12:23:07.764109 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.760170  1377 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.764509 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:07.793825 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:07.767593 30852 raft_consensus.cc:1240] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:07.794967 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1473) took 2124 ms. Trace:
I20260709 12:23:07.795387 30852 rpcz_store.cc:276] 0709 12:23:05.672768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.761348 (+2088580us) service_pool.cc:224] Handling call
0709 12:23:07.767352 (+  6004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.794647 (+ 27295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.794896 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.785772 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1449) took 1386 ms. Trace:
I20260709 12:23:07.797067 30934 rpcz_store.cc:276] 0709 12:23:06.398990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.052989 (+653999us) service_pool.cc:224] Handling call
0709 12:23:07.053342 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.601346 (+548004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.785533 (+184187us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54002251d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:07.785692 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164643584}
I20260709 12:23:07.789935 30785 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:07.790040 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 77436.1us
I20260709 12:23:07.772531 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1497) took 3735 ms. Trace:
I20260709 12:23:07.802999 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:07.803654 30778 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.778790 30679 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.800499 30780 rpcz_store.cc:276] 0709 12:23:04.036790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:04.036950 (+   160us) service_pool.cc:224] Handling call
0709 12:23:04.037389 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.208470 (+3171081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.772204 (+563734us) spinlock_profiling.cc:243] Waited 3.17 s on lock 0x7b5400118ad4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:07.772444 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7285482880}
I20260709 12:23:07.822786 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:07.823540 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 141499us
I20260709 12:23:07.829663  1441 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.830256 30852 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:07.830467 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1474) took 2157 ms. Trace:
I20260709 12:23:07.830935 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1475) took 2157 ms. Trace:
I20260709 12:23:07.831308 30852 rpcz_store.cc:276] 0709 12:23:05.673540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.829478 (+2155938us) service_pool.cc:224] Handling call
0709 12:23:07.829923 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.830689 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.830880 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27776}
I20260709 12:23:07.832955 30852 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:07.833477 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1483) took 2157 ms. Trace:
I20260709 12:23:07.834139 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:07.767315  1377 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:07.838165 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.788674  1540 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.839365 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:07.839453  1438 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.840341 30777 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:07.840651 30855 raft_consensus.cc:1240] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:07.709642  1397 raft_consensus.cc:2764] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:07.830829 30854 rpcz_store.cc:276] 0709 12:23:05.673196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.829478 (+2156282us) service_pool.cc:224] Handling call
0709 12:23:07.829923 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.830109 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.830134 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.830176 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.830205 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.830282 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.830409 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42880}
I20260709 12:23:07.841688  1547 raft_consensus.cc:2764] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:23:07.842442  1550 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:07.842928  1550 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.843304  1550 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:07.844218  1438 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.842554 30854 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:07.845407 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1484) took 2168 ms. Trace:
I20260709 12:23:07.845736 30854 rpcz_store.cc:276] 0709 12:23:05.676628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.842057 (+2165429us) service_pool.cc:224] Handling call
0709 12:23:07.842376 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.844883 (+  2507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.845312 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.830293  1441 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.847151 30854 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:07.847939 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1491) took 2168 ms. Trace:
I20260709 12:23:07.848306  1441 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.848232 30854 rpcz_store.cc:276] 0709 12:23:05.679055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.846553 (+2167498us) service_pool.cc:224] Handling call
0709 12:23:07.846867 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.847487 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.847887 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.849478 30854 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:07.851704  1489 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.853883  1411 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:07.854094  1489 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.854535  1411 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:07.855017  1411 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:07.855072 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1492) took 2175 ms. Trace:
I20260709 12:23:07.776382 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.781962  1503 consensus_queue.cc:237] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.765799  1523 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:07.855480 30854 rpcz_store.cc:276] 0709 12:23:05.679317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.849049 (+2169732us) service_pool.cc:224] Handling call
0709 12:23:07.849326 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.854811 (+  5485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.854995 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.854457 30852 rpcz_store.cc:276] 0709 12:23:05.676335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.832319 (+2155984us) service_pool.cc:224] Handling call
0709 12:23:07.832624 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.833255 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.833425 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.892629 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 400) took 2107 ms. Trace:
I20260709 12:23:07.893311 30852 rpcz_store.cc:276] 0709 12:23:05.785529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.890508 (+2104979us) service_pool.cc:224] Handling call
0709 12:23:07.890874 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.892166 (+  1292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.892195 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.892243 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:07.892288 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.892374 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.892552 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.864413 30778 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:07.897600 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 401) took 2104 ms. Trace:
I20260709 12:23:07.898279 30852 rpcz_store.cc:276] 0709 12:23:05.792910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.896489 (+2103579us) service_pool.cc:224] Handling call
0709 12:23:07.896913 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.897154 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.897198 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.897261 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.897308 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.897388 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.897525 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:07.867388 30899 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:07.881990 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 304032us
I20260709 12:23:07.901368 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 402) took 2105 ms. Trace:
I20260709 12:23:07.901846 30852 rpcz_store.cc:276] 0709 12:23:05.796222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.900420 (+2104198us) service_pool.cc:224] Handling call
0709 12:23:07.900728 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.900943 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.900968 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.901026 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:07.901062 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.901124 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.901312 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:07.906656 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:07.878473  1523 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.910210 30899 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:07.912530  1523 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:07.913255  1523 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:07.690011  1478 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.861869  1419 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:07.917102  1540 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:07.918077  1588 consensus_meta.cc:287] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.714s	user 0.013s	sys 0.000s
I20260709 12:23:07.918658  1588 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.919984 30781 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:07.921857  1397 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:07.922365  1397 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:07.922863  1397 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:07.915457  1523 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:07.873943  1390 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:07.926576  1390 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.926823  1523 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.929415  1478 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:07.930131 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:07.930891 30778 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:07.941679 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 399) took 2156 ms. Trace:
I20260709 12:23:07.942355 30854 rpcz_store.cc:276] 0709 12:23:05.785210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.889864 (+2104654us) service_pool.cc:224] Handling call
0709 12:23:07.941028 (+ 51164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.941265 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.941303 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.941358 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.941402 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.941474 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.941607 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:07.943452 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 118885us
I20260709 12:23:07.921392  1588 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:07.948252 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:07.933465 30899 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:07.784065  1439 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.933176 30825 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:07.783147  1440 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:07.965809 30784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.008s	sys 0.007s
W20260709 12:23:07.966305 30784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.008s	sys 0.007s
W20260709 12:23:07.971764 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 326126us
I20260709 12:23:07.979435 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1522) took 1855 ms. Trace:
I20260709 12:23:07.980039 30784 rpcz_store.cc:276] 0709 12:23:06.123682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.058933 (+935251us) service_pool.cc:224] Handling call
0709 12:23:07.059202 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.059394 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:07.235797 (+176403us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.978682 (+742885us) log.cc:844] Serialized 14 byte log entry
0709 12:23:07.978983 (+   301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:07.979040 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:07.979107 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.979198 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:07.979355 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20833,"prepare.queue_time_us":54721,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":760,"thread_start_us":870593,"threads_started":2}
W20260709 12:23:07.992880 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:07.993111 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 45472.3us
I20260709 12:23:07.995903 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:07.996955 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:07.997696 30928 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.007709 30928 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:08.009913 30931 raft_consensus.cc:1275] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:23:08.013671 30931 pending_rounds.cc:85] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 2
I20260709 12:23:08.013839 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:08.014106 30931 pending_rounds.cc:107] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:23:08.014583 30931 raft_consensus.cc:2889] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:08.010840 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46961.7us
I20260709 12:23:08.017091 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:08.010975 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 45290.8us
I20260709 12:23:08.012027 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:08.025003 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:08.029520 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 404) took 2073 ms. Trace:
I20260709 12:23:08.029996 30854 rpcz_store.cc:276] 0709 12:23:05.935736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.943767 (+2008031us) service_pool.cc:224] Handling call
0709 12:23:08.008878 (+ 65111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:08.009060 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.009086 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:08.009122 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:08.009156 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.009209 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:08.009355 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:08.032141 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:08.032781 30926 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:08.034389 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:08.036435 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:08.038372 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:07.961676  1245 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:08.036684 30900 leader_election.cc:336] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.904s (SENT)
I20260709 12:23:08.043958 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:08.046584 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:07.995158  1438 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:07.878042  1411 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.994710  1543 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:08.064106 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:08.052588 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:08.065855 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:08.053515 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:08.054198 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:08.056315 30854 raft_consensus.cc:1275] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:08.008690  1377 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:07.905735  1550 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:07.960743  1547 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:23:08.070209 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:08.071988 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:08.040352  1495 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:08.073378 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.034091  1440 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.066736 30931 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:08.055846  1428 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:08.056757  1439 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:08.074584 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:08.063848  1419 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:08.135645 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:08.033685  1487 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:23:08.028599  1433 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:08.117875 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 473295us
I20260709 12:23:08.121186 30933 raft_consensus.cc:2410] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:23:08.123124 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:08.124861 30926 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:08.069811  1377 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:08.157411  1377 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:08.125329  1588 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:08.128381  1440 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.072964  1566 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:08.164188  1433 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:08.166996  1411 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:08.073616  1517 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:08.169831 30826 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:08.149422 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 412) took 1530 ms. Trace:
I20260709 12:23:08.171159 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:08.171489 30782 rpcz_store.cc:276] 0709 12:23:06.618696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.356069 (+737373us) service_pool.cc:224] Handling call
0709 12:23:07.416170 (+ 60101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.419142 (+  2972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.149201 (+730059us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b540028ffd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:08.149356 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136989184}
I20260709 12:23:08.172273 30826 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:08.073462  1438 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:08.175374 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:08.184099 30826 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:08.184890 30854 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:08.064617  1543 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:08.154405  1601 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:23:08.207599 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:08.174343  1550 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:08.177246  1440 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:08.118682 30853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.046s	sys 0.120s
I20260709 12:23:08.187381 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.187615 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.189077 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.136155  1495 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:08.191656 30782 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:08.228278 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.168030  1517 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:08.239810 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.195458 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1471) took 2537 ms. Trace:
I20260709 12:23:08.246066 30855 rpcz_store.cc:276] 0709 12:23:05.657674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.594587 (+1936913us) service_pool.cc:224] Handling call
0709 12:23:07.594992 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.841058 (+246066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.195099 (+354041us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540015cf54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:08.195369 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564611584}
W20260709 12:23:08.203509 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.063740  1245 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.189380 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:08.217051 30853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.046s	sys 0.121s
I20260709 12:23:08.218211 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:08.218737 30784 raft_consensus.cc:2393] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:08.230490 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.234853 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.283332 30777 raft_consensus.cc:2393] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:23:08.283766 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 99898.7us
I20260709 12:23:08.284653 30782 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:23:08.235476 30854 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:08.148480  1554 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:23:08.247908 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.286880 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 214957us
I20260709 12:23:08.287137 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.290205 30778 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:08.206931  1543 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:08.284690 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:08.208449  1419 raft_consensus.cc:697] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:08.232154  1427 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.011s
I20260709 12:23:08.300711 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:08.380777 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.143020  1439 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:08.284832  1411 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:08.211656  1609 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:08.210530  1275 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:08.290458  1503 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:08.340456  1474 consensus_meta.cc:287] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.003s
W20260709 12:23:08.339810  1537 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.003s
I20260709 12:23:08.375818  1554 raft_consensus.cc:697] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:08.466810 30931 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:08.467078 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.469285 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 171229us
I20260709 12:23:08.448017 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1437) took 2439 ms. Trace:
W20260709 12:23:08.407145  1427 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.006s	sys 0.012s
W20260709 12:23:08.484519 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:08.440132  1523 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.010s
W20260709 12:23:08.474449 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 189851us
I20260709 12:23:08.508512 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:08.501957 30900 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:08.507395 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:08.511766 30779 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:08.422400  1440 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:08.470474 30935 rpcz_store.cc:276] 0709 12:23:06.008894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.051183 (+1042289us) service_pool.cc:224] Handling call
0709 12:23:07.051493 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:07.444078 (+392585us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:23:07.444122 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:07.444875 (+   753us) log.cc:844] Serialized 52 byte log entry
0709 12:23:07.654913 (+210038us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:07.654950 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:07.655012 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:08.447751 (+792739us) raft_consensus.cc:1685] finished
0709 12:23:08.447776 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:08.447940 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":450913,"raft.queue_time_us":393194,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12743,"thread_start_us":151160,"threads_started":1,"wal-append.queue_time_us":525665}
W20260709 12:23:08.585249 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.010s
W20260709 12:23:08.507742  1523 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.007s	sys 0.010s
W20260709 12:23:08.644929 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.008s	sys 0.010s
W20260709 12:23:08.645794 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 628985us
I20260709 12:23:08.646793 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:08.447062  1505 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 12:23:08.422921  1411 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.466192  1474 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.501497  1524 consensus_queue.cc:1059] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:23:08.523573  1186 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 12:23:08.606573  1397 consensus_meta.cc:287] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.001s
I20260709 12:23:08.624732  1517 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:08.603731  1537 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:23:08.504426  1438 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.617880  1422 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:08.464798  1495 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:08.444895  1384 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:08.520884  1419 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:08.678542 30934 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:23:08.617580  1377 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:08.687789  1615 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:23:08.694934  1620 log.cc:927] Time spent T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:23:08.681614  1523 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:08.682824  1639 raft_consensus.cc:2764] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:23:08.708581  1603 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 12:23:08.710724  1610 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 12:23:08.748343  1439 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:08.783701  1500 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:08.783963  1523 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:08.806290  1619 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:23:08.677794  1554 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.825661  1523 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:08.837433  1517 raft_consensus.cc:3055] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:08.837961  1517 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:08.838807  1517 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.839978  1517 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:08.801437  1616 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 12:23:08.823190  1632 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:23:08.891912  1623 log.cc:927] Time spent T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.264s	user 0.001s	sys 0.001s
W20260709 12:23:08.902688  1608 log.cc:927] Time spent T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.436s	user 0.001s	sys 0.002s
W20260709 12:23:08.904608  1638 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
W20260709 12:23:08.905561  1636 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 12:23:08.908144  1624 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
W20260709 12:23:08.904613  1629 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 12:23:08.931079  1543 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:08.934535  1543 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.249152 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1614) took 2697 ms. Trace:
I20260709 12:23:09.256402 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 381) took 1089 ms. Trace:
I20260709 12:23:09.257140 30926 rpcz_store.cc:276] 0709 12:23:08.167074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.167321 (+   247us) service_pool.cc:224] Handling call
0709 12:23:08.167715 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:08.222799 (+ 55084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.222839 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:08.223418 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:23:08.390997 (+167579us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:08.391057 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.391150 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:08.822514 (+431364us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:09.162450 (+339936us) raft_consensus.cc:1685] finished
0709 12:23:09.216796 (+ 54346us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.256069 (+ 39273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89756,"raft.queue_time_us":66332,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":33097,"spinlock_wait_cycles":100728192,"thread_start_us":167225,"threads_started":1,"wal-append.queue_time_us":370325}
I20260709 12:23:09.259922 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 384) took 1086 ms. Trace:
I20260709 12:23:09.260507 30928 rpcz_store.cc:276] 0709 12:23:08.172969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.174322 (+  1353us) service_pool.cc:224] Handling call
0709 12:23:08.174604 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:08.332260 (+157656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.332295 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:08.332338 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:08.332372 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.259352 (+926980us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54001c75d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:09.259422 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.259713 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362120448}
I20260709 12:23:09.262985 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 370) took 3310 ms. Trace:
I20260709 12:23:09.263463 30929 rpcz_store.cc:276] 0709 12:23:05.951918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:05.952066 (+   148us) service_pool.cc:224] Handling call
0709 12:23:05.960250 (+  8184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.742483 (+1782233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.262287 (+1519804us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54002a3354. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:09.262625 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4096423680}
I20260709 12:23:09.265769 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1464) took 1231 ms. Trace:
W20260709 12:23:09.266372  1640 log.cc:927] Time spent T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.517s	user 0.005s	sys 0.009s
I20260709 12:23:09.249711 30781 rpcz_store.cc:276] 0709 12:23:06.551332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.170966 (+619634us) service_pool.cc:224] Handling call
0709 12:23:07.171210 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:07.920386 (+749176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.248563 (+1328177us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b540014e1d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:09.248933 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721560832}
W20260709 12:23:09.274606  1607 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.868s	user 0.011s	sys 0.015s
W20260709 12:23:09.276443  1634 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.645s	user 0.011s	sys 0.009s
I20260709 12:23:09.034565 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 403) took 3236 ms. Trace:
I20260709 12:23:09.043536 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1525) took 2562 ms. Trace:
W20260709 12:23:09.276113 30931 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.019s
W20260709 12:23:09.046737 30857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.003s	sys 0.001s
W20260709 12:23:09.279526 30857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.004s	sys 0.001s
W20260709 12:23:09.047652 31477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.004s	sys 0.018s
I20260709 12:23:09.278522 30852 rpcz_store.cc:276] 0709 12:23:05.798113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.904438 (+2106325us) service_pool.cc:224] Handling call
0709 12:23:07.907065 (+  2627us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:07.944304 (+ 37239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.944336 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:07.960869 (+ 16533us) log.cc:844] Serialized 52 byte log entry
0709 12:23:08.285098 (+324229us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:08.351214 (+ 66116us) log.cc:844] Serialized 14 byte log entry
0709 12:23:08.388481 (+ 37267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.389170 (+   689us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:08.891155 (+501985us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:09.033342 (+142187us) raft_consensus.cc:1685] finished
0709 12:23:09.033598 (+   256us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.034183 (+   585us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37363,"raft.queue_time_us":48277,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":50448,"spinlock_wait_cycles":118350080,"thread_start_us":216020,"threads_started":1,"wal-append.queue_time_us":614452}
W20260709 12:23:09.280925 31477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.004s	sys 0.018s
W20260709 12:23:09.042202 30782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.032s	sys 0.028s
W20260709 12:23:09.281482 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 1.05734e+06us
W20260709 12:23:09.282014 30782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.032s	sys 0.028s
I20260709 12:23:08.710031  1384 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:08.754132  1390 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.055342  1245 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.056527  1411 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:09.037329 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:09.062587 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.711717  1422 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:09.062074 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 413830us
I20260709 12:23:09.064607  1377 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:09.065639 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.073415  1474 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.266314 30933 rpcz_store.cc:276] 0709 12:23:08.034009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.034131 (+   122us) service_pool.cc:224] Handling call
0709 12:23:09.265152 (+1231021us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b54002143d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:09.265503 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197064448}
W20260709 12:23:09.292222 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:08.696411  1397 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.278594 30783 rpcz_store.cc:276] 0709 12:23:06.480731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.117516 (+636785us) service_pool.cc:224] Handling call
0709 12:23:07.119372 (+  1856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:07.119747 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:07.119774 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:07.120212 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:23:07.584136 (+463924us) spinlock_profiling.cc:243] Waited 906 us on lock 0x7b18003a0de0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf0d1 00007f96109daa0f
0709 12:23:08.038062 (+453926us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:08.038120 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.038212 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.042843 (+1004631us) raft_consensus.cc:1685] finished
0709 12:23:09.042884 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.043310 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3298,"raft.queue_time_us":1216,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":4338,"spinlock_wait_cycles":2084736,"thread_start_us":453712,"threads_started":1,"wal-append.queue_time_us":1127193}
I20260709 12:23:09.294902  1422 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.295619  1397 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.284072 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1458) took 1225 ms. Trace:
I20260709 12:23:09.283820 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:09.297159 30932 rpcz_store.cc:276] 0709 12:23:07.994788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.995474 (+   686us) service_pool.cc:224] Handling call
0709 12:23:08.009490 (+ 14016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:08.028466 (+ 18976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.028515 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:08.043567 (+ 15052us) log.cc:844] Serialized 26 byte log entry
0709 12:23:08.439285 (+395718us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:08.439344 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.439421 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.040113 (+600692us) raft_consensus.cc:1685] finished
0709 12:23:09.040162 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.220445 (+180283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2520,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":12792,"thread_start_us":340664,"threads_started":1,"wal-append.queue_time_us":541991}
I20260709 12:23:09.283267  1384 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.284860 30931 raft_consensus.cc:2410] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:23:09.309496 30783 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:09.310549 30779 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:09.314733 30776 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:09.315107 30777 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:09.316653 30778 raft_consensus.cc:1240] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:09.286597 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1459) took 1291 ms. Trace:
W20260709 12:23:09.285069 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 782979us
I20260709 12:23:09.299671 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:09.313571 30783 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:09.299043  1397 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.337965  1626 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.338452 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:09.338905  1626 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:09.339702  1411 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:09.340262  1411 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:09.340775  1411 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:09.343422  1186 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:09.344274  1186 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:09.341531  1489 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:09.346755 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.346814  1489 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:09.347669  1489 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:09.335713 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 52223.7us
I20260709 12:23:09.313601 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:09.357967  1618 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.705s	user 0.007s	sys 0.007s
I20260709 12:23:09.368508 30783 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:09.318461 30930 rpcz_store.cc:276] 0709 12:23:07.995118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.995573 (+   455us) service_pool.cc:224] Handling call
0709 12:23:08.041237 (+ 45664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:08.041791 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:08.328304 (+286513us) log.cc:844] Serialized 14 byte log entry
0709 12:23:08.617725 (+289421us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:08.649460 (+ 31735us) log.cc:844] Serialized 26 byte log entry
0709 12:23:08.649919 (+   459us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:08.649979 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:08.650080 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.286075 (+635995us) raft_consensus.cc:1685] finished
0709 12:23:09.286113 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.286383 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3291,"prepare.queue_time_us":116349,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":3836,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":27482,"thread_start_us":398791,"threads_started":2,"wal-append.queue_time_us":318537}
I20260709 12:23:09.371724  1390 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.383721  1390 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.386427  1543 consensus_queue.cc:1059] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:09.390806 30785 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.981s	user 0.026s	sys 0.057s
I20260709 12:23:09.392247  1500 consensus_queue.cc:1059] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:23:09.393057 30785 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.026s	sys 0.058s
I20260709 12:23:09.393846  1554 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:09.394281  1500 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:09.394971  1148 raft_consensus.cc:3055] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:09.395649  1148 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.396481  1554 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:09.391443  1390 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.355095  1186 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:09.412698 30776 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:09.414880  1478 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:09.397279  1148 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.418087  1148 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:09.392400  1517 consensus_meta.cc:287] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.551s	user 0.017s	sys 0.001s
I20260709 12:23:09.373840  1397 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.389513  1543 raft_consensus.cc:3055] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:09.425961  1543 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.439342  1397 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.438998  1543 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.440276 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.419477  1537 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:09.443172 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 66699.7us
W20260709 12:23:09.440631  1608 log.cc:927] Time spent T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.061s	user 0.000s	sys 0.004s
I20260709 12:23:09.445233  1626 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:07.859586 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.456866 30679 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 2 to 6, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 7857bffc34ce4e1db3617488701b9810 (127.28.234.68). New cstate: current_term: 6 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:09.460479 30679 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:09.462941  1365 consensus_meta.cc:287] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 1.709s	user 0.014s	sys 0.015s
I20260709 12:23:09.470065 30784 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:09.476581 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.482352 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:09.481586 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 141773us
I20260709 12:23:09.485580 30851 raft_consensus.cc:1240] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:09.486523 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1472) took 3816 ms. Trace:
I20260709 12:23:09.486872 30851 rpcz_store.cc:276] 0709 12:23:05.669855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.602675 (+1932820us) service_pool.cc:224] Handling call
0709 12:23:07.602957 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:09.480185 (+1877228us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5400283d20. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610996dc0 00007f9610a211c0 00007f9610a22231 00007f9610a1ed8f 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c
0709 12:23:09.486124 (+  5939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.486441 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37803392}
I20260709 12:23:09.452307  1489 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.493920  1537 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.494658  1543 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.496532  1537 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.500720  1489 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:09.503185  1607 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.172s	user 0.000s	sys 0.004s
I20260709 12:23:09.535233 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.537310 30777 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:09.537118  1411 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.538435 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1456) took 3137 ms. Trace:
I20260709 12:23:09.535482 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33366 (request call id 382) took 1365 ms. Trace:
I20260709 12:23:09.540406 30931 rpcz_store.cc:276] 0709 12:23:08.170449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.207321 (+ 36872us) service_pool.cc:224] Handling call
0709 12:23:09.535170 (+1327849us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400225bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:09.535411 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594262400}
I20260709 12:23:09.539968  1411 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.538914 30927 rpcz_store.cc:276] 0709 12:23:06.400933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.149387 (+748454us) service_pool.cc:224] Handling call
0709 12:23:07.160875 (+ 11488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:07.509914 (+349039us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:23:07.518100 (+  8186us) log.cc:844] Serialized 14 byte log entry
0709 12:23:08.037455 (+519355us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:08.157817 (+120362us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b18001b4f60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:08.827553 (+669736us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:09.257095 (+429542us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b18001b4f60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9002a6 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a
0709 12:23:09.279000 (+ 21905us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b2c000623c8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2
0709 12:23:09.280176 (+  1176us) log.cc:844] Serialized 52 byte log entry
0709 12:23:09.280474 (+   298us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:09.414197 (+133723us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.414459 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.416332 (+  1873us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.502866 (+ 86534us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b24002064f8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d7b89c4 00007f960d7b6acb 00007f960d971dc9 00007f960d971a55 00007f960d97109d 00007f96105a310e 00007f96105ba88c 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221
0709 12:23:09.538026 (+ 35160us) raft_consensus.cc:1685] finished
0709 12:23:09.538051 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.538230 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":419782,"prepare.queue_time_us":17142,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":377048,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":23736,"spinlock_wait_cycles":132188672,"thread_start_us":584856,"threads_started":2,"wal-append.queue_time_us":691753}
I20260709 12:23:09.544689  1489 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.565779  1428 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:09.566393 30785 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1537) took 1376 ms. Trace:
I20260709 12:23:09.566707  1428 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:09.566938 30785 rpcz_store.cc:276] 0709 12:23:08.189813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.241887 (+ 52074us) service_pool.cc:224] Handling call
0709 12:23:08.242316 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:08.283115 (+ 40799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.283146 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:08.284844 (+  1698us) log.cc:844] Serialized 26 byte log entry
0709 12:23:09.465940 (+1181096us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:09.466020 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.466145 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.542195 (+ 76050us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b18003d9660. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:09.565983 (+ 23788us) raft_consensus.cc:1685] finished
0709 12:23:09.566009 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.566323 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39845,"raft.queue_time_us":40383,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":35619,"spinlock_wait_cycles":54412672,"thread_start_us":1018209,"threads_started":1,"wal-append.queue_time_us":1083924}
I20260709 12:23:09.568646 30930 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 9. Ops: []
I20260709 12:23:09.569613  1489 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.571170  1428 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:09.571784  1489 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.573843 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.575028 30931 raft_consensus.cc:2410] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:23:09.579003 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.580310 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.581147 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.583355 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.584184 30926 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:23:09.586866 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.581161 30929 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:09.587939 30935 raft_consensus.cc:2410] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:23:09.587350 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.578714 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.578195 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.581265 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.593938 30932 raft_consensus.cc:2393] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:09.600163 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:09.600855 30926 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:09.557864 30900 connection.cc:256] RPC call timeout handler was delayed by -1.1148253970000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 12:23:09.619992 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.622300 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:09.627547 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:09.629863 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.629856 30782 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.630070 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.635749 30933 raft_consensus.cc:2393] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:09.637909  1366 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:09.639123 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.627799 30780 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1544) took 1297 ms. Trace:
I20260709 12:23:09.639971 30776 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:09.642028 30779 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:09.642170  1420 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.648320 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.650427 30930 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:23:09.654881 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1466) took 3998 ms. Trace:
I20260709 12:23:09.655061 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1469) took 3997 ms. Trace:
I20260709 12:23:09.656477  1543 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:09.655347 30860 rpcz_store.cc:276] 0709 12:23:05.656182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.590720 (+1934538us) service_pool.cc:224] Handling call
0709 12:23:07.591062 (+   342us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:07.956274 (+365212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.956305 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:08.002431 (+ 46126us) log.cc:844] Serialized 78 byte log entry
0709 12:23:08.295970 (+293539us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:08.424377 (+128407us) log.cc:844] Serialized 14 byte log entry
0709 12:23:08.907389 (+483012us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:09.340310 (+432921us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b18000fb980. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf 00007f9610a39038
0709 12:23:09.340875 (+   565us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.653978 (+313103us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.654245 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.654404 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.654469 (+    65us) raft_consensus.cc:1685] finished
0709 12:23:09.654480 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.654683 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1579149,"prepare.queue_time_us":1960497,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":103,"raft.queue_time_us":58154,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":23432,"spinlock_wait_cycles":124609664,"thread_start_us":585947,"threads_started":2,"wal-append.queue_time_us":568937}
I20260709 12:23:09.657143 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1467) took 4000 ms. Trace:
I20260709 12:23:09.639931 30780 rpcz_store.cc:276] 0709 12:23:08.326839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.327212 (+   373us) service_pool.cc:224] Handling call
0709 12:23:08.466574 (+139362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:08.468631 (+  2057us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:09.481691 (+1013060us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b1800228700. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf
0709 12:23:09.482331 (+   640us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.558112 (+ 75781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:09.591298 (+ 33186us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:09.610957 (+ 19659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.615558 (+  4601us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.624570 (+  9012us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4376,"prepare.queue_time_us":46364,"prepare.run_cpu_time_us":9492,"prepare.run_wall_time_us":117158,"raft.queue_time_us":30615,"spinlock_wait_cycles":35425536,"thread_start_us":206686,"threads_started":3,"wal-append.queue_time_us":64868}
I20260709 12:23:09.657565 30857 rpcz_store.cc:276] 0709 12:23:05.656471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.592125 (+1935654us) service_pool.cc:224] Handling call
0709 12:23:07.592469 (+   344us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:07.999834 (+407365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.999880 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:08.030049 (+ 30169us) log.cc:844] Serialized 78 byte log entry
0709 12:23:09.280420 (+1250371us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:09.349020 (+ 68600us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.656266 (+307246us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.656645 (+   379us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.656786 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.656905 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.656942 (+    37us) raft_consensus.cc:1685] finished
0709 12:23:09.656954 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.657088 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":374693,"prepare.queue_time_us":72278,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":119,"raft.queue_time_us":18105,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":64,"thread_start_us":1627046,"threads_started":2,"wal-append.queue_time_us":1063714}
I20260709 12:23:09.659273  1390 consensus_queue.cc:1059] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:09.660764  1148 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:09.661938  1626 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.662046  1554 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:09.662613  1554 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.662659  1626 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:09.664304  1438 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.664136  1554 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.666071  1554 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.666153  1365 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.666853 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.666781  1365 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.668342 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1462) took 4013 ms. Trace:
I20260709 12:23:09.669044  1365 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.657588  1478 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:23:09.670390  1371 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:09.672533 30784 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.673910  1477 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:09.674739  1477 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.675097  1419 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:09.676425  1478 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:09.676860  1478 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.673969  1065 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.678005  1478 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.679409  1478 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:09.680195 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.668759 30856 rpcz_store.cc:276] 0709 12:23:05.654972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.419505 (+1764533us) service_pool.cc:224] Handling call
0709 12:23:07.439282 (+ 19777us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:07.518610 (+ 79328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.518651 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:07.527734 (+  9083us) log.cc:844] Serialized 78 byte log entry
0709 12:23:08.030379 (+502645us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:08.438910 (+408531us) log.cc:844] Serialized 14 byte log entry
0709 12:23:08.902322 (+463412us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b2400298088. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d7b89c4 00007f960d7b6acb 00007f960d971dc9 00007f960d971a55 00007f960d97109d 00007f96105a310e 00007f96105ba88c 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221
0709 12:23:09.604178 (+701856us) spinlock_profiling.cc:243] Waited 6.13 ms on lock 0x7b18000873a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:23:09.618059 (+ 13881us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.667527 (+ 49468us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.667733 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.667866 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.667924 (+    58us) raft_consensus.cc:1685] finished
0709 12:23:09.667935 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.668133 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":988423,"prepare.queue_time_us":451159,"prepare.run_cpu_time_us":191,"prepare.run_wall_time_us":8251,"raft.queue_time_us":1326822,"raft.run_cpu_time_us":618,"raft.run_wall_time_us":15737,"spinlock_wait_cycles":19946240,"thread_start_us":774709,"threads_started":2,"wal-append.queue_time_us":738768}
W20260709 12:23:09.684607 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.665073  1438 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.678395  1065 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.697407 30779 raft_consensus.cc:1240] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:09.699445 30784 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:09.665521  1626 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:09.687294 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.703593  1474 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:09.704628 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 408) took 2190 ms. Trace:
I20260709 12:23:09.706629  1065 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.706817 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:09.707304  1065 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:09.708410  1397 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:09.708920  1397 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.708532  1644 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:09.709306  1397 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.709833  1543 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:09.711789  1537 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:09.681519  1475 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:09.704274  1474 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.715519  1474 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.710180  1065 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:09.662638  1148 raft_consensus.cc:3055] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:09.727608 30781 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:23:09.655520 30853 rpcz_store.cc:276] 0709 12:23:05.657083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.594548 (+1937465us) service_pool.cc:224] Handling call
0709 12:23:07.594905 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:08.282020 (+687115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:08.282050 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:08.299002 (+ 16952us) log.cc:844] Serialized 52 byte log entry
0709 12:23:08.580352 (+281350us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:08.903755 (+323403us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:09.342530 (+438775us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.654109 (+311579us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.654440 (+   331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.654535 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.654705 (+   170us) raft_consensus.cc:1685] finished
0709 12:23:09.654724 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.654880 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1072221,"prepare.queue_time_us":767290,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":344303,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":258,"spinlock_wait_cycles":115697408,"thread_start_us":821631,"threads_started":2,"wal-append.queue_time_us":251944}
I20260709 12:23:09.732733 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.734138 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.733587 30899 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:09.736115 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:09.732666 30783 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:09.727448 30777 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:09.721215  1065 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.738731 30785 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:09.739233 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1457) took 1689 ms. Trace:
I20260709 12:23:09.739614  1065 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:09.740114  1661 log.cc:927] Time spent T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:23:09.739734 30934 rpcz_store.cc:276] 0709 12:23:07.994425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.994775 (+   350us) service_pool.cc:224] Handling call
0709 12:23:07.995216 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:09.036503 (+1041287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.683691 (+647188us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54001c7ad4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:09.683985 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570644224}
I20260709 12:23:09.740829 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.741117  1065 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.705058 30858 rpcz_store.cc:276] 0709 12:23:07.514572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:08.047798 (+533226us) service_pool.cc:224] Handling call
0709 12:23:08.069345 (+ 21547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:08.458453 (+389108us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:09.524249 (+1065796us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.700545 (+176296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:09.703535 (+  2990us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:09.703603 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.704240 (+   637us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540002c6d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:09.704292 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.704467 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":949598,"prepare.queue_time_us":885371,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":96,"raft.queue_time_us":81706,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"spinlock_wait_cycles":894074624,"thread_start_us":227799,"threads_started":2}
I20260709 12:23:09.736992  1644 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:09.746961  1644 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:09.754902 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.755730  1186 consensus_queue.cc:1048] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:09.723969  1148 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.735740  1626 consensus_queue.cc:1059] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:23:09.732319  1543 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:09.783239 30926 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:09.781252 30779 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:09.749440  1644 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:09.790532  1477 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.791661  1438 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.791821  1148 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.792315 30769 tablet_service.cc:1558] Processing DeleteTablet for tablet dd65da5a34854820ae636ab77116f737 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:54636
I20260709 12:23:09.792433  1384 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:09.794019 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 61884.5us
I20260709 12:23:09.796627 30928 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:23:09.804093 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.808197  1537 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:09.810212  1428 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:09.811062  1428 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.812350  1428 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.802009 30899 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:09.817978  1537 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:09.818087  1606 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.818481  1537 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.818965  1537 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:09.818780  1606 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.819401  1668 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:09.820079  1668 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.821470 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1465) took 4165 ms. Trace:
I20260709 12:23:09.821691  1606 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.821915 30859 rpcz_store.cc:276] 0709 12:23:05.655877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.588449 (+1932572us) service_pool.cc:224] Handling call
0709 12:23:07.588848 (+   399us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:07.589234 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:07.589262 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:07.618627 (+ 29365us) log.cc:844] Serialized 78 byte log entry
0709 12:23:08.029678 (+411051us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:09.583399 (+1553721us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b1800458260. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf
0709 12:23:09.583643 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.700703 (+117060us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.718789 (+ 18086us) log.cc:844] Serialized 14 byte log entry
0709 12:23:09.805318 (+ 86529us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800458260. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f96148f358f 00007f960d932571 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd
0709 12:23:09.820968 (+ 15650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:09.821097 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:09.821162 (+    65us) raft_consensus.cc:1685] finished
0709 12:23:09.821172 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:09.821298 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210733,"prepare.queue_time_us":392354,"prepare.run_cpu_time_us":1869,"prepare.run_wall_time_us":22402,"raft.queue_time_us":179710,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":21765,"spinlock_wait_cycles":55387264,"thread_start_us":742559,"threads_started":3,"wal-append.queue_time_us":654682,"wal-append.run_cpu_time_us":2309,"wal-append.run_wall_time_us":1074936}
W20260709 12:23:09.824730 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 1.25321e+06us
W20260709 12:23:09.825315 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.788400  1543 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.823683  1148 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:09.826970 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.826222 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:09.827595 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:09.843791 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.846423  1543 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.847988  1543 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:09.901328 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.904093 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:09.836491 30899 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:09.907793 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 71377.1us
I20260709 12:23:09.908586 30899 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:09.910615  1663 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 12:23:09.911471  1384 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:09.912216  1384 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:09.912580  1384 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.912936  1384 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:09.916467 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:09.917979 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.919013 30934 raft_consensus.cc:2410] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:09.924737 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.925490 30933 raft_consensus.cc:1813] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Handling vote request from an unknown peer 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:09.926110 30933 raft_consensus.cc:2410] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:23:09.926190 30680 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 177) took 27978 ms (client timeout 15000 ms). Trace:
I20260709 12:23:09.926968 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:09.928202 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:09.928655 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:09.929293  1517 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:09.931149  1419 raft_consensus.cc:3055] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:09.931600  1419 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.932547  1390 consensus_queue.cc:1059] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:09.933506  1390 raft_consensus.cc:3055] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:09.933954  1390 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:09.935020  1390 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.924808 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:09.936616 30931 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:09.929400  1366 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:09.940203  1366 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:09.939607  1668 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:09.948643  1420 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:09.952298 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:09.936403  1390 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:09.926615 30680 rpcz_store.cc:269] 0709 12:22:41.951628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:42.069236 (+117608us) service_pool.cc:224] Handling call
0709 12:23:09.925934 (+27856698us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:00.443009 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:00.443697 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:00.443751 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:23:00.443787 (+    36us) tablet.cc:662] Decoding operations
0709 12:23:00.444822 (+  1035us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:00.444921 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:00.444948 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:23:00.457230 (+ 12282us) tablet.cc:701] Row locks acquired
0709 12:23:00.477584 (+ 20354us) write_op.cc:260] PREPARE: finished
0709 12:23:00.513835 (+ 36251us) write_op.cc:270] Start()
0709 12:23:00.514042 (+   207us) write_op.cc:276] Timestamp: P: 1783599780484886 usec, L: 0
0709 12:23:00.514063 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:00.514861 (+   798us) log.cc:844] Serialized 3954 byte log entry
0709 12:23:00.660544 (+145683us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f960d9150ac 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b
0709 12:23:01.230139 (+569595us) op_driver.cc:464] REPLICATION: finished
0709 12:23:02.028044 (+797905us) write_op.cc:301] APPLY: starting
0709 12:23:02.028128 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:02.028299 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:02.028327 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:02.029383 (+  1056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:02.029623 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:23:02.029655 (+    32us) write_op.cc:312] APPLY: finished
0709 12:23:02.030036 (+   381us) log.cc:844] Serialized 70 byte log entry
0709 12:23:02.030252 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:02.030384 (+   132us) write_op.cc:454] Released schema lock
0709 12:23:02.030451 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:02.031201 (+   750us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:02.031239 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40443,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":775150,"apply.run_cpu_time_us":2881,"apply.run_wall_time_us":2882,"num_ops":9,"prepare.queue_time_us":42988,"prepare.run_cpu_time_us":22489,"prepare.run_wall_time_us":284821,"raft.queue_time_us":238821,"raft.run_cpu_time_us":31574,"raft.run_wall_time_us":648774,"replication_time_us":693598,"spinlock_wait_cycles":59785472,"thread_start_us":738140,"threads_started":4,"wal-append.queue_time_us":254126,"wal-append.run_cpu_time_us":15129,"wal-append.run_wall_time_us":2290105}]]}
I20260709 12:23:09.982990 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:09.985541 30783 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:09.991288 30930 raft_consensus.cc:2393] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:09.945542  1366 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:09.991580 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:09.984968 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:09.992897 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.000389 30782 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:09.970373  1517 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:09.951436  1669 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:10.004040 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:10.005554 30779 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:23:10.010234  1517 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.011474  1669 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:10.050787  1669 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:09.932565  1419 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:10.067767 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:10.072026 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:10.074149 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:10.061532  1669 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:10.079336 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.081976 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 255976us
W20260709 12:23:10.081563 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 157408us
W20260709 12:23:10.104413 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 118642us
W20260709 12:23:10.106609 30750 connection.cc:256] RPC call timeout handler was delayed by -4.3763902689997849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 12:23:10.107049 30750 connection.cc:256] RPC call timeout handler was delayed by -4.3412902689997281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:23:10.107347 30750 connection.cc:256] RPC call timeout handler was delayed by -4.3412902689997281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 12:23:10.107625 30750 connection.cc:256] RPC call timeout handler was delayed by -4.2899902689996452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:23:10.107910 30750 connection.cc:256] RPC call timeout handler was delayed by -4.244090268999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 12:23:10.108183 30750 connection.cc:256] RPC call timeout handler was delayed by -3.9596902689995659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:23:10.108465 30750 connection.cc:256] RPC call timeout handler was delayed by -3.9596902689995659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 12:23:10.108731 30750 connection.cc:256] RPC call timeout handler was delayed by -3.1244902689995797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29500000000000004s for a response
W20260709 12:23:10.109012 30750 connection.cc:256] RPC call timeout handler was delayed by -3.1244902689995797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29500000000000004s for a response
W20260709 12:23:10.111850 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.095498 30900 leader_election.cc:336] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.614s (SENT)
I20260709 12:23:10.078341  1397 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:10.136695 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:10.138494 30926 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:10.149933 30750 leader_election.cc:400] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:23:10.150348 30750 leader_election.cc:403] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:10.163683  1659 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9.
I20260709 12:23:10.166260 30667 catalog_manager.cc:5028] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): tablet dd65da5a34854820ae636ab77116f737 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:23:10.167151  1523 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.167721  1523 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:23:10.169806 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 1.54662e+06us
W20260709 12:23:10.170193 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 74756.2us
W20260709 12:23:10.171218 30900 leader_election.cc:336] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.658s (SENT)
I20260709 12:23:10.171465  1656 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.171672 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:10.172142  1656 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:10.174978  1648 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:10.175733 30783 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:10.293010 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.328454 30779 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:10.249029 30929 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:10.315599 30934 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
W20260709 12:23:10.293289 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 122166us
I20260709 12:23:10.195818 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:10.206703 30928 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
W20260709 12:23:10.330060 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 243584us
I20260709 12:23:10.221992 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:10.303226 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 132285us
I20260709 12:23:10.328537 30931 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:10.300593 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:10.333835 30778 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:10.240928 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.340500 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.331732 30780 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
W20260709 12:23:10.346915 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 183672us
W20260709 12:23:10.352895 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.241897  1667 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:23:10.242081  1523 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:10.375082  1675 log.cc:927] Time spent T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:23:10.376269 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.376536  1275 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.376801 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:10.377343 30859 raft_consensus.cc:2410] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:23:10.378746 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.379288 30853 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:10.380359  1474 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:10.381414  1659 raft_consensus.cc:2764] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:23:10.310446  1656 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:10.291944  1397 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:10.380623 30856 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 9. Ops: []
I20260709 12:23:10.382879  1245 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:10.381354 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.383596  1245 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:10.281709  1554 consensus_meta.cc:287] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.615s	user 0.003s	sys 0.008s
I20260709 12:23:10.130261  1537 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:10.386134 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.279639  1384 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:10.387084 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.386094 30900 leader_election.cc:336] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.838s (SENT)
W20260709 12:23:10.309888  1670 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:23:10.390928 30778 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:10.391180 30935 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:10.346000  1477 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:10.377168  1275 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:10.409384 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.444043 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.451149 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.451311 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.454293 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:10.455752 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 77975.3us
I20260709 12:23:10.459650 30932 raft_consensus.cc:2368] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11.
I20260709 12:23:10.460652 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.393148  1245 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:10.513899 30860 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:10.521421 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.529476 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.531181 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.532220 30782 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:10.536016 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.524115 30858 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:10.546423 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.540634 30899 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:10.563002  1517 consensus_meta.cc:287] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
W20260709 12:23:10.563966 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 54074.3us
I20260709 12:23:10.566883 30926 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:10.567960 30778 raft_consensus.cc:2393] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:10.508019  1477 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:10.570400 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 177476us
W20260709 12:23:10.557717  1670 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:23:10.514947  1554 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:10.576191 30782 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:23:10.578110 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:10.586622 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 65878.6us
I20260709 12:23:10.589147 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:10.609185 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.609709 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:10.610823 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 252581us
I20260709 12:23:10.611925 30858 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:10.618149 30899 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:10.620872 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 234842us
I20260709 12:23:10.574066  1517 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:10.605814  1390 consensus_meta.cc:287] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 12:23:10.628134 30927 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:23:10.628590 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:10.671298 30900 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.918s (SENT)
I20260709 12:23:10.672013 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:10.622120  1626 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:10.607939  1523 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:23:10.675168 30928 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:23:10.677187 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.669117 30860 raft_consensus.cc:1275] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:10.681452 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.684738 30782 raft_consensus.cc:1275] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:10.679838 30928 pending_rounds.cc:85] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 7
I20260709 12:23:10.634121  1679 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:10.693576 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:10.694298 30782 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:10.673993  1384 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:10.686170 30928 pending_rounds.cc:107] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:23:10.700560 30928 raft_consensus.cc:2889] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:23:10.702980 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 94059.7us
I20260709 12:23:10.711370 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.692350  1065 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:10.688796  1626 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:10.698341  1679 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:10.721592 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.698661  1537 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:10.728946 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 86768.7us
I20260709 12:23:10.730356 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:10.737561 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:10.745038 30784 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:23:10.749431 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.757839 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.757915  1626 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:10.759688  1606 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:10.762905 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.920s (SENT) [suppressed 24 similar messages]
I20260709 12:23:10.769634 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:10.770715  1692 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
W20260709 12:23:10.758199  1689 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:23:10.773936 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:10.751420  1275 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:10.756556  1477 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:10.778844 30857 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.781944 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:10.782829 30859 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.779996 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:10.784751 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 47292.6us
I20260709 12:23:10.785192 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:10.785939 30860 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.787190 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:10.789191  1693 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:23:10.794546 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:10.794903 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:10.795583 30854 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.801939 30851 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.803846 30782 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:10.813508 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:10.795892  1685 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.211s	user 0.002s	sys 0.000s
W20260709 12:23:10.814903 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.813391 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:10.837256 31475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.019s	sys 0.058s
W20260709 12:23:10.843353 31475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.019s	sys 0.062s
I20260709 12:23:10.806116  1477 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:10.809223 30857 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:10.869664 30852 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:10.866948 30855 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:10.819969  1690 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:23:10.809092  1517 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:10.872723 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:10.873502 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.876204 30780 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:10.879105 30856 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:23:10.881651 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 86835.2us
I20260709 12:23:10.882050 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:10.876318 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 295151us
I20260709 12:23:10.884943 30857 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 6: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:23:10.890797 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.893617 30933 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:10.896821 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.806074  1679 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:10.900143 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:10.901652 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:10.903673 30856 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.904228 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:10.905661 30826 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:10.907116 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:10.910828 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1725) took 1005 ms. Trace:
I20260709 12:23:10.911243 30932 rpcz_store.cc:276] 0709 12:23:09.905582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.905785 (+   203us) service_pool.cc:224] Handling call
0709 12:23:10.910590 (+1004805us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54002143d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:10.910762 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217058560}
I20260709 12:23:10.916093 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1724) took 1012 ms. Trace:
I20260709 12:23:10.916507 30927 rpcz_store.cc:276] 0709 12:23:09.903571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.903731 (+   160us) service_pool.cc:224] Handling call
0709 12:23:10.915903 (+1012172us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b5400263ed4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:10.916024 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137954048}
W20260709 12:23:10.918704 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.905833  1275 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:10.933035 30851 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:10.934602 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:10.934962 30858 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:10.935352 30851 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:10.935595 30859 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:10.933517  1477 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:10.936802 30780 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:10.940114 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:10.934454  1698 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:23:10.953749  1438 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:10.954421  1245 consensus_queue.cc:1048] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.960562 30857 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:10.961447 30855 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:10.933048 30852 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:10.932060 30860 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:10.956422  1606 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:10.966737 30851 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:23:10.967814 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:10.969362 30854 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:10.976521 30856 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:10.985662 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:10.987849 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 224991us
I20260709 12:23:10.994247 30826 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:11.009858 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.010905 30857 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:23:11.012979 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:10.997970  1606 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.041144 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:11.049149 30900 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.969s (SENT)
I20260709 12:23:11.039134  1275 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:11.054009  1671 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:23:11.056332  1666 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:11.079850 30926 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:11.082273  1347 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:11.082417 30900 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.985s (SENT)
I20260709 12:23:11.083132 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:11.082940  1347 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:11.084872 30900 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.685s (SENT)
I20260709 12:23:11.088105 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1668) took 1356 ms. Trace:
I20260709 12:23:11.091656 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:11.067857  1716 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:11.096648 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.102887  1275 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:11.106174 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:11.088603  1715 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:11.114761  1626 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.121663 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:11.119014 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1729) took 1148 ms. Trace:
I20260709 12:23:11.119277 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1730) took 1138 ms. Trace:
I20260709 12:23:11.126572 30933 rpcz_store.cc:276] 0709 12:23:09.981354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.981501 (+   147us) service_pool.cc:224] Handling call
0709 12:23:11.119112 (+1137611us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54000eabd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:11.119210 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1448856960}
I20260709 12:23:11.098238  1648 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.126509 30931 rpcz_store.cc:276] 0709 12:23:09.970340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.970467 (+   127us) service_pool.cc:224] Handling call
0709 12:23:11.118789 (+1148322us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002242d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:11.118934 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667612416}
I20260709 12:23:11.088682 30781 rpcz_store.cc:276] 0709 12:23:09.731283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:09.731460 (+   177us) service_pool.cc:224] Handling call
0709 12:23:09.731774 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:09.784029 (+ 52255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:09.784061 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:09.802553 (+ 18492us) log.cc:844] Serialized 26 byte log entry
0709 12:23:10.059692 (+257139us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:10.059789 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:10.059893 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:11.087032 (+1027139us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b240012a718. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d7b89c4 00007f960d7b6acb 00007f960d971dc9 00007f960d971a55 00007f960d970fb0 00007f96105e7488 00007f96105e7be8 00007f96105bf398 00007f96105ba76a 00007f96105b9bb6
0709 12:23:11.087656 (+   624us) raft_consensus.cc:1685] finished
0709 12:23:11.087698 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:11.088019 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78,"raft.queue_time_us":48472,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":18372,"spinlock_wait_cycles":181651328,"thread_start_us":208348,"threads_started":1,"wal-append.queue_time_us":330562}
I20260709 12:23:11.099839  1716 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:11.135277  1698 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:11.127424  1715 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:11.147800  1426 consensus_queue.cc:1059] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 12:23:11.148696 30900 connection.cc:256] RPC call timeout handler was delayed by -1.3970934860003581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 12:23:11.149547  1688 raft_consensus.cc:3055] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:11.150067  1688 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:11.109650  1699 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:23:11.150967  1688 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:11.152294  1688 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:11.152652  1697 consensus_queue.cc:1048] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:11.153607 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.159060 30781 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:11.162545  1347 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:11.163517 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:11.164904 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:11.165542 30780 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:11.170542 30900 connection.cc:256] RPC call timeout handler was delayed by -1.3903750129998116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:23:11.157582 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.174825 30826 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:11.176352 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.141007  1716 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:11.177886 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.143486  1679 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:23:11.178407 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.177099 30780 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:11.193378  1245 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:11.193742  1659 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:11.194394  1659 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:11.194865  1659 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:11.189567 30899 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.197279  1698 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.204861  1648 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:11.205549  1648 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:11.205996  1698 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.206549  1648 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.170877  1715 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:11.198580 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:11.196871 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.209509 30900 connection.cc:256] RPC call timeout handler was delayed by -1.0493119420002586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2703s for a response
W20260709 12:23:11.210994 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:11.212893 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.227392 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:11.230677 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.233947 30778 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:11.198529  1722 consensus_queue.cc:1059] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:11.237126 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.237828 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:11.222597  1474 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:11.240458 30853 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:23:11.243150 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:11.235435  1517 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:23:11.251425 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.270644 31506 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:23:11.240257  1723 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:11.276042 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.244830  1245 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:11.278498 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:11.275457 30899 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:11.298100 30900 leader_election.cc:336] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.732s (SENT)
I20260709 12:23:11.274353  1722 raft_consensus.cc:3055] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:11.299347 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:11.303941  1474 raft_consensus.cc:697] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.283749  1245 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:11.306354 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.308300 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:11.313028 30777 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:11.290827  1523 consensus_queue.cc:1059] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:23:11.301239  1722 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.334751  1419 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:11.323632  1477 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:11.304920  1644 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:11.336390 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 51991.3us
I20260709 12:23:11.312244  1729 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:11.312788  1245 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:11.338994  1537 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:11.341037 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 65066.5us
W20260709 12:23:11.344708 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 49457.6us
I20260709 12:23:11.304292  1735 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:11.347750 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:11.350288 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 52235.3us
W20260709 12:23:11.355964 30900 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.765s (SENT)
I20260709 12:23:11.354861 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.356487  1477 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:11.346066  1065 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:11.363304 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:11.379556  1694 log.cc:927] Time spent T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.695s	user 0.002s	sys 0.007s
I20260709 12:23:11.379343  1065 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:11.381117  1727 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:23:11.331459  1474 consensus_queue.cc:237] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.394676 30750 leader_election.cc:400] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11.
I20260709 12:23:11.395270 30750 leader_election.cc:403] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:23:11.360283  1656 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:23:11.401461 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.362478  1666 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:11.366307  1729 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.409804 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:11.361858  1477 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.358937  1736 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:11.374733  1739 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:11.407929 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.368208  1735 raft_consensus.cc:697] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:11.411605 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 55686.1us
I20260709 12:23:11.415611 31506 raft_consensus.cc:2410] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:23:11.403527  1656 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.407599  1644 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:11.415732  1614 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:11.442301  1737 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:11.443055  1737 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.427134  1065 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:11.452203  1731 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:23:11.426010  1148 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:23:11.468472 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.473541  1743 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11.
W20260709 12:23:11.546694 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 169071us
I20260709 12:23:11.385651  1722 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.547881 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:11.549597 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 133319us
W20260709 12:23:11.582372 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 242090us
I20260709 12:23:11.444108  1737 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:11.600492 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.604657 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.556013  1517 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:11.647351 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 58031.6us
W20260709 12:23:11.656224 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 204807us
I20260709 12:23:11.657485 30778 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:11.591178  1723 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.660024 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:11.656936 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 93840.6us
I20260709 12:23:11.660805 30778 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:11.598044  1743 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:11.604449  1739 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.607345  1735 consensus_queue.cc:237] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:11.675474 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.629927  1606 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.677110 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.706947 30857 raft_consensus.cc:2376] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10. Re-sending same reply.
I20260709 12:23:11.678112 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:11.677398 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.678802 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:11.692600 30899 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:11.705367 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:11.718561 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.723707 30858 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:11.645402  1517 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:11.586782  1656 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.679697  1722 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.710233  1700 raft_consensus.cc:3055] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:23:11.740978 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 48506.5us
I20260709 12:23:11.745527 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:11.748600 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 162724us
I20260709 12:23:11.756595 30854 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:11.767800 30860 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:11.707162  1065 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:23:11.747608  1543 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:11.777571 30825 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:11.715621  1606 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.778136 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.627976  1729 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.667490  1644 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:11.747689  1751 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:11.747570  1700 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:11.782390 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 66525us
W20260709 12:23:11.787307 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.793031  1606 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:11.782035  1543 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:11.793913  1543 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:11.797798  1754 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:11.797529  1700 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.798306  1754 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.798821  1754 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:11.763957  1666 consensus_queue.cc:1059] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:23:11.793620  1730 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:11.810983 30857 raft_consensus.cc:1240] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 8. Ops: []
I20260709 12:23:11.789326  1656 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.798846  1700 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:11.815218  1750 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:11.815656  1537 raft_consensus.cc:3055] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:11.815963  1750 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.816077  1537 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:11.820513 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.821774 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.822170 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.822584 30852 raft_consensus.cc:2410] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:11.822765 30853 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:11.823349 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.823568 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:11.824327 30853 raft_consensus.cc:2410] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:11.822110 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.827080 30854 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:23:11.833108 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 184822us
I20260709 12:23:11.799994  1751 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.838150 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:11.838789  1715 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.000s
I20260709 12:23:11.839392 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:11.839208  1715 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:11.779204  1739 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.840574 30776 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:11.816993  1750 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.777199  1723 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:11.842908 30900 leader_election.cc:336] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.703s (SENT)
I20260709 12:23:11.843396 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:11.847601  1245 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:11.850250  1716 consensus_meta.cc:287] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 12:23:11.850715  1716 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:11.852049 30778 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:11.835913  1275 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:11.896590 30859 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:11.817006  1537 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:11.807871  1438 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:23:11.804728  1755 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:23:11.897341 30857 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:11.837630  1747 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:23:12.019754 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 194346us
W20260709 12:23:11.930197 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 87307.2us
W20260709 12:23:12.042563 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 229499us
I20260709 12:23:11.985623 30780 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:12.035874  1659 consensus_meta.cc:287] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.840s	user 0.014s	sys 0.000s
W20260709 12:23:12.018087 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:11.809067  1743 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.930464  1745 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:12.039413  1543 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.087455  1543 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:12.061787 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 208965us
I20260709 12:23:12.090412 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1685) took 1298 ms. Trace:
I20260709 12:23:11.825542  1666 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.233s
I20260709 12:23:12.080183 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:12.081846 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:12.044916  1746 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:12.083309 30900 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.949s (SENT)
I20260709 12:23:11.855050  1275 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:12.001495 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 106274us
W20260709 12:23:12.095065 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.090838 30851 rpcz_store.cc:276] 0709 12:23:10.792075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.936231 (+144156us) service_pool.cc:224] Handling call
0709 12:23:10.936518 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:10.967331 (+ 30813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:12.090137 (+1122806us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b5400075b54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:12.090356 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68669696}
I20260709 12:23:12.065127  1755 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:12.065213  1747 raft_consensus.cc:697] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:11.925411  1754 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:12.158056 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.178207  1419 consensus_meta.cc:287] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.000s
I20260709 12:23:12.130579  1746 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.181030  1746 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:12.130239  1743 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.127084  1755 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:12.185446 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:12.181845  1275 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:12.230471 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:12.088431  1659 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.274530  1659 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:12.184823  1755 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.277019  1755 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:12.280164 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:12.283181  1760 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:23:12.131840  1517 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:12.313721  1747 consensus_queue.cc:237] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.324254  1754 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:12.178269  1768 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:12.326876  1768 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:23:12.327891 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 268911us
I20260709 12:23:12.328114  1768 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.326373 30930 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:12.430457  1522 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.431255  1522 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:12.457598 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.492940  1768 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:12.493184 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.515416 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.528218 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 460247us
I20260709 12:23:12.531385 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:12.534482 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 365119us
I20260709 12:23:12.534929 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:12.537678 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:12.538605 30782 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:12.542804 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.547623 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:12.552426 30780 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:12.554971 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:12.614456 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 64973.2us
I20260709 12:23:12.613823  1419 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.627223 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:12.627979 30857 raft_consensus.cc:2376] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6. Re-sending same reply.
I20260709 12:23:12.556001  1148 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.569154  1737 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:12.620183  1648 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.644876  1648 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.647746  1648 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:12.650516  1771 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:12.652413 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:12.655128 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:12.660068 30780 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:12.660181 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:12.620508  1745 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.629415  1419 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.636423 30782 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
W20260709 12:23:12.657568 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.660849 30857 raft_consensus.cc:2376] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10. Re-sending same reply.
I20260709 12:23:12.659534  1765 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:12.714385 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:12.836490 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.856381  1768 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.857077  1768 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.859653  1768 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:12.821055  1648 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.884788 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:12.886132 30857 raft_consensus.cc:2410] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:12.659808  1148 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.870523  1754 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:12.667232  1745 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:12.887197  1775 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:12.667666  1771 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:12.962592 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.972018 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:12.899106  1648 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:13.009080 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.031438 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:13.044420 30780 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:13.055317 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:13.061461 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.225303 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:12.951864  1754 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.126370 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:13.130218  1783 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:23:13.256032 30857 raft_consensus.cc:2410] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:23:13.257258 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.143169 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.144568 30852 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:13.227550 30855 raft_consensus.cc:2410] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:23:13.233335  1148 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.131047  1755 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.235320  1771 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:12.974557  1775 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.213932  1275 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:13.259572 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.260327 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1536) took 1132 ms. Trace:
W20260709 12:23:13.261101 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.125846  1768 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:13.264703 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1508) took 1584 ms. Trace:
W20260709 12:23:13.265456 30900 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.004s	sys 0.004s
I20260709 12:23:13.215104  1765 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.268525 30857 rpcz_store.cc:276] 0709 12:23:12.124402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.084597 (+960195us) service_pool.cc:224] Handling call
0709 12:23:13.256762 (+172165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:13.271399 30855 rpcz_store.cc:276] 0709 12:23:11.676492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.676780 (+   288us) service_pool.cc:224] Handling call
0709 12:23:13.055198 (+1378418us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faeee 000000000036eb39 00007f961596e1e0 00007f9615a370c4 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:23:13.260958 (+205760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4202240}
W20260709 12:23:13.272460 30900 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.005s	sys 0.004s
W20260709 12:23:13.278566 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 749301us
I20260709 12:23:13.268685  1771 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:13.288477 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.267045  1755 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.290302 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.279630  1419 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.291977 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1531) took 1169 ms. Trace:
I20260709 12:23:13.295156 30855 rpcz_store.cc:276] 0709 12:23:12.122832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.282481 (+1159649us) service_pool.cc:224] Handling call
0709 12:23:13.291817 (+  9336us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:13.296193 30783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.046s	sys 0.086s
W20260709 12:23:13.296566 30783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.046s	sys 0.086s
I20260709 12:23:13.272576  1275 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.275777  1768 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.304059 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.304992 30855 raft_consensus.cc:2376] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:23:13.305660 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1532) took 1182 ms. Trace:
I20260709 12:23:13.278880  1765 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.316618 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.317521 30858 raft_consensus.cc:2368] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10.
I20260709 12:23:13.318024 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1533) took 1194 ms. Trace:
I20260709 12:23:13.318509 30858 rpcz_store.cc:276] 0709 12:23:12.123466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.316278 (+1192812us) service_pool.cc:224] Handling call
0709 12:23:13.317945 (+  1667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:13.320358 30858 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:13.321123 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1539) took 1195 ms. Trace:
I20260709 12:23:13.321674 30858 rpcz_store.cc:276] 0709 12:23:12.125407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.319435 (+1194028us) service_pool.cc:224] Handling call
0709 12:23:13.319854 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.320785 (+   931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.321053 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:13.306082 30855 rpcz_store.cc:276] 0709 12:23:12.123153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.296388 (+1173235us) service_pool.cc:224] Handling call
0709 12:23:13.305579 (+  9191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:13.322901 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1705) took 1318 ms. Trace:
I20260709 12:23:13.290719  1771 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.325338 30779 rpcz_store.cc:276] 0709 12:23:12.004327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.004527 (+   200us) service_pool.cc:224] Handling call
0709 12:23:13.316097 (+1311570us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:23:13.322350 (+  6253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.322550 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:13.322580 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:13.322625 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:13.322662 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.322714 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.322835 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4048640}
W20260709 12:23:13.347155 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.347844 30857 raft_consensus.cc:2410] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:23:13.356693 30750 connection.cc:256] RPC call timeout handler was delayed by -1.7480230770001981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:23:13.358693 30750 connection.cc:256] RPC call timeout handler was delayed by -1.7435230770001908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260709 12:23:13.359234 30750 connection.cc:256] RPC call timeout handler was delayed by -1.7426230770001894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 12:23:13.359819  1745 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.360551  1790 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:13.371847  1790 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.379066  1768 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.384876  1775 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.386245  1790 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:13.386713  1755 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:13.388587  1754 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:13.398264  1715 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.404561  1765 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.406234  1275 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.408210  1771 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:13.361124 30750 connection.cc:256] RPC call timeout handler was delayed by -1.7156230770001457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 12:23:13.409597 30750 connection.cc:256] RPC call timeout handler was delayed by -1.7084230770001341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:23:13.410069 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5689230770003633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17410000000000003s for a response
W20260709 12:23:13.410454 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5653230770003574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:23:13.410866 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5653230770003574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:23:13.411253 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5536230770003385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 12:23:13.411628 30750 connection.cc:256] RPC call timeout handler was delayed by -1.5320230770003036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 12:23:13.412027 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4996230770002512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:23:13.412415 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4807230770002207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
W20260709 12:23:13.414676 30750 connection.cc:256] RPC call timeout handler was delayed by -1.4006230770000911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:23:13.415153 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3862230770000679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 12:23:13.415553 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3691230770000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 12:23:13.415925 30750 connection.cc:256] RPC call timeout handler was delayed by -1.3196230769999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 12:23:13.416299 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2719230770003378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:23:13.416692 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2674230770003305s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:23:13.417033 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2548230770003101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 12:23:13.417431 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2539230770003087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 12:23:13.417852 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2449230770002941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 12:23:13.418203 30750 connection.cc:256] RPC call timeout handler was delayed by -1.2449230770002941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 12:23:13.418545 30750 connection.cc:256] RPC call timeout handler was delayed by -1.217023077000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 12:23:13.418884 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1630230770001617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 12:23:13.419670 30750 connection.cc:256] RPC call timeout handler was delayed by -1.1468230770001355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
I20260709 12:23:13.419839 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.420341 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.421147  1676 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.421689 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.421706  1765 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:13.418772 30900 leader_election.cc:336] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.071s (SENT)
W20260709 12:23:13.432374 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.421689  1676 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.443421  1748 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.444120  1748 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:13.447861 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.448441 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.449512  1775 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.450238  1775 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.457988  1745 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.458678  1745 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.445437 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.463398 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1538) took 1338 ms. Trace:
I20260709 12:23:13.463479  1419 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:13.463797 30851 rpcz_store.cc:276] 0709 12:23:12.125071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.445011 (+1319940us) service_pool.cc:224] Handling call
0709 12:23:13.463324 (+ 18313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:13.464254  1419 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.472362 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.473220 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1541) took 1109 ms. Trace:
I20260709 12:23:13.473562 30856 rpcz_store.cc:276] 0709 12:23:12.363621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.472117 (+1108496us) service_pool.cc:224] Handling call
0709 12:23:13.473161 (+  1044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:13.479526  1477 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:13.480111 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 436) took 2256 ms. Trace:
I20260709 12:23:13.480396  1477 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.480736 30776 rpcz_store.cc:276] 0709 12:23:11.223406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.232385 (+  8979us) service_pool.cc:224] Handling call
0709 12:23:11.245908 (+ 13523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:11.840951 (+595043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.479749 (+1638798us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400121bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:13.479981 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367156480}
I20260709 12:23:13.487188 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.483629 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.485184 30853 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 10. Ops: []
I20260709 12:23:13.487982 30858 raft_consensus.cc:2393] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:13.488933 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.486441 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.482511 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 445) took 1682 ms. Trace:
I20260709 12:23:13.487952 30856 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.490453 30778 rpcz_store.cc:276] 0709 12:23:11.800249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:11.800398 (+   149us) service_pool.cc:224] Handling call
0709 12:23:11.800687 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:11.852423 (+ 51736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.482167 (+1629744us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b540008b1d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:13.482427 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117699840}
I20260709 12:23:13.492274 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.492367 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.494057 30851 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
W20260709 12:23:13.499672 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 139387us
W20260709 12:23:13.511103 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.509529 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1530) took 1387 ms. Trace:
I20260709 12:23:13.511813 30857 rpcz_store.cc:276] 0709 12:23:12.122490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:13.282385 (+1159895us) service_pool.cc:224] Handling call
0709 12:23:13.509287 (+226902us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54004367d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:13.509457 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133227264}
W20260709 12:23:13.507890 30930 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1731) took 3497 ms (client timeout 1745 ms). Trace:
W20260709 12:23:13.512914 30930 rpcz_store.cc:269] 0709 12:23:10.010747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:10.019305 (+  8558us) service_pool.cc:224] Handling call
0709 12:23:13.507645 (+3488340us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54002148d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:13.507774 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4843853696}
W20260709 12:23:13.518080 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 96449.4us
I20260709 12:23:13.523293 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:13.500777 30900 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.076s (SENT)
I20260709 12:23:13.529964 30855 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:13.531550  1477 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.531622  1756 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:13.522475  1789 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.502485  1765 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.534020 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1540) took 1408 ms. Trace:
I20260709 12:23:13.534833  1676 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:13.537698 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.554127 30856 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:13.554745 30852 rpcz_store.cc:276] 0709 12:23:12.129059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.530894 (+401835us) service_pool.cc:224] Handling call
0709 12:23:13.533784 (+1002890us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54004380d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:13.533918 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289057152}
I20260709 12:23:13.559434 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.560202 30852 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:13.563035 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.564226 30851 raft_consensus.cc:2410] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:13.566344 30858 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: [6.5-7.6]
I20260709 12:23:13.557874 30853 raft_consensus.cc:2376] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10. Re-sending same reply.
I20260709 12:23:13.586341 30852 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:13.555960 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.546725  1606 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:13.565476  1789 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.590443  1245 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:13.591079  1789 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:13.591779  1606 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.596313 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.597152 30929 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:13.598466  1606 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.593146 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.598803 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.599097 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.599474 30860 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:13.599660 30929 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:13.599918 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.600411 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.601037 30860 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:13.601214 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.601884 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.593897 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.595986 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.603102 30851 raft_consensus.cc:2410] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:23:13.603468 30931 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:13.603602 30853 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:13.603356 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.552951  1756 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:13.604779 30860 raft_consensus.cc:2410] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:13.606767 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.607271 31508 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:13.608022 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.608613 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.608999 30852 raft_consensus.cc:2376] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6. Re-sending same reply.
I20260709 12:23:13.609688 30926 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:13.609874 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.611011 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.613739 30929 raft_consensus.cc:1275] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:13.616439 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:13.618177 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 62344.7us
I20260709 12:23:13.619966 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.620842 30851 raft_consensus.cc:2376] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8. Re-sending same reply.
I20260709 12:23:13.626827 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.628711 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.629443 30860 raft_consensus.cc:2376] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10. Re-sending same reply.
I20260709 12:23:13.629604 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:13.639842 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 139094us
I20260709 12:23:13.643675 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.644223 30933 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:13.644954 30855 raft_consensus.cc:2410] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:23:13.645589 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:13.648175 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:13.648371 30900 leader_election.cc:336] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.078s (SENT)
I20260709 12:23:13.648795 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.648175 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.649652 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.650072 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.648825 30853 raft_consensus.cc:2376] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:23:13.650727 30852 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:13.650942 30851 raft_consensus.cc:2376] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11. Re-sending same reply.
I20260709 12:23:13.615983  1775 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.654362 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.652300 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.655077 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.655720 30852 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:13.656632 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.647589 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.661258 30852 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: [5.4-8.5]
I20260709 12:23:13.662086 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:13.662837 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:13.663401 30853 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:13.664026 30852 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:23:13.665318 30852 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:13.651320  1791 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:13.667022 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.651906  1739 raft_consensus.cc:2764] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:13.668139 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.670832 31508 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:23:13.669866 30855 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:13.671439 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.672284 30932 raft_consensus.cc:2393] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:13.672739 30852 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:13.673031 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.658957  1766 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:13.677011 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:13.678269 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.659720  1419 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.680346 30927 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:23:13.680739 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.681267 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.681838 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.681692 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:13.682418 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.682852 30900 connection.cc:256] RPC call timeout handler was delayed by -1.7141258700003164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 12:23:13.683277 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.683962 30927 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:13.684391 30855 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:23:13.684789 30855 pending_rounds.cc:85] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 3
I20260709 12:23:13.685051 30855 pending_rounds.cc:107] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:23:13.685475 30855 raft_consensus.cc:2889] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.686793 30931 raft_consensus.cc:2393] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:13.694026  1756 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.696012  1756 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.667483  1791 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:13.701150  1791 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.702662  1716 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:13.705531 30900 leader_election.cc:336] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.217s (SENT)
I20260709 12:23:13.706180 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.707104  1419 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:13.710361 30900 connection.cc:256] RPC call timeout handler was delayed by -1.5813046379998923s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2594s for a response
I20260709 12:23:13.710278 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.711450 30927 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:23:13.712217 30900 connection.cc:256] RPC call timeout handler was delayed by -1.4814046380001855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2705s for a response
W20260709 12:23:13.712908 30900 connection.cc:256] RPC call timeout handler was delayed by -1.4382046380001157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27530000000000004s for a response
I20260709 12:23:13.699700 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:13.713338 30900 connection.cc:256] RPC call timeout handler was delayed by -1.2456046379998043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2967s for a response
I20260709 12:23:13.684938 30852 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:13.714231 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.716660 30852 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:13.717908  1746 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:13.718719  1517 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.720036  1522 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.715910  1766 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:13.720492  1751 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:13.720860  1766 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:13.723279  1766 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:13.715653  1419 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:13.724318  1419 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.726910 30855 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:23:13.727448 30855 pending_rounds.cc:85] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 5
I20260709 12:23:13.727788 30855 pending_rounds.cc:107] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:23:13.728163 30855 raft_consensus.cc:2889] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:13.739055  1419 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.747421 30853 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
W20260709 12:23:13.777005 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.780444 30826 connection.cc:256] RPC call timeout handler was delayed by -4.1031694719995357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 12:23:13.781044 30826 connection.cc:256] RPC call timeout handler was delayed by -4.0599694719999206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:23:13.781529 30826 connection.cc:256] RPC call timeout handler was delayed by -3.8889694719996442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 12:23:13.781972 30826 connection.cc:256] RPC call timeout handler was delayed by -3.8187694719995307s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:23:13.782446 30826 connection.cc:256] RPC call timeout handler was delayed by -2.1798694719996092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.38480000000000003s for a response
I20260709 12:23:13.783138 30826 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.791095 30927 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:13.794126 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.798273 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.800153 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.800901 30927 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:13.786072  1648 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:13.802300 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.809191 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.791867  1789 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:13.842691 30900 leader_election.cc:336] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.509s (SENT)
I20260709 12:23:13.845424 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.843338 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.849548 30927 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
W20260709 12:23:13.855207 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.856455 30826 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.859691 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:13.863611 30900 leader_election.cc:336] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.543s (SENT)
I20260709 12:23:13.864151 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1572) took 1327 ms. Trace:
I20260709 12:23:13.864230 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.864748 30781 rpcz_store.cc:276] 0709 12:23:12.536360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.536518 (+   158us) service_pool.cc:224] Handling call
0709 12:23:12.536843 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:12.537060 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:12.537084 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:13.809143 (+1272059us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b2c00058ff8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2
0709 12:23:13.809572 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:23:13.838508 (+ 28936us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:13.838548 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.838620 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:13.847712 (+  9092us) raft_consensus.cc:1685] finished
0709 12:23:13.847743 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.864075 (+ 16332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43751808,"thread_start_us":28469,"threads_started":1,"wal-append.queue_time_us":34257}
I20260709 12:23:13.845896  1537 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:13.879652 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.880704 30927 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
W20260709 12:23:13.885178 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:13.902629 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 54142.1us
I20260709 12:23:13.903607 30826 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:13.904693 30900 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.737s (SENT)
W20260709 12:23:13.910445 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:13.913028 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.914093 30927 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
W20260709 12:23:13.919265 30900 leader_election.cc:336] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.789s (SENT)
I20260709 12:23:13.919539 30860 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:13.919788 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.833254  1791 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:13.921970 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:13.924572 30900 leader_election.cc:336] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.882s (SENT)
W20260709 12:23:13.925369 30900 leader_election.cc:336] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.894s (SENT)
I20260709 12:23:13.925715 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:13.927107 30900 leader_election.cc:336] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.920s (SENT)
I20260709 12:23:13.886188  1648 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:13.936064 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.937695 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.940956  1756 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:13.941826  1756 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:13.942849 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.946305 30927 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:13.929543  1753 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:13.926410  1789 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:13.947417 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.948499 30927 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:13.949541 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.952107 30927 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:13.953074 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.919024  1768 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:13.958663 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:13.961160 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 313679us
I20260709 12:23:13.962149 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.961199 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1707) took 1956 ms. Trace:
I20260709 12:23:13.929723  1766 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:13.965917 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:13.964836 30784 rpcz_store.cc:276] 0709 12:23:12.005000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:12.005106 (+   106us) service_pool.cc:224] Handling call
0709 12:23:13.469798 (+1464692us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:23:13.469995 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:13.470207 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:13.605153 (+134946us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.652885 (+ 47732us) log.cc:844] Serialized 14 byte log entry
0709 12:23:13.947541 (+294656us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b180005e240. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:13.960660 (+ 13119us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b180005e240. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:23:13.960839 (+   179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:13.960889 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:13.960940 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:13.961017 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:13.961141 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":309030,"prepare.queue_time_us":168951,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":89,"raft.queue_time_us":310621,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2648,"spinlock_wait_cycles":16130944,"thread_start_us":180556,"threads_started":2,"wal-append.queue_time_us":62929}
I20260709 12:23:13.968434 30932 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
W20260709 12:23:13.969461 30900 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.922s (SENT)
I20260709 12:23:13.970767 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:13.971436 30927 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:13.973616 30900 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.984s (SENT)
I20260709 12:23:13.962707  1765 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:13.975893 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:13.978544 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.978771 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.979199 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:13.979871 30784 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:13.978801  1751 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:13.978820 30776 raft_consensus.cc:1240] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:23:13.982465 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.966467  1715 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:13.974385 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.978608 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:13.988305 30784 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:13.990917 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:13.994319 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:13.995924 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:13.996805 30927 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:13.997143 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:13.995014 30778 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:13.999686 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.001487 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.003765 30928 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:23:13.990284  1751 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:14.011145 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.011576  1715 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:14.011950 30777 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:14.012421  1791 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.013540 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:14.018662 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 45067.6us
W20260709 12:23:14.019327 30900 leader_election.cc:336] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.057s (SENT)
I20260709 12:23:14.022809 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.028939  1768 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:14.031255 30778 raft_consensus.cc:1240] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:14.032152 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.034641 30928 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:14.035379 30825 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:14.036499 30825 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:14.038267 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.038882  1606 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:14.038763  1741 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:14.040038  1741 consensus_queue.cc:1059] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:14.041132  1741 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:14.042183  1484 raft_consensus.cc:3055] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:14.042626  1484 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:14.043598  1484 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:14.044979  1484 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:14.038355 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.046231 30859 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:14.049090 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.050105 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.039049  1756 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:14.052533 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:14.054886 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.020305  1715 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:14.058176 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.058888 30853 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:14.060186  1795 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.061213  1795 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.062212  1795 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.062726  1795 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.064677 30932 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:14.065027  1795 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:14.065842 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.066673 30927 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 9. Ops: []
I20260709 12:23:14.067230  1745 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:14.079145 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59835.2us
I20260709 12:23:14.079623 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:14.080286 30900 leader_election.cc:336] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.157s (SENT)
I20260709 12:23:14.067904  1606 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:14.082376 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.083045 30785 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 10.
I20260709 12:23:14.082724  1606 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.084404  1756 raft_consensus.cc:697] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:14.085578  1756 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.092427  1748 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:14.096889 30779 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:14.041579  1741 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:14.103062 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:14.105841 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:14.106159 30932 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:14.107182  1715 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:14.107576  1715 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:14.107955  1715 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:14.110219 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:14.113312 30932 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:23:14.105633 30900 leader_election.cc:336] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.594s (SENT)
I20260709 12:23:14.114771 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:14.116248 30934 raft_consensus.cc:1275] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:14.118531 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.118677 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:14.117591 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:14.119202 30856 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:14.121932 30928 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:14.123380 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:14.130288 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.132830 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.133090  1716 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:14.133728  1716 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:14.134788  1716 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.140136 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.140846 30859 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:14.131894  1791 consensus_queue.cc:1059] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:23:14.142416  1791 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:14.133328  1741 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:14.142771  1791 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:14.143224 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:14.143491  1741 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:14.143705  1791 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:14.144218 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:14.145128 31502 raft_consensus.cc:2410] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:23:14.145850 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:14.146461 30852 raft_consensus.cc:1275] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:14.147069 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:14.148209 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.150923 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.152043 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.152802 30854 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
W20260709 12:23:14.134796 30900 leader_election.cc:336] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.705s (SENT)
I20260709 12:23:14.153559 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.151746 30859 raft_consensus.cc:2410] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:23:14.155166 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.157023 30856 raft_consensus.cc:2410] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:14.145066  1791 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.158471 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.167238 30851 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:14.167374 30859 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:14.137995 30853 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:14.171058 30859 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:23:14.173897 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.176848 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.175633 30933 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:14.131312  1751 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:14.178282 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.178539 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.177387 30857 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:14.185104 30933 raft_consensus.cc:2393] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:14.179104 30859 pending_rounds.cc:85] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 5
I20260709 12:23:14.152249  1748 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.186234 30859 pending_rounds.cc:107] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:23:14.186585 30859 raft_consensus.cc:2889] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:14.178910 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:14.188259 30854 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:14.188341 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.189509 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:14.190764 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.191337 30933 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:14.192200 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:14.193324 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:14.194682 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:14.198031 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 63314.1us
W20260709 12:23:14.198731 30900 leader_election.cc:336] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.753s (SENT)
W20260709 12:23:14.199759 30900 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.967s (SENT)
I20260709 12:23:14.200202 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.202669  1775 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.206568 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.207983 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:14.208599 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.208880 30935 raft_consensus.cc:1275] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:14.168042  1739 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:14.198731 30933 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:14.216423 30781 raft_consensus.cc:1240] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:14.212637 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:14.217672 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.219904 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.221164 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:14.226188 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 75744.9us
I20260709 12:23:14.231279 30852 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:14.231750 30785 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:14.151718  1723 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:23:14.186739  1751 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:14.234959 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 58230.9us
W20260709 12:23:14.235386 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.238507 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:14.237345 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.210186  1606 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.214759  1523 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:14.243554 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.232810  1347 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:14.252839 31509 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:14.232653  1554 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:14.245883 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.240279  1751 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.266263 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.267176 30782 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:14.225375  1739 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.248485  1347 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.236543  1771 consensus_queue.cc:1059] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:23:14.291522 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.291795  1795 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.291960 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.292251  1723 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.268643  1768 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:14.314019  1768 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:14.314220  1821 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:14.314530  1768 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.295930 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.318755 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.319566 30781 raft_consensus.cc:2393] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 6: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:14.309219 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.327317 30777 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:23:14.349822 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:14.355078 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 116653us
I20260709 12:23:14.356056 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.306097  1347 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.364869 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:14.365926 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 141933us
I20260709 12:23:14.314613  1771 raft_consensus.cc:3055] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:23:14.354516  1807 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:23:14.343307  1795 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.377804  1771 raft_consensus.cc:740] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:14.351823  1723 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.387255  1768 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:14.529345  1756 consensus_queue.cc:1059] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:14.530457  1245 raft_consensus.cc:3055] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:14.530879  1245 raft_consensus.cc:740] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:14.531653  1245 consensus_queue.cc:260] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.533088  1245 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.541553 31510 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 12.
W20260709 12:23:14.542656 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 177914us
I20260709 12:23:14.543756  1765 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:14.544967 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.545854  1716 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:14.546535  1828 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:14.546648  1771 consensus_queue.cc:260] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.547741  1771 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:14.550793  1739 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.551275  1824 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:14.552202  1606 consensus_queue.cc:1048] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:14.552501 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.553325  1614 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:14.554643 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.555617  1614 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:14.557488 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.558494  1614 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:14.558233 31474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.559870 30851 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:14.560487  1789 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.562495  1768 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:14.555616  1795 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.564447  1795 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:23:14.574087 30778 raft_consensus.cc:1240] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:14.657411 30783 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:23:14.626411  1832 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:23:14.609400 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 329846us
I20260709 12:23:14.571837 30781 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:14.575670 30682 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:14.608893 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.575052  1751 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.566402 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:14.609181  1522 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:14.661279 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 94935.2us
I20260709 12:23:14.661371  1522 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.662587  1751 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.690712 30927 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:23:14.575277 30679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 81) took 22805 ms (client timeout 15000 ms). Trace:
I20260709 12:23:14.694069 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.696609 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:14.697798 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 91356.1us
W20260709 12:23:14.693693 30679 rpcz_store.cc:269] 0709 12:22:51.771362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.782093 (+ 10731us) service_pool.cc:224] Handling call
0709 12:23:14.575187 (+22793094us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:10.053712 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:10.054477 (+   765us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:10.054535 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:23:10.054556 (+    21us) tablet.cc:662] Decoding operations
0709 12:23:10.100631 (+ 46075us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:10.126998 (+ 26367us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:10.130204 (+  3206us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:10.272823 (+142619us) tablet.cc:701] Row locks acquired
0709 12:23:10.272878 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:23:10.273066 (+   188us) write_op.cc:270] Start()
0709 12:23:10.273234 (+   168us) write_op.cc:276] Timestamp: P: 1783599790272991 usec, L: 0
0709 12:23:10.273257 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:23:10.274005 (+   748us) log.cc:844] Serialized 1811 byte log entry
0709 12:23:11.195817 (+921812us) op_driver.cc:464] REPLICATION: finished
0709 12:23:11.349197 (+153380us) write_op.cc:301] APPLY: starting
0709 12:23:11.351930 (+  2733us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:11.361893 (+  9963us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:11.362070 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:11.583952 (+221882us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:11.738117 (+154165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:23:11.743780 (+  5663us) write_op.cc:312] APPLY: finished
0709 12:23:11.760483 (+ 16703us) log.cc:844] Serialized 40 byte log entry
0709 12:23:11.760725 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:11.760901 (+   176us) write_op.cc:454] Released schema lock
0709 12:23:11.760977 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:11.761537 (+   560us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:11.761578 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10780292,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":123190,"apply.run_cpu_time_us":4975,"apply.run_wall_time_us":415009,"num_ops":4,"prepare.queue_time_us":350328,"prepare.run_cpu_time_us":18629,"prepare.run_wall_time_us":347731,"raft.queue_time_us":237809,"raft.run_cpu_time_us":11713,"raft.run_wall_time_us":165275,"replication_time_us":901328,"thread_start_us":492299,"threads_started":4,"wal-append.queue_time_us":234049,"wal-append.run_cpu_time_us":47701,"wal-append.run_wall_time_us":2299822}]]}
I20260709 12:23:14.713846 30859 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:14.571367  1723 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.663605 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:14.563612 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.718783  1537 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:14.718871 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 55351.6us
I20260709 12:23:14.719300  1537 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:14.719676  1756 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:14.720329 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:14.720999 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 157452us
I20260709 12:23:14.664575  1746 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:14.563669  1768 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:14.609606  1775 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:23:14.634032 30784 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:14.665424  1745 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:23:14.593283 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:14.609310 31509 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:14.566479  1831 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:23:14.679533  1554 consensus_queue.cc:1059] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:14.726634  1554 raft_consensus.cc:3055] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:14.727026  1554 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:14.663763  1522 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:14.727823  1554 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.667454  1347 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:14.681457  1795 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:14.729242  1554 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:14.680409 30899 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:14.682723  1826 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:14.687747 30928 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:14.688028 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.681018  1824 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:14.730623  1824 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.731001  1824 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.711050 30857 raft_consensus.cc:1275] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:14.712596 30854 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:14.685779 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:14.734174 30932 raft_consensus.cc:2376] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6. Re-sending same reply.
I20260709 12:23:14.708180 30858 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:14.719751  1537 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.713469 30853 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:14.689270 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:14.712922 30852 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:23:14.736476 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.723434 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:14.738281 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:14.730113 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49789.4us
I20260709 12:23:14.739153  1384 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:14.739336 30899 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.739560  1384 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.739933  1384 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.747538  1537 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:14.749454  1768 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:14.750247  1537 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:14.716634 30682 catalog_manager.cc:5697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.747457  1384 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.752912 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.753559  1384 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:14.754073  1745 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:14.754508  1745 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.754874  1745 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.755951  1347 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.753611  1523 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:14.758554  1523 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.758924  1523 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.564527  1715 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.733898  1522 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:23:14.766994 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 45099.7us
I20260709 12:23:14.768539 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:14.802666 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:14.804162 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:14.769083 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.769644  1795 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:14.769737  1828 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:14.770431 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 87697.9us
W20260709 12:23:14.882332 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 94158.6us
I20260709 12:23:14.770936 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:14.762610  1753 consensus_queue.cc:1059] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 12:23:14.775094 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.776934 30852 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:23:14.885368 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.752182 30682 catalog_manager.cc:5697] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 5 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.782126 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:14.783224 30858 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:14.786341 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:14.887737 30854 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:14.781453 30899 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:14.800686 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.803207  1751 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:14.886628 30853 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:23:14.893071 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 111667us
I20260709 12:23:14.832060  1746 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:14.803501  1771 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:23:14.874650 30856 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:14.877256  1715 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.877934 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:14.878594 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 74639.6us
I20260709 12:23:14.881790 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.883462 30777 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:14.894533 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 93941.9us
I20260709 12:23:14.902338 30854 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:14.904634 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.881456  1723 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:14.907150 30778 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:14.881536  1831 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:14.883790  1522 raft_consensus.cc:697] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:14.921370 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:14.910502 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.923060 30928 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:14.912253 30682 catalog_manager.cc:5697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:14.935856 30778 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:14.899519  1384 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:14.903393  1537 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:14.884191  1795 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.939953  1537 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:14.940388  1537 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:14.941593  1523 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:14.942672  1744 raft_consensus.cc:3055] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:14.943069  1744 raft_consensus.cc:740] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:14.943858  1744 consensus_queue.cc:260] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.945206  1744 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:14.946480  1347 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:14.946686  1775 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:14.929908  1789 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:14.948342  1789 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.941632  1795 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.952953  1831 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:14.979701  1831 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:14.953990 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:14.961064 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 56549.8us
W20260709 12:23:14.983712 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 60776us
I20260709 12:23:14.984562  1795 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:14.895550  1745 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.937300  1723 raft_consensus.cc:697] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:14.986799  1746 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:14.987303  1746 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:14.986994  1723 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:14.987880  1745 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:14.971755  1522 consensus_queue.cc:237] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.903746  1824 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:14.991364  1824 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:14.991832 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:14.909834  1821 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:14.943830  1523 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:14.992309  1821 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:14.992812  1821 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.995186 31476 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:14.909972  1753 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:23:14.996788  1684 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:14.997509  1684 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:14.998512  1684 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:15.004232  1789 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.911460  1554 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:23:14.921793  1275 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:15.061956  1275 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:15.062476  1275 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:14.929749  1606 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:14.885339  1828 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.073496  1828 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:14.976428  1537 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.074460 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:14.929973  1756 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:23:14.984889 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:14.984021 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:14.973210  1751 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:23:15.081146 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 175070us
W20260709 12:23:15.086037 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 185083us
W20260709 12:23:15.088665 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 103969us
I20260709 12:23:15.089489 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.093148 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:15.093819 30785 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:15.094960 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 111018us
I20260709 12:23:15.091219 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:15.116556 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:15.119231 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:15.125612 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.127877  1716 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:15.130568  1716 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:15.134083 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:15.134747 30776 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:15.133456  1716 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:15.115259  1715 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:15.075420  1821 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.112746  1614 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:15.145192  1826 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:23:15.171322 30776 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:15.165022  1775 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:15.144909  1765 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:23:15.149219  1768 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:15.146740 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:15.092696  1753 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:23:15.161680  1845 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:15.112138  1523 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:23:15.155326 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:15.246001 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 99324.3us
I20260709 12:23:15.251080 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.120415  1606 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:15.160008  1844 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:15.259119  1746 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.121978  1554 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:23:15.123941  1828 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:23:15.260267  1554 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:15.261690  1554 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:15.262538  1554 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.263710  1554 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:15.252921  1822 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:15.264892  1822 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:15.265257  1822 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:15.268221  1746 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:15.268492 30783 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:15.261215  1823 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:15.243978 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 120558us
I20260709 12:23:15.145884  1824 consensus_queue.cc:1048] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:23:15.255133 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:15.272104  1828 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:15.273648 30826 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:15.213941 30899 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:15.274235  1828 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:15.274598 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 60817.4us
I20260709 12:23:15.276434  1771 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:15.276859  1771 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:15.277215  1771 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:15.277917  1826 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:15.280073  1715 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:15.280789  1845 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:15.281461  1826 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:15.282066  1823 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:15.282521  1823 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:15.282889  1823 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:15.283216  1845 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:15.283562 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:15.291715  1763 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:15.294978 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:15.284626 30826 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.311051 30927 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:15.318861 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:15.319110 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:15.323200 30928 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:23:15.324455 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 228463us
I20260709 12:23:15.325415 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.327184 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:15.305696 30826 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.329567 30932 raft_consensus.cc:1275] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:15.330886 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:15.245791  1537 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:15.246183  1522 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:15.336120 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:15.342005 30932 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:15.338506 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.338891 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:15.348596 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:15.340767 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:15.318524  1768 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:15.307438  1845 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:15.363903 31509 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:15.358666 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:15.362051 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:15.338112  1715 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:15.339272  1789 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:15.335520  1828 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:15.341132  1793 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:23:15.356145  1768 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.380632  1614 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:15.380671  1824 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:15.381168  1614 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:15.381260  1793 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:15.381843  1793 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:15.381897  1828 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:15.382519  1828 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:15.381583  1824 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.382858  1793 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:15.353317  1522 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:15.398332 30900 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.113s (SENT)
W20260709 12:23:15.394042 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 179170us
I20260709 12:23:15.394562 30779 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:15.353135  1825 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:15.367637  1756 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:15.404034 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:15.407419 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:15.408812 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:15.409086 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:15.410076 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:15.403398 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:15.411497 30777 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:15.388152  1768 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:15.437883  1852 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:23:15.443900 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:15.522290 30852 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:15.394721  1715 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:15.384087  1275 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.383472  1850 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 12:23:15.430320  1849 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:23:15.384228  1789 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:15.387872  1614 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:15.451727  1825 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:15.508106 30855 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:15.504563 30854 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:15.504987  1793 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:15.505374  1824 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:15.507507 30856 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:15.505864 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:15.510645 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 107304us
I20260709 12:23:15.413954  1756 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:15.511006  1845 raft_consensus.cc:697] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:15.520462 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 122185us
I20260709 12:23:15.510162 30785 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
W20260709 12:23:15.521852 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 111706us
I20260709 12:23:15.558079 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:15.524694 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.545872 31510 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 12: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:15.525063  1826 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:15.523756  1751 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:15.522696 30932 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:15.567510  1384 raft_consensus.cc:2764] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:23:15.556488 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:15.570293 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 231868us
I20260709 12:23:15.571018 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:15.565548 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.536098  1789 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:15.554328  1753 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:15.554890  1756 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:15.555548  1821 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:15.560822  1716 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:15.616536 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 45587.3us
I20260709 12:23:15.620913 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:15.598948  1746 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:15.619174  1753 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.625357  1753 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:15.568514  1824 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:23:15.533387  1823 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:15.631603  1823 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:15.631800  1855 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:23:15.634580  1756 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:15.636854  1846 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.249s	user 0.012s	sys 0.000s
I20260709 12:23:15.638177  1751 raft_consensus.cc:2764] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:23:15.644552  1716 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.646169  1826 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:15.646637  1826 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:15.646935  1716 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:15.650146  1822 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:15.651840  1768 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.652673  1822 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:15.653136 30852 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:15.653429  1822 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:15.568495  1851 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:15.662286 30928 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:15.568871  1854 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:15.672043 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 115630us
W20260709 12:23:15.660540  1853 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:23:15.684067 30854 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:23:15.692510 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.681209 30855 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:15.695921 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:15.721813 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:15.728762  1756 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:15.598451  1744 consensus_queue.cc:1059] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
W20260709 12:23:15.749662 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:15.751274 30931 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:23:15.753484 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:15.670890  1828 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.763556 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:15.718837  1522 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:15.738730  1831 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:15.616395  1715 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.719630  1716 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:23:15.828375 31506 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:15.719440  1723 consensus_queue.cc:1048] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
W20260709 12:23:15.834146 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 262904us
W20260709 12:23:15.824023 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 93511.1us
W20260709 12:23:15.838848 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 111071us
I20260709 12:23:15.841686 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:15.838851 30899 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:15.842715 31510 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:23:15.857299 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.528s (SENT) [suppressed 23 similar messages]
W20260709 12:23:15.866851 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 337513us
W20260709 12:23:15.867447 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 246642us
I20260709 12:23:15.872215 30778 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:15.871024 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:15.873610 30784 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:15.876127 30899 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:15.878465 30778 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:15.690828  1845 consensus_queue.cc:237] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:15.891860 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 339417us
I20260709 12:23:15.892400 30779 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:15.746345  1826 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:15.896555 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:15.902230 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:15.884704  1771 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 12:23:15.884315  1275 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:15.924816  1537 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:15.908893  1771 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:15.933911 30668 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:23:15.934721 30668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 43726.2us
I20260709 12:23:15.935598  1614 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:15.936782  1860 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:23:15.936831 30857 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:23:15.935972  1771 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:15.907581  1857 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:15.950287 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:16.004637 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:16.006340 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:15.682802  1854 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.017982 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:16.020541 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:15.933903  1746 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:15.911389  1822 consensus_queue.cc:1059] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:23:16.011945 30931 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:23:16.031693 30931 pending_rounds.cc:85] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 4
I20260709 12:23:16.032007 30931 pending_rounds.cc:107] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 12:23:16.031741 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 126748us
I20260709 12:23:16.032337 30931 raft_consensus.cc:2889] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:16.030133 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:16.037441 30926 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:15.956169  1768 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:16.011199 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 153919us
I20260709 12:23:16.042821 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:16.007756  1537 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:16.000627  1744 consensus_queue.cc:1243] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 7857bffc34ce4e1db3617488701b9810 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:16.066243 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:16.049221 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:16.033810 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:16.055759 30855 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:15.675794  1851 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:16.071771 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:16.071831 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 230167us
I20260709 12:23:16.062351 31509 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:16.069202 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:16.062917  1831 raft_consensus.cc:697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:16.014914  1384 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:23:16.047544  1756 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.111907 30935 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:16.087105 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:16.078620 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.104236 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:16.113294 30855 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:16.057920  1275 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:16.126320 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 59782.4us
W20260709 12:23:16.130676 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.077610  1746 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:16.131822 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:16.081975  1825 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:16.170586  1866 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 12:23:16.172993  1864 log.cc:927] Time spent T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
I20260709 12:23:16.112215  1850 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:16.165469  1899 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:16.166431  1554 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:16.256258  1554 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.166258  1880 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:16.169497  1881 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:23:16.076524  1753 consensus_queue.cc:1059] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 12:23:16.273816 30900 leader_election.cc:336] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.828s (SENT)
I20260709 12:23:16.274497 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:16.260095  1855 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:23:16.285468  1884 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:23:16.218631  1384 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:16.286168  1869 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.286763  1869 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.286206  1857 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:16.288590  1857 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:16.289011  1869 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:16.188884 30855 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:16.131984  1275 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.187829 30935 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:16.152428  1746 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:16.069031  1862 consensus_queue.cc:1059] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:23:16.127494  1828 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:16.217674 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 85979.1us
I20260709 12:23:16.234611 30933 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:16.129117  1756 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.232373  1825 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.260418  1826 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:16.316220 30854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.008s
W20260709 12:23:16.317505 30854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.005s	sys 0.008s
I20260709 12:23:16.293484 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.319042 30855 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:16.294085  1856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.005s	sys 0.008s
I20260709 12:23:16.206472  1831 consensus_queue.cc:237] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.081624  1793 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:23:16.305276  1614 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:16.307176  1746 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:16.353281 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:16.341133 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 67377.3us
I20260709 12:23:16.354239 30856 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:16.343047  1792 consensus_queue.cc:1059] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:23:16.251454  1537 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:23:16.333703  1856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.005s	sys 0.009s
I20260709 12:23:16.362859  1907 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.363392  1756 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:16.364041  1877 log.cc:927] Time spent T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:23:16.364912  1886 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:16.365962  1745 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:16.366422 30933 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:16.370693  1889 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:23:16.304826  1861 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:16.408752 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:16.484280 30928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.014s
W20260709 12:23:16.488736 30928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.006s	sys 0.014s
W20260709 12:23:16.488139 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 455053us
W20260709 12:23:16.488418 30900 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.007s (SENT)
I20260709 12:23:16.493129 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:16.488194 30856 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
W20260709 12:23:16.497460 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 368639us
I20260709 12:23:16.499076 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:16.474884 30855 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 12.
I20260709 12:23:16.500854 30854 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:16.508567 30855 raft_consensus.cc:1240] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:16.511595 30855 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:16.491241 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1724) took 1078 ms. Trace:
I20260709 12:23:16.526571 30856 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:16.522295 30858 rpcz_store.cc:276] 0709 12:23:15.412959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.515915 (+102956us) service_pool.cc:224] Handling call
0709 12:23:15.516272 (+   357us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:15.529880 (+ 13608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.529912 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:15.540187 (+ 10275us) log.cc:844] Serialized 78 byte log entry
0709 12:23:16.011872 (+471685us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:16.110323 (+ 98451us) log.cc:844] Serialized 14 byte log entry
0709 12:23:16.341131 (+230808us) log.cc:844] Serialized 14 byte log entry
0709 12:23:16.392786 (+ 51655us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b18002c94a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:16.482973 (+ 90187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.483100 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.490960 (+  7860us) raft_consensus.cc:1685] finished
0709 12:23:16.490996 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.491177 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7029,"prepare.queue_time_us":330582,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":256262,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":69740,"spinlock_wait_cycles":68723328,"thread_start_us":706873,"threads_started":3,"wal-append.queue_time_us":823243}
W20260709 12:23:16.478384  1789 consensus_meta.cc:287] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.862s	user 0.011s	sys 0.001s
I20260709 12:23:16.339243  1829 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:16.534569 30900 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.208s (SENT)
W20260709 12:23:16.535552 30900 leader_election.cc:336] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.238s (SENT)
W20260709 12:23:16.536419 30900 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.251s (SENT)
I20260709 12:23:16.487248  1886 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:16.379530  1865 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.463s	user 0.004s	sys 0.000s
W20260709 12:23:16.488001  1775 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.000s	sys 0.019s
I20260709 12:23:16.371588  1854 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:16.533932 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:16.390816  1275 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:16.344580  1384 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:16.380702  1851 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:16.331125  1825 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:16.541255 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:16.529096  1756 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:16.548826 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1728) took 1014 ms. Trace:
W20260709 12:23:16.543049  1775 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.020s
W20260709 12:23:16.569855 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 422813us
I20260709 12:23:16.567513 30859 rpcz_store.cc:276] 0709 12:23:15.534393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.534545 (+   152us) service_pool.cc:224] Handling call
0709 12:23:15.534909 (+   364us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:15.555204 (+ 20295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.555241 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:15.657313 (+102072us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b2c00031778. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2
0709 12:23:15.658027 (+   714us) log.cc:844] Serialized 78 byte log entry
0709 12:23:15.906882 (+248855us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:16.093007 (+186125us) log.cc:844] Serialized 14 byte log entry
0709 12:23:16.093421 (+   414us) log.cc:844] Serialized 14 byte log entry
0709 12:23:16.386654 (+293233us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b48000ce7d8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:23:16.543477 (+156823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.543578 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.543634 (+    56us) raft_consensus.cc:1685] finished
0709 12:23:16.543653 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.548584 (+  4931us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17455,"prepare.queue_time_us":554431,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":79,"raft.queue_time_us":467457,"raft.run_cpu_time_us":3309,"raft.run_wall_time_us":126115,"spinlock_wait_cycles":37515904,"thread_start_us":871997,"threads_started":3,"wal-append.queue_time_us":355888}
I20260709 12:23:16.571677 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:16.537011  1745 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:16.586011 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1770) took 1265 ms. Trace:
I20260709 12:23:16.586448 30934 rpcz_store.cc:276] 0709 12:23:15.320528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.322576 (+  2048us) service_pool.cc:224] Handling call
0709 12:23:15.322915 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.335477 (+ 12562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.335508 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.363432 (+ 27924us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b2c000623c8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2
0709 12:23:15.385911 (+ 22479us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.704243 (+318332us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:15.704300 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.704387 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.378851 (+674464us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:16.585773 (+206922us) raft_consensus.cc:1685] finished
0709 12:23:16.585795 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.585934 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43056,"raft.queue_time_us":28527,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6747,"spinlock_wait_cycles":19949568,"thread_start_us":265949,"threads_started":1,"wal-append.queue_time_us":447771}
I20260709 12:23:16.588021 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:16.590624 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.593245 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1721) took 1184 ms. Trace:
I20260709 12:23:16.535125  1789 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.593811 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.594928 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:16.595177 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 58769.4us
I20260709 12:23:16.597980 30858 raft_consensus.cc:2368] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 11. Current term is 12.
I20260709 12:23:16.596026 30855 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:16.593678 30853 rpcz_store.cc:276] 0709 12:23:15.409116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.409237 (+   121us) service_pool.cc:224] Handling call
0709 12:23:15.409543 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.436786 (+ 27243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.506421 (+ 69635us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.506894 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.906497 (+399603us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:15.906547 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.906655 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.593004 (+686349us) raft_consensus.cc:1685] finished
0709 12:23:16.593024 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.593183 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10198,"raft.queue_time_us":125195,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":10649,"thread_start_us":399222,"threads_started":1,"wal-append.queue_time_us":604192}
I20260709 12:23:16.598500 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:16.599284 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:16.582746  1831 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:16.599455 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:16.600673 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:16.600853  1776 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:23:16.601171 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.601714  1873 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.601992 30856 raft_consensus.cc:2393] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:16.602291  1873 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:16.602836 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.604174 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.604671  1873 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:23:16.604827 30856 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:16.605240  1873 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.605917  1875 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.601774  1522 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:16.606530  1875 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.607502 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:16.609093  1875 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:16.609978  1887 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:16.610823  1736 consensus_queue.cc:1059] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:16.611876  1825 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:16.612502  1825 raft_consensus.cc:3055] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:16.612856  1825 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:16.613819 30853 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:23:16.614898  1910 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:16.601380 30855 raft_consensus.cc:2368] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 11. Current term is 12.
W20260709 12:23:16.616382  1908 log.cc:927] Time spent T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:23:16.580323  1756 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:16.614905 30859 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:16.615522  1910 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.619227  1756 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:16.619706  1891 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.509s	user 0.000s	sys 0.001s
I20260709 12:23:16.529973  1861 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.620033  1910 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:16.620656  1910 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:16.621670  1522 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:16.621945  1861 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:16.622437  1522 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:16.623541 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1731) took 1087 ms. Trace:
I20260709 12:23:16.619653 30930 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:16.624051 30852 rpcz_store.cc:276] 0709 12:23:15.535830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.679310 (+143480us) service_pool.cc:224] Handling call
0709 12:23:15.686717 (+  7407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.717484 (+ 30767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.717520 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.742175 (+ 24655us) log.cc:844] Serialized 26 byte log entry
0709 12:23:15.943153 (+200978us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:15.943217 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:15.943297 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:16.618959 (+675662us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:16.623263 (+  4304us) raft_consensus.cc:1685] finished
0709 12:23:16.623283 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:16.623477 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9267,"raft.queue_time_us":14559,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":30074,"spinlock_wait_cycles":19010816,"thread_start_us":124711,"threads_started":1,"wal-append.queue_time_us":277852}
I20260709 12:23:16.523721  1907 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.566406  1384 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.630772 30856 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:16.646601 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.629684 30933 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:16.653004 30860 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:16.639158 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:16.653700 30932 raft_consensus.cc:3055] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:16.657532 30932 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:16.651213 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 80048.6us
I20260709 12:23:16.658511 30932 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:16.662487 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:16.663138 30932 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:16.663947 30856 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:23:16.665472 30856 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:23:16.585289  1745 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.619807  1756 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:16.667171 30856 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:16.643184  1886 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.651861  1775 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:16.663550 30927 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:16.605695  1873 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.624868  1825 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:16.639397  1831 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:16.735278  1919 log.cc:927] Time spent T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:17.106211  1912 raft_consensus.cc:3055] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:17.120563  1912 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:17.121601 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1725) took 1605 ms. Trace:
I20260709 12:23:17.113547 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:16.987654 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1727) took 1460 ms. Trace:
I20260709 12:23:17.109469  1870 raft_consensus.cc:3055] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:17.122200 30851 rpcz_store.cc:276] 0709 12:23:15.516272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.516423 (+   151us) service_pool.cc:224] Handling call
0709 12:23:15.523973 (+  7550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.818614 (+294641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:15.819145 (+   531us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:15.829640 (+ 10495us) log.cc:844] Serialized 26 byte log entry
0709 12:23:16.269643 (+440003us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:16.269776 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.270020 (+   244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:17.121310 (+851290us) raft_consensus.cc:1685] finished
0709 12:23:17.121340 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:17.121513 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3066,"raft.queue_time_us":91755,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":53398,"thread_start_us":710584,"threads_started":2,"wal-append.queue_time_us":657971}
I20260709 12:23:17.123304  1870 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:17.034508  1771 raft_consensus.cc:3055] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:17.124468 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:16.997381  1745 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:17.037706 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1729) took 1502 ms. Trace:
I20260709 12:23:17.114477 31510 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:17.125808 30860 rpcz_store.cc:276] 0709 12:23:15.534830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.535317 (+   487us) service_pool.cc:224] Handling call
0709 12:23:15.554939 (+ 19622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.656337 (+1101398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.037297 (+380960us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003782d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:17.037595 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2524658432}
I20260709 12:23:17.124490  1771 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:17.127316  1831 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.138145  1882 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.122931 30857 rpcz_store.cc:276] 0709 12:23:15.527870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.528375 (+   505us) service_pool.cc:224] Handling call
0709 12:23:15.543394 (+ 15019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:15.943468 (+400074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:16.987233 (+1043765us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b5400050354. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:16.987557 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904241920}
I20260709 12:23:17.138866  1882 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.682235 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:17.141568  1882 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:17.124928  1870 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:16.750319  1934 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:23:17.142894  1870 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.149237 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:17.095201  1746 consensus_meta.cc:287] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.002s
I20260709 12:23:17.151682  1746 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:17.109186 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.156023  1768 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:16.724885 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:16.760864 30778 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:16.893307  1715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.006s	sys 0.003s
I20260709 12:23:16.754452  1751 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.742063  1857 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.662114  1824 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:17.109396  1907 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:16.924711  1880 consensus_meta.cc:287] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.000s
I20260709 12:23:16.749867  1554 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:16.853857  1883 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:16.936290  1868 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:16.668398  1744 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:16.745615 31509 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42840 (request call id 321) took 1342 ms. Trace:
W20260709 12:23:16.745922  1915 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:23:17.136754  1825 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.137388  1924 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.119367 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:17.121987  1912 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:17.141829 30852 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:16.676359 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:17.145133 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:17.145925  1745 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:17.156359  1886 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:16.804450 30932 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:17.026903 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49622 (request call id 1517) took 1006 ms. Trace:
I20260709 12:23:17.220105  1554 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:23:17.216200  1883 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:17.222415  1844 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:23:17.030205 30931 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:17.222685  1554 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:16.702903  1937 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.223165  1554 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:17.223459  1937 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:17.224080  1883 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:17.195712  1751 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.216490  1868 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.161149 30851 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:17.226241  1751 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.158797  1931 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:17.227218  1868 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.227555  1931 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:16.715116  1384 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:17.161794  1831 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.231016  1831 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.233346  1831 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.127882  1771 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.163301 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:17.234488  1940 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:23:17.234706  1745 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.235352 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.164847  1904 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:17.236361  1904 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.236749 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:17.237164  1745 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:16.977859  1765 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:17.238183  1765 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:17.238927 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.240284  1765 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:17.240339 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:16.937001 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:17.174137 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:17.241797 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 304845us
W20260709 12:23:17.242096 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 68054.9us
I20260709 12:23:17.242909 30900 leader_election.cc:400] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 11. Current term is 12.
I20260709 12:23:17.244036 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.244306 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.244958 30926 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:17.168043 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.245199 30900 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.182219 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.246182 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.176258 30859 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:17.246685 30781 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:17.247328 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.247454 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.248550 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.248723  1892 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:17.172099 30779 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:17.248648  1937 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.219098  1723 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.250527 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.250913  1723 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.185498 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1789) took 1073 ms. Trace:
I20260709 12:23:17.196208 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:17.251645 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:17.252095 30933 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:17.252393 30779 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:17.192210 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:17.185063  1715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.008s	sys 0.008s
I20260709 12:23:17.203570 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.212610 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.255779 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.257746 30780 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 11: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:17.263659 30784 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:17.267899 30900 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.270527 30777 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:17.279605 30900 leader_election.cc:400] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 11. Current term is 12.
I20260709 12:23:17.280400 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.281397 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.282085 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.283465 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:17.283681 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.284912 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.274395 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.252940  1723 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.205190 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.298274 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.212687 31509 rpcz_store.cc:276] 0709 12:23:15.403073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.403718 (+   645us) service_pool.cc:224] Handling call
0709 12:23:16.745371 (+1341653us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54004e3ed4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:16.745520 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236953984}
I20260709 12:23:17.174343  1746 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:17.184393  1768 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:17.221493 30935 rpcz_store.cc:276] 0709 12:23:16.020065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.020205 (+   140us) service_pool.cc:224] Handling call
0709 12:23:17.026613 (+1006408us) spinlock_profiling.cc:243] Waited 90.6 ms on lock 0x7b54002baa54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:17.026806 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208397184}
I20260709 12:23:17.227051  1857 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.247534 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.177410 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.176734 30930 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:23:17.251770 30934 rpcz_store.cc:276] 0709 12:23:16.111829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.595897 (+484068us) service_pool.cc:224] Handling call
0709 12:23:16.596193 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:16.668032 (+ 71839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:16.668064 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:16.673306 (+  5242us) log.cc:844] Serialized 26 byte log entry
0709 12:23:17.006631 (+333325us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b480018c258. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:23:17.171782 (+165151us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:17.171842 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.185145 (+ 13303us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b54002bbe54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:17.185195 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:17.185240 (+    45us) raft_consensus.cc:1685] finished
0709 12:23:17.185251 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:17.185424 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1773,"raft.queue_time_us":4615,"raft.run_cpu_time_us":3247,"raft.run_wall_time_us":333453,"spinlock_wait_cycles":165609472,"thread_start_us":373958,"threads_started":1,"wal-append.queue_time_us":417893}
I20260709 12:23:17.148283  1789 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.250918 30926 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:17.248569  1899 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:17.294646 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.197330 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:17.262012  1384 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:17.302043 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.349311 30933 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 12.
I20260709 12:23:17.336283 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.264976  1912 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:17.304103 30900 leader_election.cc:336] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.514s (SENT)
I20260709 12:23:17.350488 30932 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
W20260709 12:23:17.350836 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46809.1us
I20260709 12:23:17.338069 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 433) took 1311 ms. Trace:
I20260709 12:23:17.332288 30899 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:17.270987  1923 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:17.291103  1745 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:17.377547 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.378301 30778 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:17.379226 30778 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3"
dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
mode: GRACEFUL
new_leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
 from {username='slave'} at 127.0.0.1:52636
I20260709 12:23:17.379976 30778 raft_consensus.cc:606] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Received request to transfer leadership to TS 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.380283 30778 raft_consensus.cc:614] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:17.383186 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:17.384141 31477 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.384898  1763 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:17.385319  1763 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.385669  1763 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:17.385732  1878 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:17.386572  1878 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.386942  1878 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.385960 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:17.389825  1929 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:23:17.390476 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 185403us
I20260709 12:23:17.390673 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.391458  1862 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:17.307515 31510 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:17.278376  1744 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:17.227263  1793 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:23:17.318558 30781 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:17.352392 30931 rpcz_store.cc:276] 0709 12:23:16.026581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.138208 (+111627us) service_pool.cc:224] Handling call
0709 12:23:17.029893 (+891685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:17.223014 (+193121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.337549 (+114535us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b54002baa50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:17.337954 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2049849216}
I20260709 12:23:17.370219 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.406522 30776 raft_consensus.cc:2393] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:17.265548  1523 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.355938 30929 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:17.220782  1824 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.264822  1775 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:23:17.392681 30826 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.253160  1924 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.308636 30852 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:17.295243  1883 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:23:17.329725  1882 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:17.298239  1907 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.412341  1793 consensus_queue.cc:1243] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:17.412249 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.414767 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1747) took 1749 ms. Trace:
W20260709 12:23:17.413035 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 168521us
I20260709 12:23:17.300549  1831 consensus_queue.cc:1059] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:23:17.401026 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:17.376245  1897 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:17.425981 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:17.422963 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 438) took 1112 ms. Trace:
I20260709 12:23:17.294067  1931 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.390653  1929 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.343492  1851 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:23:17.450695 30777 rpcz_store.cc:276] 0709 12:23:15.665326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.665732 (+   406us) service_pool.cc:224] Handling call
0709 12:23:15.666123 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:17.278906 (+1612783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.413527 (+134621us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540008bbd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:17.414700 (+  1173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3689359744}
I20260709 12:23:17.224174  1554 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.477375  1554 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:17.479429  1924 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:17.472234  1862 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:17.458819 30927 rpcz_store.cc:276] 0709 12:23:16.310451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.662733 (+352282us) service_pool.cc:224] Handling call
0709 12:23:16.663124 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:16.663403 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:17.266074 (+602671us) log.cc:844] Serialized 14 byte log entry
0709 12:23:17.421965 (+155891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:17.422038 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:17.422105 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.422753 (+   648us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:17.422898 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3055,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4165,"thread_start_us":154918,"threads_started":1}
I20260709 12:23:17.461126 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.412042  1756 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:23:17.463649 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 108576us
I20260709 12:23:17.466634 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:17.441279  1880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59738 (request call id 7) took 2849 ms. Trace:
I20260709 12:23:17.402805  1857 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:23:17.422693  1899 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:17.413290  1384 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:23:17.427198  1789 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:17.465462  1904 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.475384  1868 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.485575 30899 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:17.485843 30777 raft_consensus.cc:2955] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 5 to 9, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:17.507987 30826 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.455525  1892 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:17.465418  1897 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:17.509359 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:17.509477 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.491729  1921 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:17.522318 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:17.522630 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.477388  1831 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:23:17.506709  1862 raft_consensus.cc:3055] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:17.531774 30899 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:17.554342 30929 pending_rounds.cc:85] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 7
I20260709 12:23:17.554692 30929 pending_rounds.cc:107] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:23:17.554936 30929 raft_consensus.cc:2889] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:17.517087  1960 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:17.556372  1960 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:17.556950  1960 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.519626  1892 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:17.511372  1897 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.562840 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.572971 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.575120 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:17.581363 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:17.587967 30779 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:17.588974 30781 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:17.514452  1875 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:17.607388 30783 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:23:17.609309 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 56674.6us
I20260709 12:23:17.605306 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:17.551139  1955 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:17.611603 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:17.552004  1862 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:17.618587  1862 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.619920  1862 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.621357  1824 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.622010  1824 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:17.592417  1962 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:17.623690  1962 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:17.624127  1962 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.625458  1771 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:17.570920  1789 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:17.627044  1768 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:17.562135  1384 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:17.629231  1384 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.605067  1857 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:17.634136  1857 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:17.634312  1821 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:17.634616  1857 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:17.634727  1821 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:17.635667  1821 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.636929  1821 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.541119  1907 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:23:17.531692  1932 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.562422  1245 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.515887  1868 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:17.644752 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:17.650084 31506 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:17.609414  1921 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:17.629667  1384 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:17.668306 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 54630.4us
I20260709 12:23:17.669199 30826 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:17.670925 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 318720us
I20260709 12:23:17.672338 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.638351  1874 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:17.615450  1955 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:17.650115  1907 consensus_queue.cc:1243] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:17.565508  1763 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:17.674657  1744 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:17.672142  1892 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:17.743502 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 74396.5us
I20260709 12:23:17.744455 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:17.745537 30826 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:17.562175  1899 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.650311  1245 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.710186  1955 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.759620 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.764050 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.764991 30926 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:17.713043  1537 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:17.754375 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:17.772490 30927 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:17.738574  1831 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:17.761376 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:17.785967 30932 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:17.674199  1904 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:23:17.771049 30930 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:17.717064  1964 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:17.773663 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:17.666471  1960 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.791409 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:17.792557 30933 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:17.751408  1614 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:17.756554  1921 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:17.771031  1874 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:17.750581  1744 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:17.790601  1831 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:17.800028  1614 raft_consensus.cc:697] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:23:17.812767  1825 consensus_meta.cc:287] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.003s
I20260709 12:23:17.833036  1963 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:17.797966  1921 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:17.801092  1874 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:17.815054  1873 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.755437 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:17.836413  1824 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:17.848120  1831 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:17.845248  1964 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:17.488693  1880 rpcz_store.cc:276] 0709 12:23:14.577566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:14.577726 (+   160us) service_pool.cc:224] Handling call
0709 12:23:14.585504 (+  7778us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b54004f9fa0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961099c520 00007f9610a25b42 00007f9610a24800 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54 00007f960ef61be2 00007f960ef61b11 00007f960ef61a8c 00007f960ef60d42
0709 12:23:14.608527 (+ 23023us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b580053edd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961097b0aa 00007f96109fd447 00007f9610a1a70a 00007f9610a1b76a 00007f9610a1a91b 00007f9610a2603c 00007f9610a256b3 00007f9610a1d9fa 00007f96159e54c9 00007f960ef61c54
0709 12:23:14.725560 (+117033us) log.cc:844] Serialized 501 byte log entry
0709 12:23:15.258498 (+532938us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b1800321cc0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a5bd01 00007f9610998691 00007f9610978eaa 00007f961097fd53 00007f961097fcd9 00007f961097fc69 00007f961097fc31 00007f961097edfd 0000000000388634 0000000000388479
0709 12:23:17.419107 (+2160609us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66223,"raft.queue_time_us":42229,"raft.run_cpu_time_us":25761,"raft.run_wall_time_us":581003,"spinlock_wait_cycles":58648064,"thread_start_us":37509,"threads_started":1,"wal-append.queue_time_us":31948,"wal-append.run_cpu_time_us":1846,"wal-append.run_wall_time_us":1001857}
I20260709 12:23:17.856530  1921 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:17.861354  1874 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:18.023149  1968 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 12:23:18.023850  1959 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.286s	user 0.000s	sys 0.000s
I20260709 12:23:17.876613  1824 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:18.026877  1944 log.cc:927] Time spent T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.425s	user 0.000s	sys 0.001s
I20260709 12:23:17.859160  1963 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:18.050994  1971 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 12:23:18.053196  1554 consensus_meta.cc:287] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.000s
I20260709 12:23:18.054466  1964 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.063154 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1782) took 2324 ms. Trace:
I20260709 12:23:18.100564 30928 rpcz_store.cc:276] 0709 12:23:15.738942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.739478 (+   536us) service_pool.cc:224] Handling call
0709 12:23:15.739958 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:16.489231 (+749273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:16.489270 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:16.856825 (+367555us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b2c000623c8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2
0709 12:23:16.857447 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:23:17.307866 (+450419us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:17.307925 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.308018 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:18.062827 (+754809us) raft_consensus.cc:1685] finished
0709 12:23:18.062848 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:18.063077 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2711,"raft.queue_time_us":114080,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":21185,"spinlock_wait_cycles":6829440,"thread_start_us":1198662,"threads_started":2,"wal-append.queue_time_us":639639}
W20260709 12:23:18.102574 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 494580us
I20260709 12:23:18.068495  1868 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:18.068434  1960 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:18.066651 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b23b41846a694f24a76e3aa05d9e54b2 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:18.067636  1744 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:18.064157  1793 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:18.121866 30668 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 55229.9us
I20260709 12:23:18.096624  1974 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.061913  1245 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:17.852896 30927 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:17.882704 30932 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:18.056363  1897 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:18.081944 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 326588us
I20260709 12:23:18.118786  1763 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.126719  1793 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.135383  1384 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.107885  1962 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.112458 30899 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:18.123270  1878 consensus_meta.cc:287] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.003s
W20260709 12:23:18.172420 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 69096.4us
I20260709 12:23:18.112586  1963 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.143231  1746 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:18.173544 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.012s
W20260709 12:23:18.190460  1967 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:23:18.190873 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.012s
I20260709 12:23:18.190794  1746 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.065989  1614 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.178937  1970 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:18.179175  1962 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.179420  1245 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.146030  1857 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.182972  1878 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.187778  1384 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:18.125592  1824 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.227902 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 473) took 1077 ms. Trace:
I20260709 12:23:18.192021 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.228969 30860 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 10.
W20260709 12:23:18.191820 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 547100us
I20260709 12:23:18.209987  1907 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.213843  1793 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.228585 30776 rpcz_store.cc:276] 0709 12:23:17.150274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.408805 (+258531us) service_pool.cc:224] Handling call
0709 12:23:17.409190 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:17.469035 (+ 59845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:17.469074 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:17.469822 (+   748us) log.cc:844] Serialized 52 byte log entry
0709 12:23:17.650472 (+180650us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:17.650522 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:17.650599 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:18.227680 (+577081us) raft_consensus.cc:1685] finished
0709 12:23:18.227705 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:18.227844 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13260,"raft.queue_time_us":62731,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"thread_start_us":183399,"threads_started":2,"wal-append.queue_time_us":381413}
I20260709 12:23:18.218019  1495 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.218400 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:18.218904  1862 consensus_meta.cc:287] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.003s
I20260709 12:23:18.172330  1974 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:18.189610  1932 consensus_meta.cc:287] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.003s
I20260709 12:23:18.170935  1537 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:18.230487 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:18.230834 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:18.225224  1970 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:18.203404  1744 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:18.215845  1897 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:18.066754  1874 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.213392  1955 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.245466 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:18.236972  1824 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:18.235764  1883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.034s
I20260709 12:23:18.242971  1495 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.267663  1495 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.274628  1857 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.276939  1878 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:18.278824  1957 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.801s	user 0.011s	sys 0.000s
I20260709 12:23:18.252585  1983 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:18.281344  1983 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:18.281911  1983 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:18.285131  1744 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.288182  1744 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:18.288621 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:18.289240 30932 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:18.246121  1974 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.292689  1974 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:18.294137 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.294808 30927 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:18.249365  1844 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:18.300688 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.236008  1907 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.302068 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.303198 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.303305  1907 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:18.299921 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.304461  1537 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:18.306061 30900 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.528s (SENT)
I20260709 12:23:18.306528 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:18.280844  1978 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:23:18.249748  1793 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:18.308018  1793 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.308493  1793 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.309898 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.314162 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:18.314818 30933 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:18.315829  1955 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.318427  1874 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.322464  1716 raft_consensus.cc:3055] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:18.322922  1716 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:18.325376 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.326107 30860 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 10.
I20260709 12:23:18.329097 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:18.330505 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 85151.9us
W20260709 12:23:18.335698 30926 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.026s	sys 0.079s
I20260709 12:23:18.226492  1245 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.229811  1831 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:18.325584  1883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.008s	sys 0.035s
I20260709 12:23:18.342583 30825 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:18.336289 30926 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.026s	sys 0.079s
I20260709 12:23:18.249794  1932 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:18.341190 30932 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 13.
I20260709 12:23:18.345458 30933 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:18.354693 31506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42840 (request call id 324) took 1241 ms. Trace:
I20260709 12:23:18.336937  1874 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:18.396699 30934 raft_consensus.cc:3055] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:18.397239 30934 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:18.336917  1878 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:18.400609 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:18.387522  1977 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.414968 30784 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:18.387776 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:18.348734  1873 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:18.390228  1964 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:18.390702 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:18.432324 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.391343  1723 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:18.323808  1716 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.335563  1955 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:18.393287 31510 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:23:18.369683  1979 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:18.407279 30779 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:18.409682 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.410773 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:18.424831 30783 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:18.338151  1875 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:18.412722  1878 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.429922 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.420240 30934 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.336966  1899 consensus_queue.cc:1059] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:23:18.439942 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.396122 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.444973 30777 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:18.439399  1715 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:18.476457 30930 raft_consensus.cc:2393] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:18.468982 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.479277 30935 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:18.427273 30776 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:18.465992 30934 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.483246 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.489470 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.490643 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.495118 30776 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.492504 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.496328 30935 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:18.497506 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.498327 30935 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:18.499527 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.509174 30927 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 12.
I20260709 12:23:18.440902  1960 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.396068  1921 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.535616 30930 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:18.411954  1874 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.398691 31506 rpcz_store.cc:276] 0709 12:23:17.113136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.113277 (+   141us) service_pool.cc:224] Handling call
0709 12:23:18.354416 (+1241139us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54005d43d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:18.354595 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212576000}
I20260709 12:23:18.541286 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.468288  1716 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:18.562491  1953 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 1.084s	user 0.015s	sys 0.013s
W20260709 12:23:18.564288  1984 log.cc:927] Time spent T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 12:23:18.469321  1878 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:18.612483 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 44259.5us
I20260709 12:23:18.468626 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:18.602962 30778 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 477) took 1445 ms. Trace:
I20260709 12:23:18.468639  1875 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.445998  1964 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.607192 30933 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:18.610826 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1633) took 1502 ms. Trace:
I20260709 12:23:18.638247 30781 rpcz_store.cc:276] 0709 12:23:17.108059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.404843 (+296784us) service_pool.cc:224] Handling call
0709 12:23:17.588634 (+183791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:17.589680 (+  1046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.610520 (+1020840us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540008cad0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:18.610740 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421684480}
I20260709 12:23:18.615155 30778 rpcz_store.cc:276] 0709 12:23:17.157845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.464784 (+306939us) service_pool.cc:224] Handling call
0709 12:23:17.465095 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:17.564630 (+ 99535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:17.564659 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:17.564700 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:17.564739 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.602598 (+1037859us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b54001838d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:18.602671 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:18.602877 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227392256}
I20260709 12:23:18.605062  1882 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:18.558161  1892 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.642174 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.643666 30933 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:18.565213  1745 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:18.425335  1970 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.530802  1715 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.551836  1744 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:23:18.569432  1554 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:23:18.650996 30933 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:23:18.651230 30776 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:18.433676  1977 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:18.649176  1923 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.090s	user 0.013s	sys 0.042s
I20260709 12:23:18.576241  1960 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.661746 30899 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:18.642032  1882 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:18.642033  1614 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:18.670127 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 324409us
I20260709 12:23:18.627772  1924 consensus_queue.cc:1059] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:23:18.628153  1897 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:23:18.677701 30934 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:23:18.656257  1873 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:18.663909  1923 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.013s	sys 0.043s
W20260709 12:23:18.688103 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.651823  1892 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.693779 30935 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:18.696949 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.652982  1745 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:18.455432  1963 consensus_queue.cc:1175] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "764ebfd36ce64b2a86e6d290ae92e276" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.5-7.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:18.686090  1857 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.677575  1831 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:18.714612 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 155948us
I20260709 12:23:18.692516  1844 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:18.675726  1954 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:23:18.672911  1907 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:23:18.718061 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:18.719913 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:18.722828  1715 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.724704  1892 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.725966  1875 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.676172  1962 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:23:18.726897  1921 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.729375 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.683022  1614 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.744036 30928 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:18.744233 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:18.744905 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.746491 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.747328 30785 raft_consensus.cc:2368] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9.
I20260709 12:23:18.751165  1745 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:18.744274 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.753070 30778 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.756961 30860 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:18.767845 30856 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:18.759596  1987 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:23:18.759693  1960 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:18.736989  1844 raft_consensus.cc:697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:18.763238  2002 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:18.699950  1873 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.765748 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.769199 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:18.770329  1874 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.717586  1857 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.771237  1964 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:18.771468 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.791230 30857 raft_consensus.cc:2393] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:18.771938 30852 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:18.773432  1614 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.769493 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.782229 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.780910 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.785629 30778 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:18.785959 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.781906 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:18.789387 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.791160 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.796116 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.794305 30854 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:18.794790 30859 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:18.799849 30860 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:18.803617 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.805608 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.805688 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.805843 30856 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:18.816262 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.816908 30858 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:18.817687  1974 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:18.818161  1974 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:18.819072  1974 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.820367  1974 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.821703 30851 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:18.821854  1775 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:23:18.822717 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.823263 30851 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:18.824004 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.824962 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:18.826493 30825 leader_election.cc:400] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9.
I20260709 12:23:18.826880 30825 leader_election.cc:403] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:23:18.827001 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:18.827546 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:18.827580 30859 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.828262 30860 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.808028  1878 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.813019 30930 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:18.786811  1899 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:18.843415 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.785009  2002 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:18.807938 30934 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:18.773660  1793 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.825516 30851 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:18.833091 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.838884 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.855664 30781 raft_consensus.cc:2393] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:18.840744 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:18.858896 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:18.859843 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:18.842028 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:18.782203  1245 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:18.844444 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:18.860283 30858 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.890729 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.891409 30933 raft_consensus.cc:1813] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Handling vote request from an unknown peer 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:18.891934 30933 raft_consensus.cc:2393] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:18.860909 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:18.881865 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49848.4us
I20260709 12:23:18.895627  1894 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:18.896181  1894 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:18.896763  1946 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:18.859227 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:18.897362  1946 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.898348 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:18.899619  1946 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.900534 30825 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:18.900633 30857 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:18.901206  1751 raft_consensus.cc:2764] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:18.901918  2001 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:18.856038  1983 consensus_meta.cc:287] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.002s
I20260709 12:23:18.813669  1844 consensus_queue.cc:237] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.905120 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:18.854279  1614 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:18.896968 30860 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:18.915383 31506 raft_consensus.cc:2368] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11.
I20260709 12:23:18.913687 30859 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:18.917987 30858 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:18.902511 30851 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:18.929908  1606 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:18.923585  1946 consensus_queue.cc:1059] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:23:18.929078  1962 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:18.914800  1894 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:18.932722  1606 raft_consensus.cc:697] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:18.932803  1962 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:18.856374  1899 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:18.937049 30783 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:18.938772  1899 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.934763  1962 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:18.924376  1964 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:23:18.935379  1977 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.930832  1983 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.003428  1983 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.004539 30776 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:18.970968  2000 raft_consensus.cc:3055] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:23:19.010514  2009 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.087s	user 0.000s	sys 0.004s
I20260709 12:23:19.035578 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:18.963263  1899 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:19.049116 30933 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:19.037546 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:19.050153 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:18.998705  1875 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:19.040967  1857 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:18.929698  2003 consensus_queue.cc:1059] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:23:19.042734  1793 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.045974  1868 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:19.046059  1964 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:19.050892 30928 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:23:19.040307  1824 consensus_meta.cc:287] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.006s
I20260709 12:23:19.052668 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:19.054306  1956 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 1.570s	user 0.006s	sys 0.013s
I20260709 12:23:19.049935  2000 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.055462 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:19.086197 30858 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:19.059027 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:19.059871 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.060967 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 69522us
I20260709 12:23:19.045467  1894 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.094437 30927 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:19.095616 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:19.061952  1924 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:19.101420 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.061977  1873 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.107893 30858 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:19.006309  1606 consensus_queue.cc:237] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.111547 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.116664 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:19.087028  1983 raft_consensus.cc:3055] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:19.059871  1899 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.094064  2003 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:19.060757  1875 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.151388  1875 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:19.151746  1899 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:19.151958  1882 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.102515  1892 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:23:19.153380  1882 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:19.119742  2004 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:19.120296  2001 raft_consensus.cc:2764] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:19.120610  1946 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:19.155634  1946 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:19.156030  1946 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:19.124939  1983 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.158982  1983 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.160022  1875 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.160391  1983 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:19.160540  1875 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.162837  1875 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.109573  1746 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:19.144176  1931 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:19.143980  2000 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.114379  1924 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:18.955080  2002 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.109664  1878 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.102615  1831 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:19.122704  1716 consensus_meta.cc:287] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.003s
I20260709 12:23:19.148957  1997 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:19.098520  1824 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:23:19.136503  1894 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.143194  2003 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:19.170042 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 53493us
I20260709 12:23:19.172940 30928 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:19.177896 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.180630  1998 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:23:19.173795  1954 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:19.195272  1976 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:19.195495 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:19.196100  1929 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.175599  2001 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:19.198843 31506 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:23:19.176013  1997 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.188863  1716 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:19.202292 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.202847  1723 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:19.209616  1985 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.961s	user 0.002s	sys 0.001s
I20260709 12:23:19.204137 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:19.218075 31502 raft_consensus.cc:1813] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Handling vote request from an unknown peer 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:19.218787 31502 raft_consensus.cc:2410] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:23:19.220068 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1543) took 1451 ms. Trace:
I20260709 12:23:19.199782  1894 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:19.220700  1894 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:19.221244  1894 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:19.220487 30926 rpcz_store.cc:276] 0709 12:23:17.768507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.769099 (+   592us) service_pool.cc:224] Handling call
0709 12:23:17.769571 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:17.770185 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:18.344004 (+573819us) log.cc:844] Serialized 14 byte log entry
0709 12:23:18.567771 (+223767us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:19.165393 (+597622us) spinlock_profiling.cc:243] Waited 9.89 ms on lock 0x7b1800057d60. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9002a6 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a
0709 12:23:19.174680 (+  9287us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b2c000623c8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960f318a11 00007f960f328372 00007f9610a5aa01 00007f9610a1f43a 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2
0709 12:23:19.176746 (+  2066us) log.cc:844] Serialized 26 byte log entry
0709 12:23:19.176879 (+   133us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:19.177047 (+   168us) log.cc:844] Serialized 14 byte log entry
0709 12:23:19.179628 (+  2581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:19.179684 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:19.219849 (+ 40165us) raft_consensus.cc:1685] finished
0709 12:23:19.219876 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:19.220008 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39513,"prepare.queue_time_us":762914,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2201,"raft.queue_time_us":74151,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":20264,"spinlock_wait_cycles":141992064,"thread_start_us":780661,"threads_started":2,"wal-append.queue_time_us":246368}
I20260709 12:23:19.207012 31509 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:23:19.226056  1924 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:19.189118  2000 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:19.214946 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:19.208115  1716 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.185352  2003 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.175163  1962 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.233103 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.195968  1976 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.231053  1723 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:19.239404 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.239996  1723 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:19.240469  1723 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:19.243191  1962 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.247342 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.207551  2001 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.250510 30750 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.252488  2001 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.253098  2001 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:19.253544  2001 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.254465  2001 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.257813 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:19.258539 30926 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:19.259378  1771 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:19.259950  1771 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.266410 30926 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:19.276973 30826 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:19.278322 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:19.281127  1981 raft_consensus.cc:3055] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:19.281695  1981 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:19.283790  1929 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:19.284636  1929 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:19.285175  1929 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:19.286197  1929 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.291635  1765 raft_consensus.cc:3055] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:19.292131  1765 raft_consensus.cc:740] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:19.294823  1961 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 1.544s	user 0.007s	sys 0.003s
I20260709 12:23:19.304158  1768 raft_consensus.cc:3055] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:19.304719  1768 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:19.305680  1768 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.306977  1768 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:19.316085  1982 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.195s	user 0.004s	sys 0.000s
I20260709 12:23:19.317797 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 445) took 1764 ms. Trace:
I20260709 12:23:19.318200 30929 rpcz_store.cc:276] 0709 12:23:17.553560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:17.553729 (+   169us) service_pool.cc:224] Handling call
0709 12:23:17.554120 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:17.779062 (+224942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:17.779092 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:17.779663 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 12:23:18.099422 (+319759us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:18.099730 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:18.099816 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:19.268105 (+1168289us) spinlock_profiling.cc:243] Waited 5.43 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:19.317403 (+ 49298us) raft_consensus.cc:1685] finished
0709 12:23:19.317424 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:19.317680 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51944,"raft.queue_time_us":66992,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":12496128,"thread_start_us":490917,"threads_started":2,"wal-append.queue_time_us":341077}
I20260709 12:23:19.323580  1897 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:19.324275  1897 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.340366 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:19.197151  1954 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.343868 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:19.343986  1954 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.346547 30930 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:19.348604 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.349428 30856 raft_consensus.cc:2393] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:19.353574 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.354211 30856 raft_consensus.cc:2376] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:23:19.356282 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.246134  2004 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:19.360178 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:19.365422 30929 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:19.249323  1824 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:19.363986 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.367555 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:19.257725  1962 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:19.390094 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:19.391304 30929 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:19.293087  1765 consensus_queue.cc:260] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.348172  1614 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329) with higher term. Message: Invalid argument: T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9.
I20260709 12:23:19.401319  1999 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:19.401603  2020 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.296s	user 0.003s	sys 0.005s
I20260709 12:23:19.364779  1931 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:19.364991  2004 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:19.336208  1899 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:23:19.282675  1981 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.399183  1824 raft_consensus.cc:697] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.410025  2004 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:19.405957  1962 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.405534  1771 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.426432  1981 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:19.363862  1716 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.415199  1765 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:19.446650  2033 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:23:19.449864  1962 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.451323  1824 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.367532  1997 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.455855  1997 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:19.456097  1892 consensus_queue.cc:1175] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "764ebfd36ce64b2a86e6d290ae92e276" responder_term: 11 status { last_received { term: 10 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:23:19.441241  2032 log.cc:927] Time spent T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.246s	user 0.000s	sys 0.002s
I20260709 12:23:19.488031  1894 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:19.493607  1894 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:19.498239  1897 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:19.499825  2034 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:23:19.503414  1976 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.504673  2004 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.524300  1999 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:19.361917 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.569713 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:19.570643 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.571353 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:19.576429 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:19.582474 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.586071 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:19.591022 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:19.595376 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.598496 30856 raft_consensus.cc:1275] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:19.600899 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.602311 30858 raft_consensus.cc:2393] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:19.606552 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:19.608564 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 340929us
I20260709 12:23:19.608935 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.620736 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.622550 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.622973 30854 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:23:19.623528 30855 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:19.624239 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.624696 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:19.625313 30858 raft_consensus.cc:2393] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:19.626469 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.633983 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.638329 30858 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:23:19.641636 30855 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 12:23:19.641938 30856 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:23:19.642946 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.648815 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:19.649904 30854 raft_consensus.cc:2376] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7. Re-sending same reply.
I20260709 12:23:19.659253 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.660277 30854 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:19.662616 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:19.664626 30900 leader_election.cc:336] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.697s (SENT)
I20260709 12:23:19.666752  1523 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:19.668573 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.667963  1523 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.671389 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:19.671782 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:19.672183  1523 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:19.672715 31502 raft_consensus.cc:2393] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:23:19.674088 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.674288 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:19.702649 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 111872us
I20260709 12:23:19.703519 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:19.785655 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:19.788071 30784 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:19.790343 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:19.712494  2004 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.726282  1821 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:19.727355  1831 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:19.730306  1894 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:19.730728 30855 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:19.725329  1751 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:19.732627  1899 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:19.733966 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.736899 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.738368  1793 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:19.739689 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 75212.5us
I20260709 12:23:19.740852 30860 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:19.709188 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:19.741422  1715 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:23:19.764842 30927 raft_consensus.cc:1240] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:19.768880  2031 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.401s	user 0.000s	sys 0.003s
W20260709 12:23:19.772078 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.778021 30777 raft_consensus.cc:1240] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:19.779234 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:19.782961 30782 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:19.784142  2002 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:19.725683 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1792) took 1040 ms. Trace:
I20260709 12:23:19.715315 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.818565 30858 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:19.822644 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.806088  1831 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:19.841917 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.819924  1899 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:19.851255 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:19.855743 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:19.832288 30776 rpcz_store.cc:276] 0709 12:23:18.684674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.686871 (+  2197us) service_pool.cc:224] Handling call
0709 12:23:18.687139 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:19.005177 (+318038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:19.724980 (+719803us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54003d1654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:19.725437 (+   457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729373952}
I20260709 12:23:19.854162 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.858812  1899 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:19.853119  1894 raft_consensus.cc:697] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.868208  1751 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.870175  1894 consensus_queue.cc:237] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:19.871793  1751 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.872452 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.874830 30857 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:19.876812 30857 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:23:19.877925 30931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.005s
I20260709 12:23:19.878120 30854 raft_consensus.cc:2368] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11.
W20260709 12:23:19.878357 30931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.005s
I20260709 12:23:19.879724 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1795) took 1492 ms. Trace:
I20260709 12:23:19.880945 30929 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:19.847512  1831 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:19.887392  1793 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:19.881943 30935 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:19.866650 30860 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:19.890199 30856 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
W20260709 12:23:19.872467  1955 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.321s	user 0.005s	sys 0.020s
I20260709 12:23:19.897466 30858 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:19.900287  1495 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.901029  1495 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:19.896515 30900 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.806s (SENT)
W20260709 12:23:19.895990  1955 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.420s	user 0.005s	sys 0.021s
I20260709 12:23:19.907733 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:19.904165 30785 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:19.905992 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:19.911248 30781 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:19.895939  1793 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:19.913648  1955 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:19.927801 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:19.928081 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:19.880203 30931 rpcz_store.cc:276] 0709 12:23:18.387103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:18.391290 (+  4187us) service_pool.cc:224] Handling call
0709 12:23:18.391670 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:18.391925 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:19.271945 (+880020us) spinlock_profiling.cc:243] Waited 7.77 ms on lock 0x7b18000e98c0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f96105c74bc 00007f960d91548b 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf
0709 12:23:19.272094 (+   149us) log.cc:844] Serialized 14 byte log entry
0709 12:23:19.879091 (+606997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:19.879221 (+   130us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:19.879306 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:19.879455 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:19.879622 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5207,"prepare.queue_time_us":223247,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":123,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":17878784,"thread_start_us":834721,"threads_started":2,"wal-append.queue_time_us":177325}
I20260709 12:23:19.932040 30779 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:19.933732 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 45091.9us
I20260709 12:23:19.938093  1988 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:19.939543  1723 consensus_meta.cc:287] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.010s
I20260709 12:23:19.942129 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:19.943727  1946 consensus_meta.cc:287] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.787s	user 0.016s	sys 0.003s
I20260709 12:23:19.944729 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:19.945640 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:19.951992 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:19.952415  1765 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:19.953157  1715 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:19.954649  1831 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.023458 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.031778  1765 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.032227  1955 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.032256 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.034247  1765 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.033963  1946 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:20.034848 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 46459.7us
I20260709 12:23:20.036338  1946 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:20.036585 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:20.037889 30928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.022s	sys 0.020s
W20260709 12:23:20.038278 30928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.023s	sys 0.020s
I20260709 12:23:20.038148  1979 consensus_queue.cc:1059] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:20.039024 30930 raft_consensus.cc:1240] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:20.025933 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.024905 30855 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:20.027946 30933 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:23:20.053930 30900 leader_election.cc:336] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.820s (SENT)
I20260709 12:23:20.054443 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:20.049324 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 121914us
W20260709 12:23:20.059988 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 106205us
I20260709 12:23:20.061546 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:20.064738  1929 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.065517  1929 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:20.066661  1768 consensus_meta.cc:287] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.012s
I20260709 12:23:20.067687  1554 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.067822  1899 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.070868 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:20.073063 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:20.076771 30927 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:20.080984 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:20.080865 30931 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:20.074615 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.091531 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.091884  1792 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:20.092571  1792 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:20.093825  1792 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.096668 30783 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:20.096712  1765 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.097878  1921 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.098630  1921 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.097935  1765 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.100998  1929 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.101078  1921 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:20.102336 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 75494.4us
I20260709 12:23:20.102681 30929 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:20.102922 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.101130  1765 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.068488  1554 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.108414 30931 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:20.074339  1495 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.119997 30858 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:20.121207 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.041786  1723 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.124997 30933 raft_consensus.cc:2393] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 11: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:20.135819  1723 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.136138  1554 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:20.137724  1384 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:20.138293 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.139675 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.144048 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.149331 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.151891 30931 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:20.152489 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.153620 30929 raft_consensus.cc:2393] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:20.154601 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.155856 31502 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:20.122274  1715 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.162707  1831 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.169799 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:20.171485 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:20.174010  1245 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:20.174842  1245 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:20.176090 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:20.177026 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.179316  1554 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:20.179554  1523 consensus_queue.cc:1059] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:20.180749  1523 consensus_queue.cc:1059] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:20.164816 30681 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.181434  1554 raft_consensus.cc:3055] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:20.181596  1716 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:20.169437 30927 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:20.198029 30931 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:20.188155 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.191723 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.206161 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.206430 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:20.212867 30933 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:20.195936  1495 consensus_queue.cc:1059] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:23:20.227779 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.228623  1495 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:20.229106  1495 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:20.231004 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:20.231675 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 89024.7us
I20260709 12:23:20.232633 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:20.234058  1921 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:20.234730  1921 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:20.235328  1921 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:20.235884  1883 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:20.236397  1883 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:20.236871  1883 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.198516  1554 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:20.234148  1875 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:20.181731  1523 consensus_queue.cc:1243] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer 5e7509fe1be74f179626fb4fcb4b4e65 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:23:20.197258  1245 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.240957  1554 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.241595 30931 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:20.247308 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.248770 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.249722 30927 raft_consensus.cc:2410] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:20.249888  1723 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:20.250478  1723 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:20.250658  1983 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.251246  1983 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.273007 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:20.280089 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.285386 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:20.194729  1892 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.243044  1554 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:20.291951 30929 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:20.303730 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:20.304682 30927 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:20.251763  1723 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.283671  1495 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.311205  1495 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:20.326143  1899 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:20.327064  1875 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:20.337116  1892 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.340404  1892 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.344005 30825 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:20.366842 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.378237 30783 raft_consensus.cc:2410] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:23:20.181857  1897 consensus_queue.cc:1059] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.227s
I20260709 12:23:20.383671  1384 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:20.384197  1384 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:20.392300 30930 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:20.284422  1921 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.402998 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:20.381393  1245 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.427547  1883 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.435665 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.449949  1763 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:20.450800  1763 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.458098 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.385190  1384 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.460224  1763 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.421904 30681 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.462136 30783 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:20.461969  1851 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:20.462724  1851 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.465130  1851 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:20.465332 30851 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:20.419631  1875 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:20.475916 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:20.487188 30927 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 12.
W20260709 12:23:20.492045 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 388933us
I20260709 12:23:20.473470  1875 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:20.478535 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:20.474392  1715 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:20.481048  1897 raft_consensus.cc:3055] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:20.515933 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.491595  1929 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:20.472890  1821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.015s	sys 0.020s
W20260709 12:23:20.507203 30934 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.017s	sys 0.017s
W20260709 12:23:20.523473 30934 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.018s	sys 0.018s
W20260709 12:23:20.522106 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 343142us
I20260709 12:23:20.523970 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.503798  1875 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.530315 30783 raft_consensus.cc:1275] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:23:20.506826 30900 connection.cc:256] RPC call timeout handler was delayed by -1.0587377300003027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260709 12:23:20.532186 30900 connection.cc:256] RPC call timeout handler was delayed by -1.0407377300002736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 12:23:20.533365 30900 connection.cc:256] RPC call timeout handler was delayed by -1.0209377300002416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
W20260709 12:23:20.533844 30900 connection.cc:256] RPC call timeout handler was delayed by -1.0182377300002372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 12:23:20.536034 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.488507  1245 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.536965 30783 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
W20260709 12:23:20.523501  1821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.015s	sys 0.020s
W20260709 12:23:20.540808 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 412883us
I20260709 12:23:20.520809  1897 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:20.534951 30930 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:20.522640  1929 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:20.546564 30899 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.551432  1979 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:20.552112  1979 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.552489  1979 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:20.554379 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.563746 30935 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:20.573314 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:20.569602 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 43807.4us
I20260709 12:23:20.550411  1929 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:20.589744 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:20.596493 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.588027  1554 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.589807  1921 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.636242 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.637984 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.638804 30778 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
I20260709 12:23:20.638886  1821 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:20.639389  1821 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.639750  1821 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:20.615717  1793 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:20.641846  1793 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:20.643221  1955 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:20.643115  1793 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.646495 30900 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:20.646309  1897 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:20.672053 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 58412.1us
I20260709 12:23:20.675738 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.685653  1894 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:20.685945 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 83360.2us
I20260709 12:23:20.686443  1894 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:20.687214 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.687539  1894 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.688375 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.689090 30930 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:20.689909  2053 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.690537 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:20.690315 30900 leader_election.cc:400] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11.
I20260709 12:23:20.691493 30930 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:20.691754 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.691890 30900 leader_election.cc:403] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:20.693320  1765 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:20.693919  1716 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.694588  1716 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:20.695470  1851 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.693424  1979 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.696331  1851 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.697271  1716 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:20.693749  1765 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:20.699918  1765 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:20.701210  1979 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:20.702044  1979 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11.
I20260709 12:23:20.702277 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:20.705325 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.673501  1523 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:20.706028 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.707046 30782 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:23:20.708946 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 167309us
I20260709 12:23:20.612473  1554 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.681332  1897 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:20.713238 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.715298 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:20.718092 30778 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:20.716207 30781 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:20.724253 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.724895  1824 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:23:20.725373  1554 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:20.726876  2054 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:23:20.730789  1851 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:20.731902 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42868 (request call id 1644) took 1111 ms. Trace:
I20260709 12:23:20.732337 30851 rpcz_store.cc:276] 0709 12:23:19.620971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.624247 (+  3276us) service_pool.cc:224] Handling call
0709 12:23:20.731661 (+1107414us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540003edd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:20.731803 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021010304}
I20260709 12:23:20.744331 30854 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:20.740790  1981 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:23:20.747416 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.748769 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.754940  1981 consensus_queue.cc:1059] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:20.756484  1981 raft_consensus.cc:3055] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:20.756932  1981 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:20.758426  1981 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.759859  1981 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:20.762209  1824 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.762785  1824 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.765264  1824 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.766448  1929 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.768635  1929 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.690598  2053 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.738862  1554 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:20.781839 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 262909us
I20260709 12:23:20.782140 30782 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:20.785739 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1661) took 1049 ms. Trace:
W20260709 12:23:20.789839 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:20.780936  1245 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.786338 30853 rpcz_store.cc:276] 0709 12:23:19.732254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.737875 (+  5621us) service_pool.cc:224] Handling call
0709 12:23:19.738388 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:19.738906 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:20.053958 (+315052us) log.cc:844] Serialized 14 byte log entry
0709 12:23:20.494922 (+440964us) log.cc:844] Serialized 14 byte log entry
0709 12:23:20.781315 (+286393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:20.781369 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:20.781415 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.781561 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:20.781704 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499242,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":112656,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":9009,"thread_start_us":1014579,"threads_started":3,"wal-append.queue_time_us":631376}
W20260709 12:23:20.831653 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 455473us
I20260709 12:23:20.832768 30826 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:20.834444  2059 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:20.835103  2059 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:20.839526 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 149918us
I20260709 12:23:20.797991  1554 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.840207 30778 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:20.843174 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:20.852684 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:20.849594  1523 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:20.857146  1554 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:20.862433  2060 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:23:20.865640  1983 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:20.880843 30899 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.886484 30899 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:20.888849  1523 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:20.898337 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 65701.9us
I20260709 12:23:20.902184  2059 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:20.902938 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:20.903795 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:20.904778 31506 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:20.907691 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1668) took 1153 ms. Trace:
I20260709 12:23:20.916589  1883 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:20.897482 30900 connection.cc:256] RPC call timeout handler was delayed by -1.2669938179997189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 12:23:20.927206  1384 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:20.930738  2070 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 12:23:20.933925  1988 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:20.939100  2053 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:20.940490 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 56478.4us
I20260709 12:23:20.854442  1921 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:20.947201 31502 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:20.948175 30681 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 3 to 7, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New cstate: current_term: 6 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.963219 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:20.995615 30934 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:20.998158  1929 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:20.998888  1929 raft_consensus.cc:697] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:21.000102  1929 consensus_queue.cc:237] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:20.963824  2059 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:21.005455  2059 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:21.006744  2059 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:20.963920 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 77557.7us
I20260709 12:23:21.018954 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.020135 30777 raft_consensus.cc:2410] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:20.965384 31510 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:20.967702 30854 rpcz_store.cc:276] 0709 12:23:19.754645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:19.880168 (+125523us) service_pool.cc:224] Handling call
0709 12:23:20.733669 (+853501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:20.745007 (+ 11338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:20.907444 (+162437us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540003edd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:20.907614 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1962005376}
I20260709 12:23:21.023938  1245 consensus_queue.cc:1059] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:20.974174 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:20.968195 30900 connection.cc:256] RPC call timeout handler was delayed by -1.1562938179999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 12:23:21.026365 30900 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.588s (SENT) [suppressed 13 similar messages]
W20260709 12:23:21.027344 30900 leader_election.cc:336] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.589s (SENT)
I20260709 12:23:21.025579  2071 raft_consensus.cc:3055] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:21.031702  2071 raft_consensus.cc:740] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:21.032728  2071 consensus_queue.cc:260] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.034209  2068 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:21.034718  2068 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.035106  2068 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.041460  2072 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:23:21.029565 30900 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.095s (SENT)
I20260709 12:23:21.046449 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:21.047570  1384 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:21.052471 30900 leader_election.cc:336] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.140s (SENT)
I20260709 12:23:21.053177 30900 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:21.054742  1384 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:21.045440  2071 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:21.064682 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:21.066820 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:20.976325 30682 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48042 (request call id 178) took 29585 ms (client timeout 15000 ms). Trace:
I20260709 12:23:20.971849  1988 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:21.138577  1988 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:21.139674  1988 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:20.974061  1768 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:23:20.974637  1921 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:23:21.134286 30682 rpcz_store.cc:269] 0709 12:22:51.393716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:51.413868 (+ 20152us) service_pool.cc:224] Handling call
0709 12:23:20.913721 (+29499853us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:15.434271 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:15.657963 (+223692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:15.657999 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:23:15.658020 (+    21us) tablet.cc:662] Decoding operations
0709 12:23:15.658719 (+   699us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:15.658779 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:15.658808 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:23:15.659194 (+   386us) tablet.cc:701] Row locks acquired
0709 12:23:15.659209 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:23:15.659353 (+   144us) write_op.cc:270] Start()
0709 12:23:15.659471 (+   118us) write_op.cc:276] Timestamp: P: 1783599795659306 usec, L: 0
0709 12:23:15.659489 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:23:15.660204 (+   715us) log.cc:844] Serialized 1705 byte log entry
0709 12:23:17.150586 (+1490382us) op_driver.cc:464] REPLICATION: finished
0709 12:23:17.498160 (+347574us) write_op.cc:301] APPLY: starting
0709 12:23:17.501925 (+  3765us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:17.532407 (+ 30482us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:17.566409 (+ 34002us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:17.567161 (+   752us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:17.567460 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:23:17.567529 (+    69us) write_op.cc:312] APPLY: finished
0709 12:23:17.650087 (+ 82558us) log.cc:844] Serialized 40 byte log entry
0709 12:23:17.670977 (+ 20890us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.713095 (+ 42118us) write_op.cc:454] Released schema lock
0709 12:23:17.739058 (+ 25963us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:17.763971 (+ 24913us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:17.785182 (+ 21211us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5182006,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":298622,"apply.run_cpu_time_us":12694,"apply.run_wall_time_us":267635,"num_ops":4,"prepare.queue_time_us":263650,"prepare.run_cpu_time_us":65325,"prepare.run_wall_time_us":1089099,"raft.queue_time_us":414565,"raft.run_cpu_time_us":33879,"raft.run_wall_time_us":226498,"replication_time_us":1490927,"thread_start_us":1563342,"threads_started":4,"wal-append.queue_time_us":1057021,"wal-append.run_cpu_time_us":29413,"wal-append.run_wall_time_us":2057146}]]}
I20260709 12:23:21.143016  1921 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:21.025588 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 51499.3us
I20260709 12:23:20.964654  1875 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.147476  1875 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:21.147677 30854 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:23:21.149346 30853 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:20.962620  1523 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.150317  1523 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:21.150795 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.151973 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.152752 30859 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:21.153910  1875 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.154179 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:20.991796  1554 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:21.074144 30777 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:21.154592 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 87919.3us
I20260709 12:23:21.156504 30858 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:20.976027  1765 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.157176 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.156554  1554 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:21.159211  1765 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:20.961676  1821 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.159880  1554 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:21.160465 30854 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:21.155288 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.161330  1821 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:21.085420 30785 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:21.090291 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 262641us
I20260709 12:23:21.163462 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:21.164234  1713 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:21.164333 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:21.164405  1875 consensus_queue.cc:1059] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:23:21.121186 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.164734 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.166076  2076 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:21.166529  2076 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.166932  2076 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.167272  1768 raft_consensus.cc:3055] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:21.167219 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.167795  1768 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:21.168010 30855 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.168915 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.168767  1768 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:21.129307 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 76885.3us
I20260709 12:23:21.170130 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:21.170745 30900 leader_election.cc:336] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 2.169s (SENT)
I20260709 12:23:21.170846 30860 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:21.171216 30900 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:21.171326 30852 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:23:21.172014  1554 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:21.174346 30856 raft_consensus.cc:1240] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:20.978916 30681 catalog_manager.cc:5697] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.164690  1713 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:21.170176 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.176127  1713 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:21.176833 30681 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.178118 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.179420  2084 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:21.179208 30681 catalog_manager.cc:5697] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.179972 30852 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:23:21.182106 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.183393 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.179208 30859 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:21.187156 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.188776 30852 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:21.189821 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.190415 30852 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:21.190639 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:21.191306 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.191689 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:21.197433 30852 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:21.199029 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:21.199662  1245 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:21.200075  1245 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:21.201262  1245 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.202106 30934 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:21.202581  1245 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.131179  2068 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.192858 30855 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:21.194325  1768 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.195415 30858 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
W20260709 12:23:21.196421 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 380902us
I20260709 12:23:21.180892 30681 catalog_manager.cc:5697] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.102870  1929 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:21.192432 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.223868 30859 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:21.182139 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:21.220296 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.222538 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:21.230271 30681 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.241927 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:21.253021 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.253051 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:21.255574 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.256577 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.257362 30858 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:21.258570 30927 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:21.254347 30934 raft_consensus.cc:2376] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7. Re-sending same reply.
I20260709 12:23:21.265197 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:21.229133 30854 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:21.265198 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.266186 31510 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:21.254129 30855 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 6.
W20260709 12:23:21.219450 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:21.269232 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 98512.8us
I20260709 12:23:21.270087 30784 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:21.272145 30935 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:21.275800 30928 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 12:23:21.285833 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.299508 30929 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 13.
I20260709 12:23:21.301386 30858 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:23:21.302608 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.303927 30681 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.305542 30681 catalog_manager.cc:5697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.307140 30681 catalog_manager.cc:5697] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.308833 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:21.309448 30934 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.239164  1523 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.312325 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:21.320753 30927 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:21.314270 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:21.295440  2075 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:23:21.316731 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:21.324684 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 88039.8us
I20260709 12:23:21.305689 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:21.333912 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:21.336524 30860 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:21.337126 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:21.337879 30935 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.302424  1384 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.341665 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:21.345345 30929 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:21.373589 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 191553us
I20260709 12:23:21.312397 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:21.378235 30858 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:21.379722 30931 raft_consensus.cc:2393] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:21.324331  2074 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:21.385080 30856 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:21.306135  1875 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:21.374787  2084 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:21.404898 30851 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:21.405086 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:21.312942  1715 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:23:21.336491  1894 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:23:21.420334 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 78039.4us
I20260709 12:23:21.403986  1495 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:21.431208 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:21.448326 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:21.440346 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 159608us
I20260709 12:23:21.433048 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:21.449985  1921 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:21.454732  1921 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:21.456976  1921 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:21.459332  2083 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:21.413821  2074 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.448266  1875 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:23:21.462296 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 57350.9us
I20260709 12:23:21.432390  2071 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.385140  1384 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:21.429561  2084 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:21.544521 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 111538us
I20260709 12:23:21.545475 30826 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:21.449738  1981 consensus_queue.cc:1048] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:23:21.547786 30928 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:21.474403  1894 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:21.604923 30778 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:23:21.614486 30778 pending_rounds.cc:85] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 9
I20260709 12:23:21.450155 31502 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:21.452489  1765 raft_consensus.cc:493] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:21.500936  1495 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:21.594007 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:21.614879 30778 pending_rounds.cc:107] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:23:21.641880 30778 raft_consensus.cc:2889] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:21.616362 30929 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
W20260709 12:23:21.644565 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 192069us
W20260709 12:23:21.601310  2091 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:23:21.643467 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 317111us
I20260709 12:23:21.549455  2068 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:21.654913 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:21.607841  1929 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.592396  2059 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:23:21.678825 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 192911us
I20260709 12:23:21.475055  1875 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.680326 30826 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:21.660000  2086 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:23:21.702419 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:21.703097 30784 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:21.646420  1715 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:21.704181 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.699052 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:21.709731 30778 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:21.710156 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 116298us
I20260709 12:23:21.663166  1821 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.691586 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.641635  1713 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:21.682227  1523 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:21.725396 30852 consensus_meta.cc:287] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.527s	user 0.013s	sys 0.000s
I20260709 12:23:21.730213 30852 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:21.682849  2098 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:21.700418  2074 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:21.737195 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:21.738469 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:21.691058  1765 raft_consensus.cc:515] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:21.694835  2059 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.702523  1929 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.735975  2098 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:21.735142  2107 raft_consensus.cc:2764] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:21.737838  1495 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:21.784976 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 67939.4us
W20260709 12:23:21.785390 30859 consensus_meta.cc:287] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.547s	user 0.002s	sys 0.009s
I20260709 12:23:21.786027 30859 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 12.
I20260709 12:23:21.746263  2074 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.728560  1792 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:23:21.722424  1715 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.788349 30778 raft_consensus.cc:2468] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:23:21.788784 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46397.2us
I20260709 12:23:21.793210  1765 leader_election.cc:290] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:21.794904  2090 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:23:21.795523 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:21.795984 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.820822 30780 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:21.804016 30784 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:21.821856  1713 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:21.744365  1821 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:23:21.741290  2101 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:23:21.785503  2098 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:21.824193 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 144873us
I20260709 12:23:21.791035  2067 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.824641  1384 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:21.818228  2074 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.844151 30926 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:21.844784 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:21.881853 30929 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:21.826697  1715 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:21.825186  2084 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:21.870700 31477 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:21.889948 30935 consensus_meta.cc:287] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 12:23:21.894241 30935 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:21.834440  2059 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:21.838745  2110 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:21.895752  1715 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 12:23:21.901492  2100 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:23:21.902272  2105 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:23:21.905406  2076 consensus_meta.cc:287] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.738s	user 0.006s	sys 0.003s
I20260709 12:23:21.922299  2076 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:21.827962  1765 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:23:21.926879 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.929319 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.931507  1384 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.931702 30784 raft_consensus.cc:2410] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:21.932090  1384 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:21.933017 30934 consensus_meta.cc:287] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
I20260709 12:23:21.933139 30780 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:21.933486 30934 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:21.934566  1384 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:21.935298  2110 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:21.935784  2110 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:21.830639  2116 consensus_queue.cc:1059] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
W20260709 12:23:21.917436  1768 consensus_meta.cc:287] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.688s	user 0.008s	sys 0.003s
W20260709 12:23:21.917842 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 127857us
I20260709 12:23:21.889209  1763 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:23:21.833257  1929 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:21.848454  2067 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:21.931839  1245 consensus_meta.cc:287] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.005s
I20260709 12:23:21.943481 30899 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:21.951534 30929 raft_consensus.cc:2468] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
W20260709 12:23:21.954569 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 152410us
I20260709 12:23:21.955332 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:21.958079 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:21.955580 30899 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:21.959301 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.940567  2104 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:21.961704 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:21.962644 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:21.972934 30856 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:21.974514 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.975261 30853 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.973871 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.981179  2065 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:21.981717 30860 raft_consensus.cc:1240] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:21.982384 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:21.982789 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.983021 30785 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:21.983493 30860 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:21.986136 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:21.988994  2067 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:21.959360  2117 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:21.990128  2117 raft_consensus.cc:697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:21.969861  2104 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:21.991353  2117 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:21.993060  2104 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:21.961097  1821 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:21.994257  1821 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:21.994812  1821 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:21.997004  1768 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:21.965358  1894 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:21.998133 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 317879us
I20260709 12:23:21.970345  1897 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:21.999194  1897 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:21.999718  1897 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.003237 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:21.994846 30900 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:22.005146  1981 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:22.007071 30825 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:22.007284  2106 raft_consensus.cc:2804] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:22.008181  2106 raft_consensus.cc:697] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:22.009454 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:22.010444 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 169031us
I20260709 12:23:22.010897 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:22.011868  2118 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:22.012387  2118 raft_consensus.cc:697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:22.012703 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:22.013145 31477 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:22.013564  2071 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:22.014308  2071 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.015173  1768 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:22.015869  2108 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:22.023389  1765 raft_consensus.cc:3055] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:22.023854  1765 raft_consensus.cc:740] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.024142 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:22.024729  1765 consensus_queue.cc:260] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.028733 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.032132 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:22.031960 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:22.033151 30856 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:22.030308 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 51182.1us
I20260709 12:23:22.040925 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:22.043623 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.046861 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.050136 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:22.044299  2067 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:23:22.058480 30785 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
W20260709 12:23:22.068878 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 107268us
I20260709 12:23:22.070933 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.043165  1765 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:22.043758  1495 raft_consensus.cc:2804] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:22.098594 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:22.013275  2118 consensus_queue.cc:237] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.111981 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.084414  1875 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:22.088508  2113 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:22.124498 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:22.127260 30934 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.055225  2098 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:22.119990  2119 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:22.131546 31506 raft_consensus.cc:1240] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.133459 30853 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:22.112160  2076 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:22.136368 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 45234.9us
I20260709 12:23:22.114259  1495 raft_consensus.cc:697] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:22.009536  2106 consensus_queue.cc:237] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:22.145864 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.141731 30856 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:22.146852 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:23:22.147200 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 63097.2us
W20260709 12:23:22.154964 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 127337us
I20260709 12:23:22.137236  2113 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.138049  2074 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.169561 30826 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:22.171012 30934 raft_consensus.cc:2468] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:22.176137 31477 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:22.149819  2119 raft_consensus.cc:697] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.193123 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:22.201965 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:22.202719 30857 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.204897 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:22.151500  1875 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:23:22.209630 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.197101  1792 raft_consensus.cc:2804] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:22.211308 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:22.199627  2072 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:22.215121 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.210482  1894 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:23:22.216576  2098 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:22.217657  1894 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:22.218192  1894 raft_consensus.cc:697] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.219195  1894 consensus_queue.cc:237] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.162133  2114 consensus_queue.cc:1059] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:23:22.236908  2115 consensus_queue.cc:1048] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:23:22.238384  2119 consensus_queue.cc:237] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.239702  2065 raft_consensus.cc:2764] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:22.214721  1981 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:23:22.242043  2099 raft_consensus.cc:2764] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:23:22.242765  2121 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:23:22.243070  2114 raft_consensus.cc:3055] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:22.243492  2114 raft_consensus.cc:740] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:22.233800 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.244375  2114 consensus_queue.cc:260] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.246115 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:22.236666 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:22.250917 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.258324 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:22.210907  2067 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:22.282449 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.262863 30857 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 7.
I20260709 12:23:22.290263 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:22.301550 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 108502us
I20260709 12:23:22.302567 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:22.303400 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 45216.2us
I20260709 12:23:22.245653  2114 raft_consensus.cc:3060] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:22.264766  2122 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:22.242089  1981 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:22.249891  1921 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:23:22.267655  2123 log.cc:927] Time spent T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:23:22.260440  1792 raft_consensus.cc:697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
W20260709 12:23:22.314364 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 109552us
I20260709 12:23:22.312409  2098 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:22.266646  2065 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:22.310917  2059 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:22.263981  1821 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.317692 30750 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:22.316598  2116 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:22.234354  1495 consensus_queue.cc:237] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:22.348035  1554 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.366070  1765 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:22.323462  1921 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:22.379511 30781 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.379312  1554 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.380604  1921 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.382031  1921 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:22.383373  2125 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:22.316103  1897 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.339893  1384 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.384737 30781 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:22.385272  1384 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.386669  1897 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.388058  1384 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.368854  1715 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:22.390249  2115 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:22.390587  1715 consensus_queue.cc:1059] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:22.307150  2067 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.393713  2132 raft_consensus.cc:3055] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:22.394186  2132 raft_consensus.cc:740] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.394568  2067 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.395169  2132 consensus_queue.cc:260] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.319953  1981 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:22.313545  2074 consensus_queue.cc:1059] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:23:22.406023 30783 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:22.406330 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:22.407102 30933 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:22.407248 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:22.409204 30928 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: [6.5-10.7]
I20260709 12:23:22.405323 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:22.410480 30935 raft_consensus.cc:2410] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:22.411049 30934 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.242089  2113 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:22.423254 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:22.424784 30935 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:22.428784 30935 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:22.430814 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:22.431672 30933 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:23:22.433255 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 65111.5us
I20260709 12:23:22.454370 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:22.455646  1765 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.401330  2116 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.413391  2132 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.423584  1554 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.465327 30930 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:22.458325 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:22.456091 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:22.471809 30935 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:22.466375 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:22.474174 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0091994870003873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:23:22.456600 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:22.478787 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:22.488179  2139 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:22.469013  2109 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.480988 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:22.451766  2098 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:22.460361 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 114137us
I20260709 12:23:22.489373 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:22.398929  2110 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.490092 30926 raft_consensus.cc:2368] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 11. Current term is 12.
I20260709 12:23:22.475827  2072 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.495436 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.414688  1792 consensus_queue.cc:237] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:22.482371 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:22.495577 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:22.496455  2116 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.496817  2098 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:22.497830  1821 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:22.509441 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.499580  2110 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.503226 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.482098  1929 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.512420 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.522759 30856 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:22.524960 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:22.491657  2139 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:22.526003 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:22.500895  2072 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:22.530177 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.541127 30933 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:22.552785 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.553841 30856 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:22.567519 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.570258 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.571338 30853 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:22.575141 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:22.577271 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 88808.1us
I20260709 12:23:22.578953 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:22.579990 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:22.535931  2139 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:22.491689  1981 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:22.527102  1929 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.503194  2109 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.600436 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.601150 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.611843 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.612730 30856 raft_consensus.cc:2410] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:22.623175 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.624495 30856 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:22.576627  1765 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.626381 30853 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:23:22.629391  2136 log.cc:927] Time spent T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:23:22.640239  1715 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:22.640934  1715 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:22.641994  1715 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.648376  2137 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.649178  2137 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.652307  2137 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:22.645579 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.666697 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.686012  1554 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.689201  1554 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.691744  2072 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:22.700945 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.708250  2067 raft_consensus.cc:3055] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:22.708899  2098 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:22.724458  1245 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:22.725180  1245 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.659142  1981 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:22.727362  1245 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:22.729013 30784 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:22.735211 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:22.735740 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.735954 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.736090 30853 raft_consensus.cc:2376] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8. Re-sending same reply.
W20260709 12:23:22.737246 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.737114 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.738096 30851 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:22.740178 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.740410 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:22.741098 30853 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:22.743125  2109 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:22.744660 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.774747 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.775508 30853 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:22.776763 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.779106 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.782267 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.783218 30857 raft_consensus.cc:2376] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9. Re-sending same reply.
I20260709 12:23:22.708896  2067 raft_consensus.cc:740] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:22.781256  2059 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:22.786613  2067 consensus_queue.cc:260] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:22.787432  2059 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.788728  2067 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:22.789660  2059 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.791304 30783 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:22.790553 30851 raft_consensus.cc:1275] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:22.794479 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.805984 30856 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:22.806588 30856 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:22.807560 30856 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.808871 30856 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:22.811216  1929 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:22.819437 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:22.820261 30783 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:23:22.820384 30776 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 10.
I20260709 12:23:22.820865 30783 pending_rounds.cc:85] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 7
I20260709 12:23:22.821288 30783 pending_rounds.cc:107] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 12:23:22.823486  2128 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.472s	user 0.000s	sys 0.005s
I20260709 12:23:22.825608 30779 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:22.821666 30783 raft_consensus.cc:2889] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:22.792958 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:22.841432 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.842180 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:22.844755  2110 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.845438  2110 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.848230  2110 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.852742  1554 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:22.853571  1554 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:22.854935  2059 raft_consensus.cc:3055] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:22.855484  2059 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:22.855970  1929 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:22.856689  1929 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.856586  2059 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:22.858980  2059 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:22.868717  2114 consensus_meta.cc:287] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.006s
I20260709 12:23:22.869989 30852 raft_consensus.cc:2410] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:23:22.798874  2141 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.185s	user 0.004s	sys 0.000s
I20260709 12:23:22.832696 31476 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:22.875845  2093 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:22.876394  2093 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:22.876796  2093 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:22.886070 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 53486.1us
W20260709 12:23:22.891124 31477 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.28.234.126:42357, user_credentials={real_user=slave}} blocked reactor thread for 54146.2us
I20260709 12:23:22.895903 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.896929 30859 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
W20260709 12:23:22.898373 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.898960 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.907477 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 126698us
I20260709 12:23:22.909991 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:22.911558  2118 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:23:22.927270  1921 consensus_meta.cc:287] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.002s
W20260709 12:23:22.938781 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:22.938272 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46105.8us
I20260709 12:23:22.943774  1713 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:22.774797  2137 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:22.954849  2137 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:22.958160  2137 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:22.961946 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 159260us
W20260709 12:23:23.014060 30900 leader_election.cc:336] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.660s (SENT)
I20260709 12:23:23.014780 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:22.962826 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 67863.3us
W20260709 12:23:22.966648 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 386735us
I20260709 12:23:23.002808 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:23.016096 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:23.016601 30859 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:22.942932 30825 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:23.039103 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 96245.9us
I20260709 12:23:23.046583 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:23.047752 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:23.049676 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 84096.3us
I20260709 12:23:23.056031 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:23.056747 30934 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:23.064779 30856 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:23:23.065261 30856 pending_rounds.cc:85] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 7
I20260709 12:23:23.065503 30856 pending_rounds.cc:107] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:23:23.065737 30856 raft_consensus.cc:2889] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:23.070359 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:23.082769 30933 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:23.035883  1929 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:23.043540  2110 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.052873  2118 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:23.097499  2132 consensus_meta.cc:287] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.006s
I20260709 12:23:23.035347  1713 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:23:23.085275  2137 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:23.112612 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:23.080744  2059 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:23:23.137024 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.137197  2059 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:23.139834  2059 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:23.141167 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:23.141932 30856 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:23.142781 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:23.130129  2113 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:23.132117 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:23.200600 30854 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:23.203668  1554 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:23.204352  1554 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:23.206672  1554 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:23.103446  2118 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:23.117693  2111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.019s
I20260709 12:23:23.212903 30854 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:23:23.214797 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.214968 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.197669  2106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.016s	sys 0.008s
I20260709 12:23:23.217453 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:23.262097 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:23.266546 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:23.118229  2140 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:23.262591 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:23.218181 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.273183 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.265910 30858 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:23.267321 30859 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:23.265095 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:23.280809 30778 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:23.207989  2115 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.267583  2111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.001s	sys 0.021s
I20260709 12:23:23.105371  2110 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:23:23.266254  2106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.016s	sys 0.010s
I20260709 12:23:23.326866 30931 raft_consensus.cc:1240] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:23.327442  1929 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:23.324018  1981 consensus_meta.cc:287] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
I20260709 12:23:23.330403  2093 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:23.331104 30932 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:23:23.331640 30932 pending_rounds.cc:85] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 8
I20260709 12:23:23.331919 30932 pending_rounds.cc:107] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:23:23.332206 30932 raft_consensus.cc:2889] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:23.333232  2093 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:23.335392 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 321367us
I20260709 12:23:23.212996  2118 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:23.346069 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.259410  2113 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:23.366600 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 158114us
W20260709 12:23:23.627804 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.628427 30899 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.629298  2137 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.469836  1894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.019s	sys 0.029s
W20260709 12:23:23.630635 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 368112us
I20260709 12:23:23.631348  2110 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:23.559360  1765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.018s	sys 0.029s
I20260709 12:23:23.283834  2114 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.632454  1765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.024s	sys 0.033s
W20260709 12:23:23.529603  2119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.018s	sys 0.039s
W20260709 12:23:23.555868 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.632930  2114 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:23.585167 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:23.633626  2119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.025s	sys 0.041s
I20260709 12:23:23.582819 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:23.579856  2139 consensus_meta.cc:287] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.982s	user 0.005s	sys 0.007s
I20260709 12:23:23.583439 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:23.679272 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:23.676072  1245 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:23.438410  1792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.028s	sys 0.121s
W20260709 12:23:23.631428  1894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.029s	sys 0.035s
W20260709 12:23:23.686218 31477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.005s	sys 0.005s
W20260709 12:23:23.710525 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:23.685448 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:23.282970  2140 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:23.583882 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:23.431766 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.674293 30777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.026s	sys 0.009s
W20260709 12:23:23.674986 30935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.038s	user 0.020s	sys 0.015s
W20260709 12:23:23.427896 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62098.2us
I20260709 12:23:23.470553  2115 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:23.636003  2114 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:23.710574 30779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.020s	sys 0.031s
W20260709 12:23:23.710531 31477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.006s	sys 0.006s
I20260709 12:23:23.716100 30776 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:23:23.728822 30779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.020s	sys 0.031s
I20260709 12:23:23.715515 30853 raft_consensus.cc:2376] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9. Re-sending same reply.
W20260709 12:23:23.717549 30777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.027s	sys 0.009s
W20260709 12:23:23.717793 30935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.021s	sys 0.015s
I20260709 12:23:23.681447  1245 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:23.450090  2145 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.006s	sys 0.040s
I20260709 12:23:23.676167  2110 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.643656  1554 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:23.710192  1792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.029s	sys 0.128s
W20260709 12:23:23.737440 30852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.009s	sys 0.017s
I20260709 12:23:23.737933 30777 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 523) took 1193 ms. Trace:
W20260709 12:23:23.743273 30852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.010s	sys 0.017s
W20260709 12:23:23.736537  2145 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.009s	sys 0.040s
I20260709 12:23:23.643513  2137 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:23.766096 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:23.766981 30933 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:23:23.769165 30927 raft_consensus.cc:1275] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:23:23.741667  1875 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.010s
I20260709 12:23:23.743753 30777 rpcz_store.cc:276] 0709 12:23:22.537057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.537179 (+   122us) service_pool.cc:224] Handling call
0709 12:23:22.563098 (+ 25919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:22.563394 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:22.586650 (+ 23256us) log.cc:844] Serialized 14 byte log entry
0709 12:23:22.632069 (+ 45419us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b18003c32e0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:23:23.730017 (+1097948us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:23.730096 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:23.730167 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.730264 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:23.730422 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23655,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":524200,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":9319,"spinlock_wait_cycles":7993216,"thread_start_us":1097787,"threads_started":1}
I20260709 12:23:23.697956  2139 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:23.780454 31506 raft_consensus.cc:1240] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:23.744165  2072 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.012s	sys 0.034s
I20260709 12:23:23.792472 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 475) took 1497 ms. Trace:
W20260709 12:23:23.795004 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.811575 30750 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.012s	sys 0.015s
W20260709 12:23:23.819818 30750 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.013s	sys 0.016s
W20260709 12:23:23.820478 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 804402us
I20260709 12:23:23.818291 30932 rpcz_store.cc:276] 0709 12:23:22.295069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.300007 (+  4938us) service_pool.cc:224] Handling call
0709 12:23:22.314797 (+ 14790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.332740 (+1017943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.785586 (+452846us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400223dd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:23.792394 (+  6808us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336048000}
W20260709 12:23:23.778514  1875 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.005s	sys 0.011s
I20260709 12:23:23.743242  2114 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 12:23:23.822698 30857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.009s	sys 0.020s
W20260709 12:23:23.828038 30857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.009s	sys 0.020s
I20260709 12:23:23.745390  2093 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:23:23.824589 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:23.742763  2110 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:23.745143  1554 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:23.853614 31474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.011s	sys 0.011s
W20260709 12:23:23.855115 31474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.012s	sys 0.011s
W20260709 12:23:23.859700 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.860782 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:23.853176  2067 consensus_meta.cc:287] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.016s	user 0.010s	sys 0.002s
W20260709 12:23:23.820263  2072 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.012s	sys 0.035s
I20260709 12:23:23.870504 30933 raft_consensus.cc:2468] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:23.850816  2149 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:23.880277 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:23.881193 30825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.017s	sys 0.007s
W20260709 12:23:23.907513 30825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.018s	sys 0.008s
W20260709 12:23:23.907917 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 608965us
W20260709 12:23:23.936976  2163 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:23:23.938776  2150 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:23:23.939431  2148 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:23:23.828408  2113 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:23.940964  2159 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
W20260709 12:23:23.942431  2160 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:23:23.873824  2162 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 12:23:23.945015  2157 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:23:23.859686  1894 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:23:23.948361 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:23.822499  2140 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:23.898427  2149 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:23.959700 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1587) took 1480 ms. Trace:
I20260709 12:23:23.954011 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:23.969230  1921 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:23.972872  1921 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:23.973407 30859 raft_consensus.cc:3055] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:23.973956 30859 raft_consensus.cc:740] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:23.976689  1921 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:23.973323 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:23.982573 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:23.914055  1875 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:23.978266  2147 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:23.960244 30935 rpcz_store.cc:276] 0709 12:23:22.479499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.487205 (+  7706us) service_pool.cc:224] Handling call
0709 12:23:22.487569 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.487973 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.488002 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.488517 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:23:22.636460 (+147943us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b1800087dc0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d914e07 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f96105b920b 00007f96105bed23 00007f96105bf0d1 00007f96109daa0f
0709 12:23:23.731036 (+1094576us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:23.731820 (+   784us) log.cc:844] Serialized 14 byte log entry
0709 12:23:23.732041 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.732135 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:23.947776 (+215641us) raft_consensus.cc:1685] finished
0709 12:23:23.959491 (+ 11715us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:23.959635 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":239,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":148065,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":32990,"spinlock_wait_cycles":6100352,"thread_start_us":1094313,"threads_started":1,"wal-append.queue_time_us":1366849}
I20260709 12:23:24.025161 31506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42838 (request call id 180) took 1540 ms. Trace:
I20260709 12:23:23.881472  2132 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:23:23.935302  2067 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.036489  2110 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:24.039249 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:24.079247 30935 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:24.080334 30933 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:24.025274  2144 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:23.900707  2115 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:24.040717  1875 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:23.952685  2119 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:24.047928  2137 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:23.947224  1554 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:23.953554  2139 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.049844  1245 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:23.915246  2116 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 12:23:23.992386  2149 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:23:24.058594 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 427904us
I20260709 12:23:24.064472 31506 rpcz_store.cc:276] 0709 12:23:22.422229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.422395 (+   166us) service_pool.cc:224] Handling call
0709 12:23:22.422723 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.791620 (+1368897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:23.961863 (+170243us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000136d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:23.962109 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3121849728}
I20260709 12:23:24.073292 30778 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:24.082827 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:24.083709 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:24.086951 30934 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:23:24.073251 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 305713us
W20260709 12:23:24.258292 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.251197 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.232960 30852 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:24.360865 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:24.361779 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.362236 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:24.249428 30900 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.011s	sys 0.011s
W20260709 12:23:24.235697 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.476405 30900 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.011s	sys 0.015s
W20260709 12:23:24.377705 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.477608 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.477597 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 840793us
I20260709 12:23:24.306118 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:24.276119  2118 consensus_meta.cc:287] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.002s
I20260709 12:23:24.480482 30935 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:24.086205  2144 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:24.398300  2174 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:24.413048  2167 log.cc:927] Time spent T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:23:24.413547 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:24.488590 30853 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:24.199482  2115 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.495455 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1725) took 1439 ms. Trace:
I20260709 12:23:24.502051  1763 consensus_queue.cc:1048] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:24.495872 30779 rpcz_store.cc:276] 0709 12:23:23.055614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.055732 (+   118us) service_pool.cc:224] Handling call
0709 12:23:23.056036 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:23.729434 (+673398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:23.729471 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:23.737404 (+  7933us) log.cc:844] Serialized 26 byte log entry
0709 12:23:24.250258 (+512854us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:24.250309 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.250415 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:24.495233 (+244818us) raft_consensus.cc:1685] finished
0709 12:23:24.495252 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.495388 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151297,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":39421,"thread_start_us":1115386,"threads_started":2,"wal-append.queue_time_us":746562}
I20260709 12:23:24.386809  2137 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:24.107226 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.105129 30926 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:24.108736 30929 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:24.107864 30927 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:24.519951 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1694) took 1698 ms. Trace:
I20260709 12:23:24.160339  1875 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.470844 30933 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
W20260709 12:23:24.472939 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 106844us
I20260709 12:23:24.088964  2151 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:23:24.249868 30826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.005s	sys 0.017s
I20260709 12:23:24.218020 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:24.544260 30826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.009s	sys 0.020s
W20260709 12:23:24.544680 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 912793us
I20260709 12:23:24.484184 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:24.486405 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1585) took 2011 ms. Trace:
I20260709 12:23:24.545439 30826 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:24.546159 30931 rpcz_store.cc:276] 0709 12:23:22.474533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.474748 (+   215us) service_pool.cc:224] Handling call
0709 12:23:22.475046 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.327314 (+852268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.486138 (+1158824us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54000b7a54. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:24.486344 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958495104}
I20260709 12:23:24.089221  2067 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.494195  2174 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.509264 30853 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:24.496896 31477 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:24.486845  2144 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:24.551940 31510 raft_consensus.cc:2368] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11.
I20260709 12:23:24.488524  1245 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.495333  2132 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:24.483597  2118 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.520239  2115 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.520481  2076 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
W20260709 12:23:24.671372 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 174548us
I20260709 12:23:24.632907 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:24.583132 30899 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:24.564344 30900 connection.cc:256] RPC call timeout handler was delayed by -2.1003521249999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 12:23:24.674024 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 166772us
I20260709 12:23:24.592593 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:24.610881 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 65533.9us
W20260709 12:23:24.678753 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 95710.8us
I20260709 12:23:24.526049  2166 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:24.678216 30900 connection.cc:256] RPC call timeout handler was delayed by -1.9948179499997423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31930000000000003s for a response
W20260709 12:23:24.713903 30900 connection.cc:256] RPC call timeout handler was delayed by -1.9185521250001329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 12:23:24.679137 30826 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:24.714325 30900 connection.cc:256] RPC call timeout handler was delayed by -1.8411521250000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
W20260709 12:23:24.715003 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.668844  2182 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:23:24.529160  2133 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.193s
I20260709 12:23:24.562917  1929 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:24.738242 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 58589us
I20260709 12:23:24.744480 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:24.668258 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:24.719002  1245 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.745782  2164 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:24.736968  2178 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:24.721406  2119 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:24.724237  2166 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.748719  2183 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:24.749955  2139 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:24.750679  2116 raft_consensus.cc:2804] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:24.745464  1765 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:23:24.582121  2151 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:24.751492  1929 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.671646  2175 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:24.716115  1554 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:24.716741  2096 raft_consensus.cc:2804] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:24.528641  2137 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.553299  2147 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.203s
I20260709 12:23:24.631754  2109 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:24.772146  2119 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:24.753948  2113 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:23:24.773185  2116 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:24.760176  2132 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.816773 30859 consensus_queue.cc:260] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.846553 30859 raft_consensus.cc:3060] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:24.798998  1554 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:24.801276  2194 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:24.850579 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 171522us
I20260709 12:23:24.807444  1894 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:24.769934  2178 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.816309  2096 raft_consensus.cc:697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:24.871338 30932 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:24.851716  1554 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:24.841993  2116 raft_consensus.cc:3060] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:24.885584 30826 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.899726 30826 connection.cc:256] RPC call timeout handler was delayed by -1.1003327700000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:23:24.900357 30826 connection.cc:256] RPC call timeout handler was delayed by -1.0904327700000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 12:23:24.901938 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.815145  2109 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.903564  2072 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.904312  2072 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.905525  1921 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:24.901836 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:24.904742  2109 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.907953  2109 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.908537  2109 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.906844  1921 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:24.886721 30900 connection.cc:256] RPC call timeout handler was delayed by -1.7079521250002472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 12:23:24.911073  2109 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.912375  2109 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:24.910897 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:24.916427 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 525) took 1175 ms. Trace:
I20260709 12:23:24.859754 30853 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:23:24.928148 30897 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:24.911294 30900 connection.cc:256] RPC call timeout handler was delayed by -1.6494521250001526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.215s for a response
W20260709 12:23:24.931325 30900 connection.cc:256] RPC call timeout handler was delayed by -1.5774521250000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
I20260709 12:23:24.934681 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:24.933655 30824 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.935395 31510 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:24.937651 31506 raft_consensus.cc:1240] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEADER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:23:24.932015 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 219113us
I20260709 12:23:24.933059 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:24.880589  2067 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:24.944613  2067 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.945309  2067 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.917099 30859 rpcz_store.cc:276] 0709 12:23:23.740724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.740978 (+   254us) service_pool.cc:224] Handling call
0709 12:23:23.741268 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:23.973300 (+232032us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b5400217da0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610996dc0 00007f9610a211c0 00007f9610a22231 00007f9610a1ed8f 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c
0709 12:23:24.816309 (+843009us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4c004a06c0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960eceba20 00007f960ecfca29 00007f960ecc2644 00007f960ece9f2d 00007f960ece9b93 00007f9610a1a18b 00007f9610a1acb5 00007f9610a15f30 00007f9610a177de 00007f9610a21b49 00007f9610a22416
0709 12:23:24.915843 (+ 99534us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:24.915888 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.916043 (+   155us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:24.916112 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.916196 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.916348 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":148,"spinlock_wait_cycles":252438656}
I20260709 12:23:24.877532  1875 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:23:24.920341  2175 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:24.920001  2183 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:24.938482  2187 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:23:24.917670  2109 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:24.932207  2059 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:24.887113  1894 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.897868  2194 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.972040  2072 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.982707  2132 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:24.987490  2202 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.988318  2202 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.985520  2194 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:24.992244  2192 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 12:23:24.994494  2196 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:23:24.994709 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:24.995102  1245 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.995224  2067 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:24.995563 30930 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:24.996033  2067 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:24.996518  2067 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.996821 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:25.000952 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.962495  2118 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:25.001510 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:25.009196 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:25.020809 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.020852 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.022266 30930 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 7.
I20260709 12:23:25.023545 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.024333 30930 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:25.021708 30933 raft_consensus.cc:2393] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:25.025484 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.027556 30930 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:25.029371 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.030321 30930 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:24.975600 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:25.043913 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.046900 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.047788 30930 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 9.
I20260709 12:23:25.051764 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:25.058655 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:25.059448 30930 raft_consensus.cc:1813] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Handling vote request from an unknown peer 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:25.021704  2132 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:25.064390 30930 raft_consensus.cc:2410] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:24.932585  2151 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:24.973310  2096 consensus_queue.cc:237] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:24.975952  2059 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.004664  2194 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:23:25.045012  1921 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.963745  2175 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:25.048730  1765 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:25.077983 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.083235  2059 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:25.083751 30898 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:25.086499  2197 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:23:25.087029 30929 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:25.049067  2200 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:25.052302  2174 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:25.119277 30900 connection.cc:256] RPC call timeout handler was delayed by -1.1171837070000947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:23:25.119777 30900 connection.cc:256] RPC call timeout handler was delayed by -1.0433837069999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 12:23:25.065982  2189 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:23:25.060974  2139 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:25.092993 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 151625us
I20260709 12:23:25.078461  2166 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:24.997596  2183 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:25.114542 30930 raft_consensus.cc:2393] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 11: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:25.079457  1929 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:25.097246 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 142047us
I20260709 12:23:25.146548 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:25.092204  2067 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:25.096046  2137 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.096339  2132 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:25.102946  2113 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:25.147811 30899 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:25.119935  1765 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:25.155151 30931 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.005s
I20260709 12:23:25.164410 30826 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:25.234952 30931 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.006s	sys 0.006s
I20260709 12:23:25.142427  2164 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:25.136719  2193 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:23:25.167333  2118 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:25.237022  1765 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:25.229857 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1895) took 1086 ms. Trace:
I20260709 12:23:25.151559  2059 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:25.213985 30900 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:25.237454  2132 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.232815  1875 consensus_queue.cc:1243] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer 7857bffc34ce4e1db3617488701b9810 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:25.154682 30930 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:25.246577 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1806) took 1015 ms. Trace:
I20260709 12:23:25.196657  2178 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.247864 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1892) took 1161 ms. Trace:
I20260709 12:23:25.238461 30935 rpcz_store.cc:276] 0709 12:23:24.143298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.501924 (+358626us) service_pool.cc:224] Handling call
0709 12:23:24.504588 (+  2664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.504820 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:24.814462 (+309642us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.229433 (+414971us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.229492 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:25.229557 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.229630 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.229782 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38966,"prepare.queue_time_us":457224,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":121795,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":4343,"spinlock_wait_cycles":6635776,"thread_start_us":637068,"threads_started":3,"wal-append.queue_time_us":328585}
W20260709 12:23:25.249931 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 102194us
I20260709 12:23:25.242885  2164 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:25.258189 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 44303.1us
I20260709 12:23:25.269330 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.258471 30854 rpcz_store.cc:276] 0709 12:23:24.230852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.231042 (+   190us) service_pool.cc:224] Handling call
0709 12:23:24.231543 (+   501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:24.366404 (+134861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.471455 (+105051us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:24.472054 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 12:23:24.700366 (+228312us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:24.736649 (+ 36283us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.225931 (+489282us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.245991 (+ 20060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.246132 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.246207 (+    75us) raft_consensus.cc:1685] finished
0709 12:23:25.246252 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.246473 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60060,"prepare.queue_time_us":175943,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":295028,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":24545,"thread_start_us":621999,"threads_started":3,"wal-append.queue_time_us":314327}
I20260709 12:23:25.142381  2147 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:25.262036  2113 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.262797 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:25.194625  2149 consensus_meta.cc:287] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.807s	user 0.006s	sys 0.008s
I20260709 12:23:25.282353 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1896) took 1124 ms. Trace:
W20260709 12:23:25.282972 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 118644us
I20260709 12:23:25.259512  2059 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:25.243562  2202 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:25.157904  2207 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:25.140699  2139 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.292902 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1805) took 1062 ms. Trace:
I20260709 12:23:25.266348 30928 rpcz_store.cc:276] 0709 12:23:24.086783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.087442 (+   659us) service_pool.cc:224] Handling call
0709 12:23:24.105705 (+ 18263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:24.106143 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.106169 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:24.106782 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:23:24.551300 (+444518us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:24.551343 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.551414 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.247614 (+696200us) raft_consensus.cc:1685] finished
0709 12:23:25.247637 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.247786 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":192345,"threads_started":1,"wal-append.queue_time_us":561680}
I20260709 12:23:25.280810 30935 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:25.295082 30930 raft_consensus.cc:2468] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:25.264438  2175 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.264642  2194 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:25.284188  2137 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:25.269608  2067 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.306257  2234 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:23:25.342133 30928 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:25.333549 30858 rpcz_store.cc:276] 0709 12:23:24.230480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.230602 (+   122us) service_pool.cc:224] Handling call
0709 12:23:24.273744 (+ 43142us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:24.528992 (+255248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.543693 (+ 14701us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:24.544833 (+  1140us) log.cc:844] Serialized 78 byte log entry
0709 12:23:24.767912 (+223079us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:24.940191 (+172279us) log.cc:844] Serialized 14 byte log entry
0709 12:23:24.940423 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.946791 (+  6368us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.292647 (+345856us) raft_consensus.cc:1685] finished
0709 12:23:25.292668 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.292835 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274161,"prepare.queue_time_us":291726,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":313678,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":89410,"thread_start_us":354849,"threads_started":2,"wal-append.queue_time_us":305650}
I20260709 12:23:25.345667 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1735) took 1371 ms. Trace:
I20260709 12:23:25.347198  2139 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:25.348102  2214 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:23:25.348528  2158 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:25.291975  2164 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.349548 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:25.351276  2210 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:23:25.351922  2201 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:25.288203  2200 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:25.353973  2207 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:25.355579  2213 log.cc:927] Time spent T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:23:25.263155  2204 consensus_queue.cc:1059] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
W20260709 12:23:25.358590 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 61921us
I20260709 12:23:25.438284 30826 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:24.524375 30857 rpcz_store.cc:276] 0709 12:23:22.799780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:22.800001 (+   221us) service_pool.cc:224] Handling call
0709 12:23:22.800428 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:22.800972 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:22.801021 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:22.890272 (+ 89251us) log.cc:844] Serialized 26 byte log entry
0709 12:23:23.828506 (+938234us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:24.281893 (+453387us) log.cc:844] Serialized 14 byte log entry
0709 12:23:24.497695 (+215802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.497789 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:24.497828 (+    39us) raft_consensus.cc:1685] finished
0709 12:23:24.497839 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:24.498003 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":205904,"prepare.queue_time_us":109904,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":250380,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":42118,"thread_start_us":1256411,"threads_started":2,"wal-append.queue_time_us":1075687}
I20260709 12:23:25.246852  2151 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:23:25.396047 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:25.302908  2212 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:23:25.305940  1894 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.449481  2067 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:25.401008 30856 raft_consensus.cc:2468] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 6.
I20260709 12:23:25.390679 30782 rpcz_store.cc:276] 0709 12:23:23.976059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:23.976600 (+   541us) service_pool.cc:224] Handling call
0709 12:23:23.976915 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.094054 (+117139us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:24.472343 (+378289us) log.cc:844] Serialized 14 byte log entry
0709 12:23:24.720978 (+248635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:24.721056 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:24.721127 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.343375 (+622248us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18003804a0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:25.345403 (+  2028us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54003db654. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:25.345452 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.345594 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47780,"prepare.queue_time_us":627783,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":4926,"raft.queue_time_us":59642,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":143,"spinlock_wait_cycles":274077184,"thread_start_us":520632,"threads_started":2,"wal-append.queue_time_us":322937}
I20260709 12:23:25.324230  2149 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:25.407070  2199 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.428s	user 0.004s	sys 0.000s
I20260709 12:23:25.453542 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1807) took 1179 ms. Trace:
I20260709 12:23:25.409076 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1811) took 1054 ms. Trace:
I20260709 12:23:25.411994 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:25.413522  2215 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:23:25.427502  2207 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:25.402565  2147 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.397852  2194 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:25.467603  2149 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.468190 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1817) took 1111 ms. Trace:
I20260709 12:23:25.469092 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1809) took 1137 ms. Trace:
I20260709 12:23:25.469190  2194 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.469610 30855 rpcz_store.cc:276] 0709 12:23:24.331509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.331708 (+   199us) service_pool.cc:224] Handling call
0709 12:23:24.387529 (+ 55821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:24.526298 (+138769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.526327 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:24.563188 (+ 36861us) log.cc:844] Serialized 26 byte log entry
0709 12:23:24.748155 (+184967us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b48000ce7d8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:23:24.877071 (+128916us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:24.877126 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:24.877215 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.406304 (+529089us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:25.468894 (+ 62590us) raft_consensus.cc:1685] finished
0709 12:23:25.468915 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.469030 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54863,"raft.queue_time_us":78954,"raft.run_cpu_time_us":2388,"raft.run_wall_time_us":194897,"spinlock_wait_cycles":86561280,"thread_start_us":205655,"threads_started":1,"wal-append.queue_time_us":327040}
I20260709 12:23:25.471359  1715 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:25.433308  2234 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:25.507709 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:25.433707 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1818) took 1077 ms. Trace:
I20260709 12:23:25.433975  2164 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:25.436163  1554 consensus_meta.cc:287] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.001s
I20260709 12:23:25.371096  2137 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:25.446456 30857 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:25.531796 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1819) took 1174 ms. Trace:
I20260709 12:23:25.449443  2225 consensus_queue.cc:1059] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:25.407650  2201 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.457340 30928 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:25.452299 30927 raft_consensus.cc:1275] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:25.454344 30851 rpcz_store.cc:276] 0709 12:23:24.354616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.682682 (+328066us) service_pool.cc:224] Handling call
0709 12:23:24.753845 (+ 71163us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:24.754239 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:24.775435 (+ 21196us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.151441 (+376006us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:25.196542 (+ 45101us) log.cc:844] Serialized 52 byte log entry
0709 12:23:25.196735 (+   193us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:25.196779 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.196865 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.408144 (+211279us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18000bdca0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:25.408722 (+   578us) raft_consensus.cc:1685] finished
0709 12:23:25.408839 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.408993 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43339,"prepare.queue_time_us":44660,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":144021,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":14772,"spinlock_wait_cycles":36524416,"thread_start_us":274767,"threads_started":2,"wal-append.queue_time_us":276618}
I20260709 12:23:25.454058 30856 rpcz_store.cc:276] 0709 12:23:24.273772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.274074 (+   302us) service_pool.cc:224] Handling call
0709 12:23:25.349371 (+1075297us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:23:25.453468 (+104097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5799296}
I20260709 12:23:25.463907 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1810) took 1132 ms. Trace:
W20260709 12:23:25.432767  2119 consensus_meta.cc:287] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 12:23:25.471889 30855 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:25.468660 30858 rpcz_store.cc:276] 0709 12:23:24.356406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.398038 (+1041632us) service_pool.cc:224] Handling call
0709 12:23:25.467615 (+ 69577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.467822 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.467851 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.467900 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:25.467939 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.467997 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.468126 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.560043 30852 rpcz_store.cc:276] 0709 12:23:24.331860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.493425 (+161565us) service_pool.cc:224] Handling call
0709 12:23:24.493868 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:24.798222 (+304354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:24.798252 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:24.821704 (+ 23452us) log.cc:844] Serialized 26 byte log entry
0709 12:23:25.001710 (+180006us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:25.001748 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.429677 (+427929us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400437bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:25.429739 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:25.456494 (+ 26755us) raft_consensus.cc:1685] finished
0709 12:23:25.456523 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.463823 (+  7300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5848,"raft.queue_time_us":27089,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":24167,"spinlock_wait_cycles":654942464,"thread_start_us":119826,"threads_started":1,"wal-append.queue_time_us":265613}
I20260709 12:23:25.473820 30826 leader_election.cc:400] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 11. Current term is 12.
I20260709 12:23:25.568102 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1820) took 1210 ms. Trace:
I20260709 12:23:25.568348 30826 leader_election.cc:403] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:23:25.472683 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 76724.2us
I20260709 12:23:25.508980 30853 rpcz_store.cc:276] 0709 12:23:24.356694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.432796 (+1076102us) service_pool.cc:224] Handling call
0709 12:23:25.433136 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.433372 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.433398 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.433434 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:25.433471 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.433523 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.433624 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.568507 30855 rpcz_store.cc:276] 0709 12:23:24.357259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.471262 (+1114003us) service_pool.cc:224] Handling call
0709 12:23:25.471557 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.567823 (+ 96266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.568046 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.511524 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:25.532272 30857 rpcz_store.cc:276] 0709 12:23:24.356977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.439602 (+1082625us) service_pool.cc:224] Handling call
0709 12:23:25.440035 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.531440 (+ 91405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.531708 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:25.534904  2183 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:25.535123  2243 log.cc:927] Time spent T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:25.507097  2149 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:25.535701  2137 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:25.477722  2200 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:25.536860  2059 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:25.538465  2113 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:25.539343 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:25.597574 31508 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 7: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:23:25.539717 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:23:25.446545  2144 consensus_meta.cc:287] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.002s
I20260709 12:23:25.572068 30853 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:25.507174  2194 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:25.477064  1715 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:25.575680 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:25.576848 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.613210 30926 raft_consensus.cc:2468] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:25.507352  2207 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:25.509366  1875 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:25.585362 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:25.587378  2132 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:25.588739 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 527) took 1111 ms. Trace:
I20260709 12:23:25.594934 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:25.595952 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 122378us
I20260709 12:23:25.601577 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1823) took 1111 ms. Trace:
I20260709 12:23:25.615759 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:25.616884  2241 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:25.618866  2230 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:23:25.405055  2158 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:25.620040  1715 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.621107  2194 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.621851  2149 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.622196  2144 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:25.622867 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:25.553926  1554 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.572451  2119 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.566943  2164 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:25.540225  2234 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:25.654462 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.204723 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.205544 30776 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:26.205600 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:25.710085 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.208061 30785 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:23:25.841192 30859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.035s	sys 0.064s
W20260709 12:23:26.209236 30859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.040s	sys 0.072s
W20260709 12:23:26.170245 30930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.009s
W20260709 12:23:26.210081 30930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.009s
W20260709 12:23:26.210714 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 635078us
I20260709 12:23:26.211621 30900 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.211694 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 528) took 1729 ms. Trace:
I20260709 12:23:26.211961 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.207099 30858 rpcz_store.cc:276] 0709 12:23:24.477237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.568063 (+1090826us) service_pool.cc:224] Handling call
0709 12:23:25.588213 (+ 20150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.588398 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.588423 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.588463 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:25.588503 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.588556 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.588676 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.214403 30928 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 7.
I20260709 12:23:26.212751 30853 rpcz_store.cc:276] 0709 12:23:24.490253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.569186 (+1078933us) service_pool.cc:224] Handling call
0709 12:23:25.569489 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:25.601305 (+ 31816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.601511 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.212395 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.217126 30777 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:26.222018 30900 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:26.212471 30852 rpcz_store.cc:276] 0709 12:23:24.482715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.568390 (+1085675us) service_pool.cc:224] Handling call
0709 12:23:26.211197 (+642807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.211376 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.211402 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.211443 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:26.211475 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.211524 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.211624 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.244860 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.227329 30853 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 531) took 1733 ms. Trace:
I20260709 12:23:26.250324 30853 rpcz_store.cc:276] 0709 12:23:24.494150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.226530 (+1732380us) service_pool.cc:224] Handling call
0709 12:23:26.226834 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.227004 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.227028 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.227069 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:26.227101 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.227153 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.227259 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:26.251715 30933 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.000s	sys 0.013s
W20260709 12:23:26.252151 30933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.000s	sys 0.013s
I20260709 12:23:26.254657 30776 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 14: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:26.271842 30780 raft_consensus.cc:2393] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 11: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:26.026330  2200 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:25.727957  2222 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:26.273146 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:25.625701  2183 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 11. Current term is 12.
I20260709 12:23:26.159232  2113 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.275267 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.369433 30777 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:25.818046  2147 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.003060  2249 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:26.245615  2059 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:26.234961  2139 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.010s	sys 0.011s
W20260709 12:23:26.271538  2140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.007s	sys 0.008s
I20260709 12:23:26.258529  1715 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:26.251410  2106 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:26.255993  2174 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:26.385581  2174 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:26.388566  2174 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:26.226264  2132 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:25.705240  2207 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.282238  2222 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:26.390079  2222 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.391498  2207 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.248868  1875 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:26.373095 30932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.047s	sys 0.093s
W20260709 12:23:26.398010 30932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.047s	sys 0.094s
I20260709 12:23:26.398757 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 532) took 1904 ms. Trace:
I20260709 12:23:26.399186 30858 rpcz_store.cc:276] 0709 12:23:24.494427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.253196 (+1758769us) service_pool.cc:224] Handling call
0709 12:23:26.259204 (+  6008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.396950 (+137746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.396980 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.397023 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.397052 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.398498 (+  1446us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540003e8d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:26.398547 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.398694 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316218240}
W20260709 12:23:26.376443 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 103395us
I20260709 12:23:26.400792 30900 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.371179  2249 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.240813  2241 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:26.382668  2140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.008s	sys 0.008s
I20260709 12:23:26.402344 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:26.375769 30750 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.000s	sys 0.008s
W20260709 12:23:26.409648 30750 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.000s	sys 0.009s
W20260709 12:23:26.410035 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 770191us
W20260709 12:23:26.395000 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.377884  2139 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.016s	sys 0.016s
I20260709 12:23:26.305207  2200 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:26.403411  2244 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.439s	user 0.000s	sys 0.002s
I20260709 12:23:26.375360  2059 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:26.377025  2114 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.382078  2218 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:26.369194  2113 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.442993 30858 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:26.446146 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1825) took 1939 ms. Trace:
I20260709 12:23:26.446646 30858 rpcz_store.cc:276] 0709 12:23:24.506044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.425437 (+1919393us) service_pool.cc:224] Handling call
0709 12:23:26.436693 (+ 11256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.445101 (+  8408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.445378 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.449014 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 533) took 1728 ms. Trace:
I20260709 12:23:26.450201 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1816) took 2094 ms. Trace:
I20260709 12:23:26.452044 30858 rpcz_store.cc:276] 0709 12:23:24.720325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.447718 (+1727393us) service_pool.cc:224] Handling call
0709 12:23:26.448519 (+   801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.448702 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.448724 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.448765 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:26.448795 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.448843 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.448961 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.451196 30854 rpcz_store.cc:276] 0709 12:23:24.356104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.290156 (+934052us) service_pool.cc:224] Handling call
0709 12:23:25.350070 (+ 59914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.350401 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.350441 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.351085 (+   644us) log.cc:844] Serialized 26 byte log entry
0709 12:23:25.463197 (+112112us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:25.463301 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.464723 (+  1422us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.450011 (+985288us) raft_consensus.cc:1685] finished
0709 12:23:26.450030 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.450148 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":111654,"threads_started":1,"wal-append.queue_time_us":245657}
I20260709 12:23:26.442380  2174 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:26.459049  2174 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:26.461474  2174 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:26.467100 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 64835.7us
I20260709 12:23:26.467980 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:26.460357 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1826) took 1696 ms. Trace:
W20260709 12:23:26.460553  2116 consensus_meta.cc:287] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 1.521s	user 0.013s	sys 0.000s
I20260709 12:23:26.470239  2116 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.469990 30858 rpcz_store.cc:276] 0709 12:23:24.764312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.459488 (+1695176us) service_pool.cc:224] Handling call
0709 12:23:26.459827 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.460003 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.460027 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.460069 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:26.460097 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.460151 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.460278 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:26.475494 31476 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.234.65:46329 timed out after 1.723s (SENT) [suppressed 13 similar messages]
I20260709 12:23:26.440531  2059 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.442169  2106 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.445717  2140 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.485064 30854 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:26.486495 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1827) took 1718 ms. Trace:
I20260709 12:23:26.487005 30854 rpcz_store.cc:276] 0709 12:23:24.767619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.476745 (+1709126us) service_pool.cc:224] Handling call
0709 12:23:26.484591 (+  7846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.485583 (+   992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.486405 (+   822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.490693 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:26.494024 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 288504us
I20260709 12:23:26.480504  2218 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:26.498353 30854 pending_rounds.cc:85] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 7
I20260709 12:23:26.504980 30854 pending_rounds.cc:107] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:23:26.505380 30854 raft_consensus.cc:2889] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:26.482484  1554 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:26.484337  1875 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:26.550983 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 49165.9us
I20260709 12:23:26.508278  2106 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.553745 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.563274 30826 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:26.564970 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:26.566501 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 91041.4us
I20260709 12:23:26.567662 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.489840  2140 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:26.539255  2158 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:26.577289 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.551580  2164 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.581784 30826 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.574698  2204 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:26.577436  2250 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:23:26.569664  1875 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:26.596549  1875 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:26.570061  2234 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.574476  2114 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:26.598286  2114 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:26.598919  2114 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.581830  2183 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:26.580232  2225 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:26.602448  2252 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:23:26.594133  2204 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.631214 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1814) took 2275 ms. Trace:
I20260709 12:23:26.607227  2183 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:26.632062  2183 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.602208  2241 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.631743 30860 rpcz_store.cc:276] 0709 12:23:24.355479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.277602 (+922123us) service_pool.cc:224] Handling call
0709 12:23:25.294753 (+ 17151us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:25.358554 (+ 63801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.358599 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:25.397677 (+ 39078us) log.cc:844] Serialized 52 byte log entry
0709 12:23:25.610518 (+212841us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:25.610581 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.610708 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.630922 (+1020214us) raft_consensus.cc:1685] finished
0709 12:23:26.630951 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.631141 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16286,"raft.queue_time_us":63544,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":24475,"thread_start_us":158320,"threads_started":1,"wal-append.queue_time_us":837775}
W20260709 12:23:26.618152  2255 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:23:26.641474  2109 raft_consensus.cc:3055] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:26.641976  2109 raft_consensus.cc:740] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:26.642207  2140 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:26.642912  2109 consensus_queue.cc:260] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:26.656076  2109 raft_consensus.cc:3060] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.648424  2113 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.621214  2249 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.602671  2261 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:26.657989 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1902) took 1650 ms. Trace:
I20260709 12:23:26.633890  2204 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.658402 30930 rpcz_store.cc:276] 0709 12:23:25.007572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.558402 (+550830us) service_pool.cc:224] Handling call
0709 12:23:25.558798 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.559257 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.559290 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.574234 (+ 14944us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.210758 (+636524us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:26.210799 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.210866 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.657749 (+446883us) raft_consensus.cc:1685] finished
0709 12:23:26.657792 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.657928 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5290,"raft.queue_time_us":96,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9152,"thread_start_us":597990,"threads_started":1,"wal-append.queue_time_us":748220}
I20260709 12:23:26.660445 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.660825  2119 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.609900  2225 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.663283  2225 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.663370  2201 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:26.664000 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 535) took 1263 ms. Trace:
I20260709 12:23:26.664386 30854 rpcz_store.cc:276] 0709 12:23:25.400917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.488149 (+1087232us) service_pool.cc:224] Handling call
0709 12:23:26.498116 (+  9967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.506107 (+  7991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.506158 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.506715 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.583914 (+ 77199us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:26.583954 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.584024 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.663767 (+ 79743us) raft_consensus.cc:1685] finished
0709 12:23:26.663788 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.663938 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":34004,"threads_started":1,"wal-append.queue_time_us":97178}
I20260709 12:23:26.655283 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1904) took 1634 ms. Trace:
I20260709 12:23:26.603307  2222 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.661648 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.666213 30928 rpcz_store.cc:276] 0709 12:23:25.021211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.247182 (+1225971us) service_pool.cc:224] Handling call
0709 12:23:26.247517 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.247888 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.247917 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.259276 (+ 11359us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.497107 (+237831us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:26.497147 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.497216 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.655025 (+157809us) raft_consensus.cc:1685] finished
0709 12:23:26.655047 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.655203 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11579,"thread_start_us":178961,"threads_started":1,"wal-append.queue_time_us":309290}
I20260709 12:23:26.668236 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.669271 30928 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 11: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:26.641507 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 536) took 1194 ms. Trace:
I20260709 12:23:26.674571 30860 rpcz_store.cc:276] 0709 12:23:25.446983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.640535 (+1193552us) service_pool.cc:224] Handling call
0709 12:23:26.640995 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.641174 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.641197 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.641235 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.641266 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.641322 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.641452 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:26.681702 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 191122us
I20260709 12:23:26.688057 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:26.688776 30930 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:26.688663 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.690990 30779 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:26.694561 30779 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54648 (request call id 1871) took 1083 ms. Trace:
W20260709 12:23:26.652738  2137 consensus_meta.cc:287] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 1.039s	user 0.010s	sys 0.000s
I20260709 12:23:26.694918 30779 rpcz_store.cc:276] 0709 12:23:25.608962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.610925 (+  1963us) service_pool.cc:224] Handling call
0709 12:23:26.688515 (+1077590us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b58000d2098. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159e50a0 00007f96159e4984 00007f960ef5f6d4 00007f960ef5f662
0709 12:23:26.692244 (+  3729us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7933312}
I20260709 12:23:26.694046 30858 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 534) took 1703 ms. Trace:
I20260709 12:23:26.697273 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1894) took 2596 ms. Trace:
W20260709 12:23:26.698352 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 102187us
I20260709 12:23:26.653120  2200 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.696978 30858 rpcz_store.cc:276] 0709 12:23:24.990375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.473285 (+1482910us) service_pool.cc:224] Handling call
0709 12:23:26.473637 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.473899 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:26.604549 (+130650us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.693600 (+ 89051us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.693720 (+   120us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:26.693788 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.693853 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.693983 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109594,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":1563,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":9633,"thread_start_us":207199,"threads_started":2}
I20260709 12:23:26.709596  1245 consensus_queue.cc:1048] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:26.710886 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.711817 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 491) took 1308 ms. Trace:
I20260709 12:23:26.712605 30929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1899) took 1947 ms. Trace:
I20260709 12:23:26.706331 30934 rpcz_store.cc:276] 0709 12:23:24.101384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.480435 (+379051us) service_pool.cc:224] Handling call
0709 12:23:24.496509 (+ 16074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.496788 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:24.814076 (+317288us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.645228 (+1831152us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b1800441520. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f96144173c7 00007f9610a299a7 00007f9610a390bf 00007f9610a39038
0709 12:23:26.645452 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.696615 (+ 51163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.696701 (+    86us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:26.696785 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.696970 (+   185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.697145 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1699851,"prepare.queue_time_us":2100367,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":149833,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":23348,"spinlock_wait_cycles":7411456,"thread_start_us":448932,"threads_started":3,"wal-append.queue_time_us":276264,"wal-append.run_cpu_time_us":2535,"wal-append.run_wall_time_us":1326803}
I20260709 12:23:26.647523  2174 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.716033 30858 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:26.712383 30935 rpcz_store.cc:276] 0709 12:23:25.403221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.710935 (+1307714us) service_pool.cc:224] Handling call
0709 12:23:26.711243 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.711427 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.711462 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.711508 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:26.711542 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.711603 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.711739 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.713037 30929 rpcz_store.cc:276] 0709 12:23:24.765648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.136429 (+370781us) service_pool.cc:224] Handling call
0709 12:23:25.156893 (+ 20464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:25.195100 (+ 38207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.195137 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:25.212521 (+ 17384us) log.cc:844] Serialized 52 byte log entry
0709 12:23:25.399072 (+186551us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:26.649668 (+1250596us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.705791 (+ 56123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.705920 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.712419 (+  6499us) raft_consensus.cc:1685] finished
0709 12:23:26.712435 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.712550 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1249441,"prepare.queue_time_us":1250123,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":31275,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":2511,"thread_start_us":173532,"threads_started":2,"wal-append.queue_time_us":221880,"wal-append.run_cpu_time_us":2161,"wal-append.run_wall_time_us":1002184}
I20260709 12:23:26.704661  2137 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.730297 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 492) took 1326 ms. Trace:
I20260709 12:23:26.730800 30935 rpcz_store.cc:276] 0709 12:23:25.404124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.727074 (+1322950us) service_pool.cc:224] Handling call
0709 12:23:26.727401 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.727620 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.729949 (+  2329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.730006 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.730052 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.730112 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.730238 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.733752 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1903) took 1716 ms. Trace:
I20260709 12:23:26.735690 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.736389 30852 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:26.735812 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.736958 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.736970 30854 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:26.737751 30860 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
W20260709 12:23:26.737805 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 54732us
I20260709 12:23:26.734242 30927 rpcz_store.cc:276] 0709 12:23:25.017298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.561697 (+544399us) service_pool.cc:224] Handling call
0709 12:23:25.570597 (+  8900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.586991 (+ 16394us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:23:26.650923 (+1063932us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.715107 (+ 64184us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.715587 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.715708 (+   121us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:26.715741 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.715807 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.733549 (+ 17742us) raft_consensus.cc:1685] finished
0709 12:23:26.733569 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.733692 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1066807,"prepare.queue_time_us":1064198,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":19060,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":127,"thread_start_us":60521,"threads_started":1,"wal-append.queue_time_us":76912}
I20260709 12:23:26.740094 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:26.740662 30926 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:26.741412 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 495) took 1249 ms. Trace:
I20260709 12:23:26.741852 30927 rpcz_store.cc:276] 0709 12:23:25.491775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.740410 (+1248635us) service_pool.cc:224] Handling call
0709 12:23:26.740707 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.740879 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.740910 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.741170 (+   260us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:26.741207 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.741262 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.741360 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.741959 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.744907  2201 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:26.745316  2201 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:26.745450 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 494) took 1270 ms. Trace:
I20260709 12:23:26.745719  2201 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:26.745842  2132 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:26.743193  2236 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 1.332s	user 0.017s	sys 0.011s
I20260709 12:23:26.745903 30934 rpcz_store.cc:276] 0709 12:23:25.475601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.738787 (+1263186us) service_pool.cc:224] Handling call
0709 12:23:26.744957 (+  6170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.745137 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.745165 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.745205 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:26.745243 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.745294 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.745393 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.746862 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.748632 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.729557  2137 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:26.753014 30858 raft_consensus.cc:2410] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:23:26.755534 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:26.756822  2222 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:26.756969 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:26.757899 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.758526 30860 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:26.755729  2174 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:26.759420 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.760443 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.761145 30860 raft_consensus.cc:2410] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:23:26.762439 30825 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:26.762992 30825 connection.cc:256] RPC call timeout handler was delayed by -1.1680936220000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 12:23:26.763337 30825 connection.cc:256] RPC call timeout handler was delayed by -1.1345965499999693s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 12:23:26.763628 30825 connection.cc:256] RPC call timeout handler was delayed by -1.131513878000078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
I20260709 12:23:26.764837 30825 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.767639 30930 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 14.
I20260709 12:23:26.768297  2115 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.778422  2268 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:26.774112  2239 log.cc:927] Time spent T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.731s	user 0.002s	sys 0.000s
I20260709 12:23:26.779673  2225 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.783039  2225 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.777276  2149 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.777946 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.788283 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:26.788965 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1821) took 2431 ms. Trace:
I20260709 12:23:26.776815  2114 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.781281 30825 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.784672 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:26.789352 30851 rpcz_store.cc:276] 0709 12:23:24.357557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.572742 (+1215185us) service_pool.cc:224] Handling call
0709 12:23:26.788169 (+1215427us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:23:26.788351 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.788660 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.788688 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.788725 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:26.788761 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.788814 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.788911 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3280,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":27825408}
I20260709 12:23:26.790881 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 497) took 1250 ms. Trace:
I20260709 12:23:26.793525 30778 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:26.790355 30935 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 13. Current term is 14. Ops: []
W20260709 12:23:26.795341 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.805688  2114 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.774106 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.790982 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:26.806614 30854 raft_consensus.cc:2393] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:26.790508 30782 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:23:26.804292 30930 rpcz_store.cc:276] 0709 12:23:25.540551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.790103 (+1249552us) service_pool.cc:224] Handling call
0709 12:23:26.790385 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.790549 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.790574 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.790615 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.790668 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.790718 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.790823 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.808755 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:26.809238  2194 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:26.797222  2248 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 12:23:26.810009  2268 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:26.811347 30859 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1812) took 2456 ms. Trace:
I20260709 12:23:26.811735 30859 rpcz_store.cc:276] 0709 12:23:24.354940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.949669 (+594729us) service_pool.cc:224] Handling call
0709 12:23:24.950457 (+   788us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:25.105695 (+155238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.105742 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:25.149822 (+ 44080us) log.cc:844] Serialized 52 byte log entry
0709 12:23:26.210064 (+1060242us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.492111 (+282047us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.492420 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.492499 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.796391 (+303892us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:26.810997 (+ 14606us) raft_consensus.cc:1685] finished
0709 12:23:26.811143 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.811285 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":345244,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":93392,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":12948,"spinlock_wait_cycles":16393600,"thread_start_us":1323134,"threads_started":3,"wal-append.queue_time_us":1032570}
I20260709 12:23:26.787472  2183 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.817804 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.818516  2183 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:26.818608 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.819350 30782 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:23:26.802260  2201 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.820539 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.821702  2201 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:25.297050 30931 rpcz_store.cc:276] 0709 12:23:24.158276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.547244 (+388968us) service_pool.cc:224] Handling call
0709 12:23:24.547653 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:24.547925 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:23:25.235581 (+687656us) log.cc:844] Serialized 14 byte log entry
0709 12:23:25.281967 (+ 46386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:25.282059 (+    92us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:25.282110 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:25.282170 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:25.282293 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44007,"raft.queue_time_us":13655,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7414,"thread_start_us":634726,"threads_started":2}
I20260709 12:23:26.827350  2059 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.819380 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.830513 30859 raft_consensus.cc:2368] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:26.832248 30856 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:26.833055 30856 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1822) took 2362 ms. Trace:
I20260709 12:23:26.799093  2224 raft_consensus.cc:3055] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:26.833422 30856 rpcz_store.cc:276] 0709 12:23:24.470767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.560275 (+1089508us) service_pool.cc:224] Handling call
0709 12:23:26.831875 (+1271600us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:23:26.832062 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.832639 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.832991 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25576832}
I20260709 12:23:26.836345 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:26.842813  2221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.434s	user 0.002s	sys 0.010s
I20260709 12:23:26.844393 30856 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:26.829561  2059 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:26.848413 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.835489  2224 raft_consensus.cc:740] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:26.853240 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:26.853587 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.854437 30859 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:26.854991  2114 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:26.857090  2114 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.859297  2114 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:26.859346  2254 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.485s	user 0.004s	sys 0.000s
I20260709 12:23:26.860008 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.855121  2225 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:26.861439  2225 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:26.862864  2253 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.489s	user 0.000s	sys 0.007s
I20260709 12:23:26.863626  2225 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:26.864408  2224 consensus_queue.cc:260] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:26.865168 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:26.865680  2224 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:26.850576  2221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.002s	sys 0.010s
I20260709 12:23:26.870213 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 490) took 1865 ms. Trace:
I20260709 12:23:26.871872 30932 rpcz_store.cc:276] 0709 12:23:25.005073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.470338 (+465265us) service_pool.cc:224] Handling call
0709 12:23:25.470684 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.470895 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.470919 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.471399 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.398542 (+927143us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.398597 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.398690 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:26.862241 (+463551us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:26.869921 (+  7680us) raft_consensus.cc:1685] finished
0709 12:23:26.869945 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.870151 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24875904,"thread_start_us":926734,"threads_started":1,"wal-append.queue_time_us":901849}
I20260709 12:23:26.873579 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.874409 30932 raft_consensus.cc:2410] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:23:26.838754  2204 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:26.871152 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1868) took 1275 ms. Trace:
I20260709 12:23:26.879174 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.871029 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.891343 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.892284  2204 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:26.892453 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 147962us
I20260709 12:23:26.892709 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:26.893414 30932 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.893831  2067 consensus_queue.cc:1048] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:26.896322 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.896522 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 529) took 2403 ms. Trace:
I20260709 12:23:26.877786 30784 rpcz_store.cc:276] 0709 12:23:25.595540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.595696 (+   156us) service_pool.cc:224] Handling call
0709 12:23:25.595989 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.259997 (+664008us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:26.492178 (+232181us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.784291 (+292113us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b18002d5140. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:23:26.784455 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.784507 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.784555 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.870939 (+ 86384us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54003ce454. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:26.870989 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.871096 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27825,"prepare.queue_time_us":316595,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1724,"raft.queue_time_us":204180,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":1544845056,"thread_start_us":263812,"threads_started":2,"wal-append.queue_time_us":169716}
I20260709 12:23:26.897239 30855 rpcz_store.cc:276] 0709 12:23:24.493406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.569268 (+1075862us) service_pool.cc:224] Handling call
0709 12:23:26.895537 (+1326269us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:23:26.895788 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.896030 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.896077 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.896136 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.896184 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.896254 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.896424 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8789376}
I20260709 12:23:26.904480 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:26.905414 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.906426 30930 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:26.907572 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.909492 30853 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:26.910748 30926 raft_consensus.cc:2410] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:23:26.914749 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.915696 30930 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:26.916817 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.918006 30930 raft_consensus.cc:2410] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:23:26.919328 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49618 (request call id 1915) took 1337 ms. Trace:
I20260709 12:23:26.920149 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.920774 30854 raft_consensus.cc:2468] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:26.886488  2183 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:26.920948 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.925472 30930 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:26.926424 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.921082 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.923331 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:26.919714 30932 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 12.
I20260709 12:23:26.927405 30784 raft_consensus.cc:3060] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.927855 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.930415 30932 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1914) took 1353 ms. Trace:
I20260709 12:23:26.934077 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.934916 30856 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 5.
I20260709 12:23:26.934085 30932 rpcz_store.cc:276] 0709 12:23:25.576573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.929623 (+1353050us) service_pool.cc:224] Handling call
0709 12:23:26.929927 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.930106 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.930129 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:26.930173 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:26.930214 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.930265 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:26.930359 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.938118 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:26.940258 30932 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:26.919749 30926 rpcz_store.cc:276] 0709 12:23:25.582441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.739830 (+1157389us) service_pool.cc:224] Handling call
0709 12:23:26.919263 (+179433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:26.942737 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:26.943554 30930 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:26.945128 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:26.948596 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:26.950137 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:26.951229  2268 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:26.952595 30855 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:26.955873 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:26.955070 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:26.956651 30853 raft_consensus.cc:2376] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10. Re-sending same reply.
I20260709 12:23:26.957592 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:26.959630 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.963341 30932 raft_consensus.cc:2468] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:26.964614 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:26.963250 30826 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:26.965503 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.968488 30935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 493) took 1563 ms. Trace:
I20260709 12:23:26.969027 30935 rpcz_store.cc:276] 0709 12:23:25.404906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.733146 (+1328240us) service_pool.cc:224] Handling call
0709 12:23:26.789868 (+ 56722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.805808 (+ 15940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.968214 (+162406us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54002a2e50. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:26.968407 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129708288}
I20260709 12:23:26.925233  2183 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:26.924796  2266 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:26.966169 30781 raft_consensus.cc:2468] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 5.
I20260709 12:23:26.976619 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:26.999701 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.000142 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:26.952530  2059 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:27.012179 30931 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1911) took 1470 ms. Trace:
I20260709 12:23:27.001287 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:27.002393 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:27.000471 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:27.012686 30931 rpcz_store.cc:276] 0709 12:23:25.541994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.826166 (+1284172us) service_pool.cc:224] Handling call
0709 12:23:26.826457 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:26.826673 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:26.873659 (+ 46986us) log.cc:844] Serialized 14 byte log entry
0709 12:23:27.011805 (+138146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:27.011863 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:27.011916 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.011980 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.012105 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15148,"prepare.queue_time_us":50715,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"thread_start_us":137717,"threads_started":1}
I20260709 12:23:27.003088 30930 raft_consensus.cc:2468] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 12.
I20260709 12:23:27.015540 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.016793 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.016917 30781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:26.954674  2201 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:26.966410 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:26.966898  2204 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:27.022989 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 56639.3us
I20260709 12:23:26.964541  2268 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:27.011617 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:27.027973 30926 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:23:27.028275 30932 raft_consensus.cc:2393] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:27.028620 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 498) took 1023 ms. Trace:
I20260709 12:23:27.028690 30931 raft_consensus.cc:1240] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:26.970755 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.029034 30926 rpcz_store.cc:276] 0709 12:23:26.005107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.022164 (+1017057us) service_pool.cc:224] Handling call
0709 12:23:27.027655 (+  5491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.028383 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.028567 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:27.000692 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:26.991819  2183 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:27.003924 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
W20260709 12:23:27.017989 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 69506.4us
I20260709 12:23:26.966401  2137 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.023677 30826 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:27.042445 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:27.044281 30826 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:27.010421 30899 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:27.024242 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.025564 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:27.026439 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:26.991570  2225 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:27.029868 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:27.029870 30935 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:27.048368 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:27.049042 30935 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.030611 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.017104 30784 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 12.
I20260709 12:23:27.022609 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:27.033228 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.031111  2114 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.045612 30930 raft_consensus.cc:2468] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:27.012588  2059 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:27.046607 30826 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:27.046906 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:27.090317 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 43786.9us
I20260709 12:23:27.090344 30780 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:27.091383 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:27.053381 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.032184 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.093465 30926 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:27.094668 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.095415 30926 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
I20260709 12:23:27.054792 30778 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:27.026198  2204 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.074432 30931 raft_consensus.cc:1240] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:23:27.034235 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:27.098557 30932 raft_consensus.cc:2468] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:27.075460 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:27.076891 30899 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:27.079145 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
W20260709 12:23:27.080389  2251 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.712s	user 0.004s	sys 0.006s
W20260709 12:23:27.083467  2273 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 12:23:27.085685 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 530) took 2592 ms. Trace:
I20260709 12:23:27.102267 30932 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:27.102491 30930 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:27.101532 30857 rpcz_store.cc:276] 0709 12:23:24.493749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.570468 (+1076719us) service_pool.cc:224] Handling call
0709 12:23:26.834062 (+1263594us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800002d98. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d8fab71 00007f960d8faa22 00007f96168138d9 00007f961596dee0 00007f9615a370ab 00007f9615a37131 00007f96159f8fc0 00007f96159e3929 00007f96159e33d2 00007f960ef5abd4
0709 12:23:26.834237 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.052018 (+217781us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:27.052063 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:27.052124 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:27.052172 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.085440 (+ 33268us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54004006d4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:27.085490 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.085621 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5688,"raft.queue_time_us":11981,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13199,"spinlock_wait_cycles":512060544}
I20260709 12:23:27.103789 30930 raft_consensus.cc:1240] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:27.043129  2137 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:27.092818 30929 raft_consensus.cc:2468] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:27.110960 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.100275 30935 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
I20260709 12:23:27.058677  2200 raft_consensus.cc:2804] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:27.050721  2115 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:27.047539  2225 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.050922  2268 raft_consensus.cc:2804] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:27.110005 30926 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:27.077989  2114 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:27.112982 30931 raft_consensus.cc:1240] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:27.107141 30899 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:27.078488  2109 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.109268  2204 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.116529 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.113751  2137 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.121018 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.117493 30900 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:27.122578 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.114809  1981 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:27.059230  2201 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:27.116966 30935 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:23:27.110337  2261 raft_consensus.cc:2804] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:27.131050 30783 raft_consensus.cc:2393] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in this term.
I20260709 12:23:27.120689 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.138142 30784 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:27.101567  2059 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:27.167279 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 226259us
W20260709 12:23:27.127558 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 65813.1us
I20260709 12:23:27.172338 30782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.101774  2174 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:23:27.123970  2225 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:27.198966 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:27.141583 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:27.175674 30931 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:23:27.178200 30935 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:27.204900 30935 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:23:27.130729  2114 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.174366  2067 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:27.213903 30933 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 489) took 2538 ms. Trace:
I20260709 12:23:27.125437  2200 raft_consensus.cc:697] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:27.189052 30899 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:27.136477  2222 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:27.134819  2109 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.173543  2115 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:27.191056 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:27.211937 30935 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:27.169858  1981 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:27.174028  2201 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:27.249038  2201 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:27.168231  2268 raft_consensus.cc:697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:27.250451  2268 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:27.219493 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 128196us
I20260709 12:23:27.214341 30933 rpcz_store.cc:276] 0709 12:23:24.675349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:25.052808 (+377459us) service_pool.cc:224] Handling call
0709 12:23:25.053484 (+   676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:25.401201 (+347717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:25.401251 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:25.484387 (+ 83136us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.271274 (+786887us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:26.271371 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.271444 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.079836 (+808392us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:27.202603 (+122767us) raft_consensus.cc:1685] finished
0709 12:23:27.202637 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.213830 (+ 11193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86381,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4421,"spinlock_wait_cycles":9987840,"thread_start_us":992291,"threads_started":2,"wal-append.queue_time_us":801847}
I20260709 12:23:27.139209  2223 raft_consensus.cc:2764] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:23:27.254559  2164 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:27.229282 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:27.229557 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:27.254616 30854 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 11.
W20260709 12:23:27.243881  2279 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:23:27.235076  1765 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:23:27.235297  2249 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 12:23:27.244716  2278 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:23:27.245404  2275 log.cc:927] Time spent T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:23:27.213596  2242 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 12:23:27.268111  2276 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 12:23:27.269248  2271 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.394s	user 0.003s	sys 0.000s
I20260709 12:23:27.224511  2146 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:23:27.270998 30927 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33366 (request call id 496) took 1777 ms. Trace:
I20260709 12:23:27.271374  2146 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:27.271833 30750 leader_election.cc:400] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:27.272179 30750 leader_election.cc:403] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:27.272266  2116 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:27.272891  2116 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:27.273955  2139 consensus_queue.cc:1059] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:27.274861  2139 raft_consensus.cc:3055] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:27.275200  2139 raft_consensus.cc:740] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:27.276077  2139 consensus_queue.cc:260] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.277349  2139 raft_consensus.cc:3060] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:27.279860 30934 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1913) took 1710 ms. Trace:
I20260709 12:23:27.280323 30934 rpcz_store.cc:276] 0709 12:23:25.569427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.839237 (+1269810us) service_pool.cc:224] Handling call
0709 12:23:26.839575 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.840041 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.840080 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.846750 (+  6670us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.941859 (+ 95109us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:26.941909 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.942002 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.279615 (+337613us) raft_consensus.cc:1685] finished
0709 12:23:27.279640 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.279793 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":2304,"thread_start_us":76117,"threads_started":1,"wal-append.queue_time_us":180951}
I20260709 12:23:27.261535  2174 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.227852  1821 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:23:27.260072 30928 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1905) took 2211 ms. Trace:
I20260709 12:23:27.217262  2067 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:27.263448 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:27.178840  2108 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:23:27.245975  2281 consensus_queue.cc:1059] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:27.271400 30927 rpcz_store.cc:276] 0709 12:23:25.493255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.744572 (+1251317us) service_pool.cc:224] Handling call
0709 12:23:26.747241 (+  2669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:26.747760 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.747789 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:26.840948 (+ 93159us) log.cc:844] Serialized 26 byte log entry
0709 12:23:26.905424 (+ 64476us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:26.905470 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.906404 (+   934us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.270777 (+364373us) raft_consensus.cc:1685] finished
0709 12:23:27.270797 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.270935 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":49653,"threads_started":1,"wal-append.queue_time_us":176702}
W20260709 12:23:27.284188 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.286132 30784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:27.313335 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.314270 30855 raft_consensus.cc:2468] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
I20260709 12:23:27.248019 30776 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:27.258953  2115 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.282115 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:27.327581 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.327852 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.291325 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.257652  1981 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:27.328315 30853 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 12.
I20260709 12:23:27.328713 30857 raft_consensus.cc:2468] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 10.
W20260709 12:23:27.311303 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 141344us
I20260709 12:23:27.294509 30928 rpcz_store.cc:276] 0709 12:23:25.049094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.692341 (+1643247us) service_pool.cc:224] Handling call
0709 12:23:26.692773 (+   432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:26.693574 (+   801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:26.693602 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:26.694221 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 12:23:26.727227 (+ 33006us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:26.842059 (+114832us) log.cc:844] Serialized 14 byte log entry
0709 12:23:26.842363 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:26.842459 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.082838 (+240379us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:27.238109 (+155271us) raft_consensus.cc:1685] finished
0709 12:23:27.259705 (+ 21596us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.259996 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30781,"prepare.queue_time_us":114567,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":1523,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":12256,"spinlock_wait_cycles":23958912,"thread_start_us":14787,"threads_started":1,"wal-append.queue_time_us":48076}
I20260709 12:23:27.330051 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:27.263559  2223 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:27.322743 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:27.334447 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 145464us
I20260709 12:23:27.299037  2174 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:27.351529 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.352232 30855 raft_consensus.cc:2468] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 8.
I20260709 12:23:27.349710 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.354403 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.298571  2144 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:27.356432 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:27.358152 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:27.310216  2067 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:27.360020 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:27.361863 30853 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:23:27.370981 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:27.375474 30899 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:27.332978  2115 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:27.379765 30825 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:27.359805  2273 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:23:27.381862 30825 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:27.359380  2174 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.388012 30899 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:27.401094 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 259619us
I20260709 12:23:27.405259 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:27.406100 30776 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:27.406424 30784 raft_consensus.cc:3055] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:27.416424 30784 raft_consensus.cc:740] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:27.362982  2261 raft_consensus.cc:697] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:23:27.420463 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 138399us
I20260709 12:23:27.417414 30784 consensus_queue.cc:260] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:27.438494 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 184127us
W20260709 12:23:27.462172 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 97615.9us
I20260709 12:23:27.407287 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:27.438355  2241 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:27.403422  1793 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 12:23:27.413340  2108 consensus_queue.cc:1059] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:23:27.373361  2200 consensus_queue.cc:237] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.503266  2106 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:27.508086  2222 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:27.498351  2241 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:27.510996  1245 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:23:27.512813 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 90521.1us
I20260709 12:23:27.477362  2223 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:27.543937  2298 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.539569 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:27.574326  2109 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:27.512553  2291 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:27.581416  2109 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:27.546844  2241 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:27.520933  2302 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:27.607385  2253 log.cc:927] Time spent T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:27.597507  2222 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:27.537967  1821 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:23:27.585016  2223 raft_consensus.cc:697] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:27.575214  2106 raft_consensus.cc:697] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:27.584410  2261 consensus_queue.cc:237] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:27.637524 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 87279.5us
I20260709 12:23:27.613240  2109 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:27.665187  2222 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.584573  2298 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.673265  2106 consensus_queue.cc:237] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.673725  2298 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:27.677923  2283 log.cc:927] Time spent T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:23:27.677357 30930 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49618 (request call id 1926) took 1219 ms. Trace:
I20260709 12:23:27.682129 30930 rpcz_store.cc:276] 0709 12:23:26.457898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.104490 (+646592us) service_pool.cc:224] Handling call
0709 12:23:27.104787 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:27.105140 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:27.105173 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:27.127117 (+ 21944us) log.cc:844] Serialized 52 byte log entry
0709 12:23:27.348443 (+221326us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:27.348488 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:27.348556 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:27.677103 (+328547us) raft_consensus.cc:1685] finished
0709 12:23:27.677123 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:27.677279 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10250,"raft.queue_time_us":4562,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1968,"thread_start_us":158733,"threads_started":1,"wal-append.queue_time_us":499285}
I20260709 12:23:27.683765  2223 consensus_queue.cc:237] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.616714  2114 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.757273  2109 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.769622  2114 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:27.775012  2115 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.777310  2115 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:27.777796  2204 consensus_meta.cc:287] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.601s	user 0.020s	sys 0.000s
I20260709 12:23:27.778250  2204 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.780319  2204 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:27.781872  2183 consensus_meta.cc:287] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.719s	user 0.016s	sys 0.000s
I20260709 12:23:27.782404  2183 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:27.767292  2059 consensus_meta.cc:287] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
W20260709 12:23:27.784371  2137 consensus_meta.cc:287] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.004s
I20260709 12:23:27.815662  2059 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.817912  2137 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:27.885363  2266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.008s	sys 0.011s
I20260709 12:23:27.889662  2241 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:27.882094  1981 consensus_meta.cc:287] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.525s	user 0.016s	sys 0.006s
I20260709 12:23:27.908851  2174 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.915269  2174 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:27.917377  2183 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:27.918399  2067 consensus_meta.cc:287] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.012s
I20260709 12:23:27.918318  1981 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:27.905659  2266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.008s	sys 0.011s
W20260709 12:23:27.940784  2139 consensus_meta.cc:287] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.015s
I20260709 12:23:27.926450  2067 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:27.954689  2241 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:27.962086  2059 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:27.963321  2225 consensus_meta.cc:287] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.009s
I20260709 12:23:27.963861  2225 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:27.967794  2201 consensus_meta.cc:287] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.718s	user 0.017s	sys 0.002s
I20260709 12:23:27.968391  2201 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:27.970769  2225 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:27.971979  2201 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:27.973448  2137 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:27.973670  2067 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:27.975684  1981 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.024333 30859 raft_consensus.cc:2368] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:23:28.059751 30855 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:28.157240 30926 raft_consensus.cc:1240] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:28.239240  1981 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.240226  1981 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.243108  1981 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:28.433465 30900 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.046s	sys 0.057s
W20260709 12:23:28.434152 30900 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.047s	sys 0.057s
W20260709 12:23:28.434939 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 1.0297e+06us
I20260709 12:23:28.435807 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:28.443480 30926 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49622 (request call id 1623) took 1510 ms. Trace:
I20260709 12:23:28.447324 30926 rpcz_store.cc:276] 0709 12:23:26.933162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.124694 (+191532us) service_pool.cc:224] Handling call
0709 12:23:27.139155 (+ 14461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:28.157713 (+1018558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.443071 (+285358us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400330ed4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:28.443389 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340782336}
W20260709 12:23:28.446466 30782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.008s	sys 0.012s
W20260709 12:23:28.451092 30782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.008s	sys 0.012s
I20260709 12:23:28.445335 30855 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1854) took 1121 ms. Trace:
I20260709 12:23:28.451733 30855 rpcz_store.cc:276] 0709 12:23:27.324009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.352852 (+ 28843us) service_pool.cc:224] Handling call
0709 12:23:27.377410 (+ 24558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:28.060303 (+682893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:28.444976 (+384673us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400377dd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1fe01 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6
0709 12:23:28.445251 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568576384}
I20260709 12:23:28.448513  1981 raft_consensus.cc:2764] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:23:28.449684 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:28.454530  1981 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:28.455024  1981 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.455487  1981 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.463830 30900 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:28.467206 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 781191us
I20260709 12:23:28.477967 30934 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:28.485822 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:28.487861  2266 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:28.488355  2266 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.488745  2266 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.489532 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:28.492036 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:28.495355 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:28.498672 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:28.470866  1981 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.504894 30858 pending_rounds.cc:85] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 8
I20260709 12:23:28.505512 30858 pending_rounds.cc:107] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:23:28.505949  1981 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.505999 30858 raft_consensus.cc:2889] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:28.506866  1981 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:28.507336 30825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.003s	sys 0.018s
W20260709 12:23:28.507854 30825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.003s	sys 0.018s
W20260709 12:23:28.508554 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 1.12669e+06us
W20260709 12:23:28.509799  2315 log.cc:927] Time spent T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.626s	user 0.003s	sys 0.000s
I20260709 12:23:28.510798  2059 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:28.511585  2059 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:28.512008  2059 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.512475  2059 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.507309  1981 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.514998  2067 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:28.515110  1981 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.516022  2067 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:28.511708 30825 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:28.524402  2289 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:28.524910  2289 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:28.527947  2183 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:28.528560  2183 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:28.531665  2183 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:28.533214  2183 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:28.532091  2289 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:28.534679  2289 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:28.539162  2261 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.539783  2261 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.542212  2261 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:28.543118 30826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.000s	sys 0.012s
W20260709 12:23:28.543602 30826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.000s	sys 0.012s
W20260709 12:23:28.543895 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 1.10357e+06us
I20260709 12:23:28.549079 30825 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:28.553825 30900 connection.cc:256] RPC call timeout handler was delayed by -2.4870831760003966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 12:23:28.554529 30900 connection.cc:256] RPC call timeout handler was delayed by -2.1405831760002911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:23:28.554983 30900 connection.cc:256] RPC call timeout handler was delayed by -1.6122831760003464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2696s for a response
I20260709 12:23:28.555902 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:28.563431 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:28.564158 30929 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.565518 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:28.571735 30900 leader_election.cc:400] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11.
I20260709 12:23:28.572631 30900 leader_election.cc:403] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:28.557070  2183 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.557080  2174 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.572000  2137 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.590377 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:28.593614 30929 raft_consensus.cc:2468] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:28.596305 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:28.597216 30927 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 11: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:28.577973  1981 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.599745  1981 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.600611  1981 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:28.592082  2067 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11.
I20260709 12:23:28.594277  2261 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.586802  2183 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.626359  2067 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:28.627470  2296 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:28.627477 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:28.590072  2174 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.633498 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:28.634186 30928 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.638264  2338 consensus_queue.cc:1059] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:28.639434  2338 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:28.640498  2174 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.640671  2338 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.641337  2338 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.642179 30928 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
W20260709 12:23:28.643743 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.646262 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.646287 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:28.646543 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.648072 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.648403 30776 raft_consensus.cc:3060] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.648816 30780 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:28.648141  1981 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.651549  1981 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.643621  2296 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.654227 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.654695  2296 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.656142 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.656844  2296 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.657864 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.622278  2266 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.658506 30779 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.660328  2266 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.662128  2333 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.662273  1245 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.662983  2334 raft_consensus.cc:3055] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:28.662845  1245 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.657835  1981 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.632393  2067 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.664073 30781 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:28.664883  1245 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.663451  2334 raft_consensus.cc:740] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:28.665558  2067 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.662695  2333 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.671308 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:28.630295  2261 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.678694 30779 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:28.679103 30778 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:28.673323  2183 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.679507 30776 raft_consensus.cc:2468] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:28.679567 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:28.680732  1245 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.681201 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.682999 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.681279  1245 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.685269 30779 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.686856 30776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:28.685138  2183 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.692831 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.702121 30780 raft_consensus.cc:2468] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:28.643657  2338 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.703598  2183 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.711545  2338 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.733425 30854 raft_consensus.cc:1275] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:23:28.734047 30854 pending_rounds.cc:85] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting all ops after (but not including) 4
I20260709 12:23:28.733347  2338 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.734328 30854 pending_rounds.cc:107] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:23:28.737432 30854 raft_consensus.cc:2889] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:28.742875 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.744617 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.745005 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.746791 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.747833 30853 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 11: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:28.748384  2109 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.748903 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.746826  1245 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.756826 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:28.759600 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62660us
I20260709 12:23:28.754123 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.760874 30854 raft_consensus.cc:2393] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:28.762029  2201 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:28.681787  2059 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:28.763712 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.692740  2296 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.670374  2334 consensus_queue.cc:260] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.768277 30853 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:28.771132  2338 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.772228  2183 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.774345 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:28.775054 30931 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.769655 30899 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:28.777099 30899 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:28.778833 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.779616 30853 raft_consensus.cc:2393] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:28.780433  2106 raft_consensus.cc:2804] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:28.780884 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:28.793946 30899 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:28.824959 30931 raft_consensus.cc:2468] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 12.
I20260709 12:23:28.775499  2296 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.825728  2333 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.778537  2059 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.780937  2201 raft_consensus.cc:2804] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:28.829831 30780 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65"
I20260709 12:23:28.835585 30851 raft_consensus.cc:2410] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:23:28.806486 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.836442 30853 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:28.826624  2334 raft_consensus.cc:3060] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.837738 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.838474 30854 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.827560  2106 raft_consensus.cc:697] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:28.840466  2106 consensus_queue.cc:237] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.843449  2296 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.843628 30853 raft_consensus.cc:2468] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 13.
I20260709 12:23:28.845414 30854 raft_consensus.cc:2468] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:28.827950  2067 raft_consensus.cc:2804] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:28.847561  1981 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:28.848212  1981 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.849908  2201 raft_consensus.cc:697] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:28.827610  2261 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.851064  2201 consensus_queue.cc:237] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.852586 30852 raft_consensus.cc:2468] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:28.856907  2067 raft_consensus.cc:697] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:28.859246 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:28.861181 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:28.862694 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:28.863011  1981 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:28.863310  2317 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.863485 31509 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 14.
I20260709 12:23:28.863991  2317 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:28.864575 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.865424 30858 raft_consensus.cc:2393] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 10: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:28.861096 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:28.868991  2317 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:28.869647  2117 raft_consensus.cc:3055] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:28.870179  2117 raft_consensus.cc:740] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:28.871035  2117 consensus_queue.cc:260] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:28.872442  2117 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.858160  2067 consensus_queue.cc:237] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:28.879686 30783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:28.884613 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:28.885069 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:28.884919 30779 raft_consensus.cc:1240] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:28.886761 30900 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:28.894554 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:28.895452 30935 raft_consensus.cc:2393] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 12: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:28.892650  2222 raft_consensus.cc:2764] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:23:28.901973 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:28.896445  1981 consensus_queue.cc:1059] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:23:28.902812 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.903298  1981 raft_consensus.cc:3055] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:28.903513 30858 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.903764  1981 raft_consensus.cc:740] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:28.893193  2266 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:28.907609 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:28.907826 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.908427 31508 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:28.908471 30860 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:28.914268 30779 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:23:28.915719 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:28.920068 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.922842 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.923556 30857 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:28.925472 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.926119 30860 raft_consensus.cc:2393] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 11: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:28.926162 30856 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.927198 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.928001 30860 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 6.
I20260709 12:23:28.929021 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.931144 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:28.931854 31506 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.929706 30860 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:28.933403 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.933933 30858 raft_consensus.cc:2468] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:28.934227 30860 raft_consensus.cc:2393] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 11: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:28.934765 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.935212 30858 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.925513 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.938807 30855 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:28.933602 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:28.904992  1981 consensus_queue.cc:260] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.947937 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.950165 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:28.958153 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.958811 30860 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:28.930612  2222 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:23:28.972025  2266 raft_consensus.cc:2764] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:23:28.982800 30777 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:28.984935  2114 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.986986 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.987620 30852 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:28.992538  2222 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:28.993804 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:28.994426 30851 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:28.996562  2114 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:28.997982  2222 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:28.998750  2222 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:28.999876  2115 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:29.000428  2115 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:29.001963  2261 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:29.010174  2114 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:29.002491  2261 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:29.019420  2298 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:29.020121  2298 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:29.020855 30859 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42858 (request call id 1837) took 2142 ms (client timeout 1870 ms). Trace:
W20260709 12:23:29.021332 30859 rpcz_store.cc:269] 0709 12:23:26.878813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:26.878941 (+   128us) service_pool.cc:224] Handling call
0709 12:23:29.020604 (+2141663us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400327dd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a232fa 00007f96159e4b17 00007f960ef5f6d4 00007f960ef5f662 00007f960ef5f591 00007f960ef5f50c 00007f960ef5e7c2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:29.020747 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631677184}
I20260709 12:23:28.915140 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.023000  2298 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:29.023245 30859 raft_consensus.cc:1275] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:23:29.024015 30681 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 82) took 21437 ms (client timeout 15000 ms). Trace:
I20260709 12:23:29.024607 31506 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:29.025513 30859 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 8. Current term is 9. Ops: []
W20260709 12:23:29.025389 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 168243us
I20260709 12:23:28.989595 30857 raft_consensus.cc:2468] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:29.027818 30785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:29.027205 30855 raft_consensus.cc:2468] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:29.029006 30856 raft_consensus.cc:2468] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:29.030002 30858 raft_consensus.cc:2468] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:29.028452 30785 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:29.032358 30899 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:29.033957 30852 raft_consensus.cc:2468] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:29.031699  2298 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.042229 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:29.042408  2298 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:29.024523 30681 rpcz_store.cc:269] 0709 12:23:07.586968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:07.588749 (+  1781us) service_pool.cc:224] Handling call
0709 12:23:29.023942 (+21435193us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:21.743043 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:21.824875 (+ 81832us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:21.824927 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:23:21.824950 (+    23us) tablet.cc:662] Decoding operations
0709 12:23:21.826085 (+  1135us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:21.826171 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:21.826197 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:23:21.925967 (+ 99770us) tablet.cc:701] Row locks acquired
0709 12:23:21.926019 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:23:21.926179 (+   160us) write_op.cc:270] Start()
0709 12:23:21.926336 (+   157us) write_op.cc:276] Timestamp: P: 1783599801926122 usec, L: 0
0709 12:23:21.926357 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:23:21.927071 (+   714us) log.cc:844] Serialized 4429 byte log entry
0709 12:23:22.658200 (+731129us) op_driver.cc:464] REPLICATION: finished
0709 12:23:23.899482 (+1241282us) write_op.cc:301] APPLY: starting
0709 12:23:23.913448 (+ 13966us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:23.990319 (+ 76871us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:23.990565 (+   246us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:24.036254 (+ 45689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:24.036706 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:23:24.036783 (+    77us) write_op.cc:312] APPLY: finished
0709 12:23:24.037325 (+   542us) log.cc:844] Serialized 82 byte log entry
0709 12:23:24.248976 (+211651us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.310560 (+ 61584us) write_op.cc:454] Released schema lock
0709 12:23:24.364849 (+ 54289us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:24.495320 (+130471us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:24.504041 (+  8721us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2199125,"reported_tablets":13,"spinlock_wait_cycles":24320,"child_traces":[["op",{"apply.queue_time_us":1200105,"apply.run_cpu_time_us":21708,"apply.run_wall_time_us":610057,"num_ops":11,"prepare.queue_time_us":245722,"prepare.run_cpu_time_us":102332,"prepare.run_wall_time_us":400444,"raft.queue_time_us":137707,"raft.run_cpu_time_us":50706,"raft.run_wall_time_us":1151097,"replication_time_us":731574,"thread_start_us":1684249,"threads_started":5,"wal-append.queue_time_us":493786,"wal-append.run_cpu_time_us":45992,"wal-append.run_wall_time_us":2503115}]]}
I20260709 12:23:29.063139 30851 raft_consensus.cc:2468] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:29.044091 30680 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.044705  2174 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:29.079545 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:29.079706  2174 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:29.080181  2174 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.080365 30851 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:29.079859 30680 catalog_manager.cc:5697] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 8, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.082708  2245 consensus_queue.cc:1059] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:29.093452 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.094633 30935 raft_consensus.cc:2393] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7857bffc34ce4e1db3617488701b9810 in current term 8: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:29.104246 30680 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 6, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 6 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:29.106029 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:29.106909 30851 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:28.943892  2201 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:29.084223  2108 raft_consensus.cc:3055] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:29.128118  2302 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:29.133041 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:29.147032  2296 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:29.155804  2222 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:29.136528  2201 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:29.121578 31532 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2260 after lost signal to thread 29612
I20260709 12:23:29.166647  2302 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:29.134940  2108 raft_consensus.cc:740] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:29.204596 30859 raft_consensus.cc:1275] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:29.205987 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:29.206013 30860 raft_consensus.cc:2468] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
W20260709 12:23:29.214316 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.222473 30777 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" is_pre_election: true
I20260709 12:23:29.223575 30777 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:29.214316 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:29.129586  2059 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:29.227133 30680 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 8, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:29.230096  2059 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:29.233956  2342 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.174s	user 0.001s	sys 0.002s
I20260709 12:23:29.237025 30784 raft_consensus.cc:3060] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.228793  2290 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:23:29.246120 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.248360 31532 debug-util.cc:398] Leaking SignalData structure 0x7b08002d20c0 after lost signal to thread 30716
W20260709 12:23:29.250000 31532 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1be0 after lost signal to thread 30809
W20260709 12:23:29.250329 31532 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1b60 after lost signal to thread 30810
W20260709 12:23:29.251664 31532 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9f80 after lost signal to thread 30884
W20260709 12:23:29.251995 31532 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6a40 after lost signal to thread 30885
I20260709 12:23:29.252941  2302 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:29.255609  2108 consensus_queue.cc:260] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:29.259620  2108 raft_consensus.cc:3060] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.262570  2261 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:29.266525  2343 log.cc:927] Time spent T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.319s	user 0.004s	sys 0.000s
I20260709 12:23:29.289259 30932 raft_consensus.cc:1275] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:23:29.290890 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.295907 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.298697 30935 raft_consensus.cc:2393] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:29.303224 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:29.304734  2106 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:29.306768 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.308125 30930 raft_consensus.cc:2410] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:23:29.316555 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:29.296779 30929 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:29.324424 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.325148 30929 raft_consensus.cc:2393] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 12: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:29.326356 30929 raft_consensus.cc:1275] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:29.297907 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.327472 30932 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 8.
I20260709 12:23:29.328706  2305 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:29.320164 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.329547 30927 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 6.
I20260709 12:23:29.320446 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.329972 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.330570 30926 raft_consensus.cc:2393] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 12: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:29.320870 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.330973  2305 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:29.331529  2305 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:29.332042  2305 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.322093 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.334583 30930 raft_consensus.cc:2393] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:29.322918 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.335870 30935 raft_consensus.cc:2393] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 11: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:29.301618  2115 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:29.317406  2106 consensus_queue.cc:1048] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:29.331669 30934 raft_consensus.cc:2410] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:23:29.321949 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.346748 30933 raft_consensus.cc:2393] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 13: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:23:29.259661 31532 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0740 after lost signal to thread 30959
W20260709 12:23:29.355288 31532 debug-util.cc:398] Leaking SignalData structure 0x7b0800356aa0 after lost signal to thread 30960
W20260709 12:23:29.357213 31532 debug-util.cc:398] Leaking SignalData structure 0x7b080014d980 after lost signal to thread 31535
W20260709 12:23:29.357728 31532 debug-util.cc:398] Leaking SignalData structure 0x7b080032bae0 after lost signal to thread 31536
I20260709 12:23:29.278290  2298 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.360472 30900 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.365715 30784 raft_consensus.cc:1275] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:23:29.366242 30784 pending_rounds.cc:85] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting all ops after (but not including) 8
I20260709 12:23:29.366545 30784 pending_rounds.cc:107] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:23:29.366575 30900 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.367233 30784 raft_consensus.cc:2889] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:29.367327 30680 catalog_manager.cc:5697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 9, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 9 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:29.372529 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:29.373255 30931 raft_consensus.cc:1240] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:29.373957 30784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32970 (request call id 542) took 1969 ms. Trace:
I20260709 12:23:29.376767 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.374933 30680 catalog_manager.cc:5697] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:29.374337 30784 rpcz_store.cc:276] 0709 12:23:27.404197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.405904 (+  1707us) service_pool.cc:224] Handling call
0709 12:23:27.406270 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:29.236643 (+1830373us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b58008cfcd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f961097b0aa 00007f96109fd447 00007f9610a15fe7 00007f9610a177de 00007f9610a21b49 00007f9610a22416 00007f9610a1ed8f 00007f9610a1e83e 00007f96159e3419 00007f960ef5abd4
0709 12:23:29.373660 (+137017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.373896 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3923405696}
I20260709 12:23:29.378634 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.381207 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.375896  2298 raft_consensus.cc:2804] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:29.397629 30680 catalog_manager.cc:5697] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.378312  2223 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:29.402839 30680 catalog_manager.cc:5697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.379218  2106 raft_consensus.cc:2804] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:29.391419  2067 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:29.367823  2174 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:29.392575  2222 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:29.412845 30680 catalog_manager.cc:5697] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 9, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 9 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.409734 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
I20260709 12:23:29.375463  2305 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.424808 30680 catalog_manager.cc:5697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 7, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 7 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:29.411896  2222 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:29.415932  2223 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:29.408155  2067 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.429883  2298 raft_consensus.cc:697] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 13 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.431041  2298 consensus_queue.cc:237] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:29.442577 31474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:29.444345 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 63214.9us
I20260709 12:23:29.446344 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.447022 30928 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:29.447129 30900 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.449103 30826 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:29.449293 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:29.449348 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.450855 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.453816 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:29.454380 31508 raft_consensus.cc:1275] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:23:29.454555 30680 catalog_manager.cc:5697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 7 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 10 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.464552 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:29.442662  2222 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:29.442620  2067 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.468497 30826 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.442950  2223 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:29.467455 30680 catalog_manager.cc:5697] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.471398 30826 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:29.452903  2106 raft_consensus.cc:697] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.463368  2305 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.474596  2106 consensus_queue.cc:237] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.470608  2137 raft_consensus.cc:2804] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:29.476157  2261 raft_consensus.cc:2804] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:29.476806  2261 raft_consensus.cc:697] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:29.477864  2261 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:29.481439  2341 log.cc:927] Time spent T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.406s	user 0.003s	sys 0.005s
I20260709 12:23:29.473269 30826 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.457197  2115 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:29.473393 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:29.471683  2223 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.471371  2201 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.484153  2296 raft_consensus.cc:2804] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:29.485060  2296 raft_consensus.cc:697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:29.486182  2296 consensus_queue.cc:237] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.474472  2174 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:29.472570  2114 raft_consensus.cc:2804] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:29.490844  2114 raft_consensus.cc:697] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:29.492014  2114 consensus_queue.cc:237] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.493690  2059 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.494351 30680 catalog_manager.cc:5697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.496656  1981 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.497139  2305 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:29.500236 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 1.96058e+06us
I20260709 12:23:29.501031 30750 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.501744  2137 raft_consensus.cc:697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.502161 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:29.502889  2137 consensus_queue.cc:237] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.504825 30782 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54660 (request call id 1755) took 2290 ms. Trace:
I20260709 12:23:29.496474  2115 consensus_queue.cc:1048] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:29.503278 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:29.519357 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46037.3us
I20260709 12:23:29.521106 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:29.522960 30900 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.505198 30782 rpcz_store.cc:276] 0709 12:23:27.214923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:27.215589 (+   666us) service_pool.cc:224] Handling call
0709 12:23:27.216002 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:27.216255 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:27.358242 (+141987us) log.cc:844] Serialized 14 byte log entry
0709 12:23:28.509194 (+1150952us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:29.504459 (+995265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:29.504514 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:29.504559 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.504624 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:29.504737 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1052852,"prepare.queue_time_us":265687,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":6225,"spinlock_wait_cycles":10432768,"thread_start_us":1225218,"threads_started":2,"wal-append.queue_time_us":461119}
I20260709 12:23:29.527731 30826 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.529660 30826 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.524609 30680 catalog_manager.cc:5697] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.534258 30826 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.534874  2287 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:29.530742  2234 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.535336  2113 raft_consensus.cc:2764] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:23:29.543184  2133 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.525477  2144 raft_consensus.cc:2804] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:29.544480  2201 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:29.533083  2333 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:29.530954  2166 raft_consensus.cc:2804] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:23:29.559590 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 56375.8us
I20260709 12:23:29.560689 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.554257 30900 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.555486 30680 catalog_manager.cc:5697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:29.548450  2174 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:29.552950  2144 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:29.505697  2222 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.529466  2297 consensus_queue.cc:1048] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:23:29.555194  2133 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.545591  2287 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:29.530830  2302 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:23:29.558571  2349 raft_consensus.cc:2804] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:29.531105  2334 consensus_queue.cc:1048] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:23:29.548308  2204 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:23:29.582756 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.592769  2144 raft_consensus.cc:3060] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.590462 30680 catalog_manager.cc:5697] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 7, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 7 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.596143 30900 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.598417 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.615286 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.616285 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:29.549600  2059 consensus_queue.cc:1048] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:23:29.559458  2333 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
W20260709 12:23:29.619431 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 84215.3us
I20260709 12:23:29.599632 30899 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:29.560214  2166 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:29.575738  2162 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:29.550134  2234 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.533360  2132 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:23:29.612000 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 87910.4us
I20260709 12:23:29.604955  2241 raft_consensus.cc:2804] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:29.610369  2353 raft_consensus.cc:2804] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:29.607657  2287 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:29.622825 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:29.611596  2204 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.619138 30900 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.624486  2333 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.624835  2166 raft_consensus.cc:3060] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:29.633123 30680 catalog_manager.cc:5697] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 7 to 10, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 10 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.620402  2349 raft_consensus.cc:697] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.625298  2147 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:29.626147  2119 raft_consensus.cc:2804] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:29.647222 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:29.625169  2162 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:29.655737 30750 leader_election.cc:400] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
I20260709 12:23:29.648396 30680 catalog_manager.cc:5697] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 4 to 8, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.649397 30900 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.658391 30750 leader_election.cc:403] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:29.612804  2067 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.662529 30900 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:29.668130 30933 raft_consensus.cc:1240] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:29.671813 30680 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:29.673056 30680 catalog_manager.cc:5697] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 5 to 9, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 9 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:29.675403 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.659271 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:29.660444 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:29.627782  2241 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:29.625242  2355 raft_consensus.cc:2804] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:29.632993  2249 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:29.631817  2352 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:29.632895  2204 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:29.730733 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 71562.2us
I20260709 12:23:29.740200 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:29.684959 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:29.741389 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 56561.1us
I20260709 12:23:29.628844  1765 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:29.656314  2162 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.656179  2109 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.637143  2147 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:29.728255  2266 raft_consensus.cc:2804] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:29.670883  2116 raft_consensus.cc:3060] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:23:29.759651 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 99271.3us
I20260709 12:23:29.738209  2164 raft_consensus.cc:2764] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:23:29.648487  2353 raft_consensus.cc:697] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.657953  2119 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:29.726827  2350 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:23:29.662918  2298 raft_consensus.cc:2804] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:29.747532  2352 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.734126  2241 raft_consensus.cc:3060] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:29.763067  2149 raft_consensus.cc:2804] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:29.674896  2137 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:23:29.657168  1715 consensus_queue.cc:1059] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:23:29.735437  2348 raft_consensus.cc:2804] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:29.669696  2225 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:29.766121 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:29.760334 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 135513us
I20260709 12:23:29.767112  2059 consensus_queue.cc:1048] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:23:29.823438 30860 raft_consensus.cc:1275] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:29.748881  2113 raft_consensus.cc:2804] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:29.784475 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.761809  2347 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:23:29.870038 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.835610  2119 raft_consensus.cc:3060] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:29.769419  2355 raft_consensus.cc:697] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.819916  2334 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.819048  2147 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:29.749491  2249 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.821501 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:29.825022  2261 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:29.735651  2108 consensus_queue.cc:1059] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:23:29.841516 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:29.852903  2351 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:23:29.872473  2347 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:29.876281  2234 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:29.788309  2109 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:29.882302 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:29.839041  2352 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:29.844842  2149 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:29.905956  2149 raft_consensus.cc:3060] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:29.906522  2360 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 12:23:29.908080  2358 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:23:29.912226  2305 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:29.882761  2067 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.878185  2139 raft_consensus.cc:3055] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:29.878043  2222 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.899168  2266 raft_consensus.cc:697] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.836583  2223 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.897480  2302 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:29.902918  2133 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:29.904090  2347 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:29.853279  2349 consensus_queue.cc:237] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.930665  2139 raft_consensus.cc:740] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:29.877416  2355 consensus_queue.cc:237] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.895696  2334 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:29.962072  2162 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.964088  2334 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:29.964219  2162 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:29.964419  2109 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:29.966424  2361 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:23:29.975168  2223 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.954856  2298 raft_consensus.cc:697] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:29.984786  2298 consensus_queue.cc:237] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:29.952708  2302 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:29.987409  2166 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.008291  2166 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:29.995301  2266 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.024778  2368 log.cc:927] Time spent T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:23:30.021114  2352 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.029389  2352 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:29.946305  2353 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.041335  2356 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:23:30.039090  2204 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.031629  2302 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:30.052380  2204 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.054319  2284 raft_consensus.cc:3055] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:30.054989  2284 raft_consensus.cc:740] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:30.056227  2284 consensus_queue.cc:260] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:30.058038  2284 raft_consensus.cc:3060] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:30.037391  2287 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:29.768512 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:23:29.999181  2139 consensus_queue.cc:260] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.004340  1981 consensus_meta.cc:287] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.006s
I20260709 12:23:30.037391  2147 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.057601  2241 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.204316  2266 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:30.152315 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 409762us
I20260709 12:23:30.122678 30776 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1911) took 1293 ms. Trace:
I20260709 12:23:30.173925 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:29.999491  2119 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.206234  2204 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.135243 30851 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 12: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:30.120020 30783 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1917) took 1144 ms. Trace:
W20260709 12:23:30.151568 30899 leader_election.cc:336] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:30.209656  2225 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.212503  2249 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.195421  2158 raft_consensus.cc:2764] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:23:30.233270  2225 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.222283  2266 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.227716  2204 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.171276  1894 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:30.228616  2289 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.222898 30776 rpcz_store.cc:276] 0709 12:23:28.828981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.829348 (+   367us) service_pool.cc:224] Handling call
0709 12:23:28.829723 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.546596 (+716873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.546628 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.550922 (+  4294us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.615647 (+ 64725us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:29.615687 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.615772 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:30.026956 (+411184us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b48000030d8. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9615948aa1 00007f961593fb37 00007f961593f9ca 00007f9615a3726f 00007f9615a36f37 00007f9615a4b55c 00007f9615a4b508 00007f9615a4b488 00007f9615a4b443 00007f9615a4a6ec 00007f9614974a96
0709 12:23:30.122032 (+ 95076us) raft_consensus.cc:1685] finished
0709 12:23:30.122080 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:30.122516 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":716434,"raft.queue_time_us":719185,"raft.run_cpu_time_us":4420,"raft.run_wall_time_us":477025,"spinlock_wait_cycles":4000640,"thread_start_us":57901,"threads_started":1,"wal-append.queue_time_us":210028}
I20260709 12:23:30.240271  2289 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:30.240372  1894 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:30.182987 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:30.159536 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.245028  2289 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.223624  2241 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.230871 30783 rpcz_store.cc:276] 0709 12:23:28.975663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.976465 (+   802us) service_pool.cc:224] Handling call
0709 12:23:28.976803 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.550352 (+573549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.550387 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.550922 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.631735 (+ 80813us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:29.631783 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.631881 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:30.119304 (+487423us) raft_consensus.cc:1685] finished
0709 12:23:30.119387 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:30.119720 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":611076,"raft.queue_time_us":574880,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3789,"thread_start_us":66709,"threads_started":1,"wal-append.queue_time_us":310974}
I20260709 12:23:30.223263 30900 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:30.249318 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:30.250468 31508 raft_consensus.cc:1813] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Handling vote request from an unknown peer 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:30.250393  2106 raft_consensus.cc:2804] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:30.251313 31508 raft_consensus.cc:2410] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:23:30.251281  2106 raft_consensus.cc:697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:30.223500  2147 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.280072  2106 consensus_queue.cc:237] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
W20260709 12:23:30.122505 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 356295us
I20260709 12:23:30.286877 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:30.288520  2241 raft_consensus.cc:2804] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:30.288637  2139 raft_consensus.cc:3060] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:30.289088  2241 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:30.289698  2241 raft_consensus.cc:3060] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.290257  2355 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.290992  2355 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.069013  2347 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.296392  2384 log.cc:927] Time spent T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 12:23:30.273718 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 122440us
I20260709 12:23:30.245023  2266 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:30.228960  2119 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:30.312311 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 89306.1us
I20260709 12:23:30.315384 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:30.319199 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:30.323168  2144 consensus_meta.cc:287] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.703s	user 0.008s	sys 0.008s
I20260709 12:23:30.323793  2144 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.325083 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 101880us
W20260709 12:23:30.338706 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 574296us
I20260709 12:23:30.340871  2347 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:30.070950  2333 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.347658  2113 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:30.348389  2113 raft_consensus.cc:3060] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:30.355172  2287 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.356658 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:30.359064  2266 consensus_queue.cc:1048] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:30.360129  1894 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:30.360836  2359 log.cc:927] Time spent T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.457s	user 0.001s	sys 0.000s
I20260709 12:23:30.361081  2266 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:30.363838  2373 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:30.364382  2373 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:30.334700 30899 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:30.378001 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 79448.5us
W20260709 12:23:30.393844 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 58723.2us
W20260709 12:23:30.398102 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 108667us
I20260709 12:23:30.400489  2334 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.400671  2380 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.401576 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:30.401412  2380 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:30.406433 30933 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 12: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:23:30.407366 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.409443 31476 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.419018  2144 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.420496  2373 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.401227  2334 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.432636 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.382948  2355 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:30.433118 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49835.3us
I20260709 12:23:30.427654 31506 raft_consensus.cc:2468] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
W20260709 12:23:30.454159 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:30.458827 30899 leader_election.cc:336] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:30.465744 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.467325  1765 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:30.468143  1765 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.469084  2113 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.476743 31508 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:30.477531  2113 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.482028  2204 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.485919  2333 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.486855  2174 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:30.487287 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:30.492156 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.493039 30927 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:30.499764 30927 raft_consensus.cc:1275] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:30.501467 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:30.502106  2362 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.558s	user 0.000s	sys 0.004s
I20260709 12:23:30.502791 30931 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 7: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:30.503281  2334 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:30.503913 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 52235.1us
I20260709 12:23:30.504103 30781 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54648 (request call id 1920) took 1508 ms. Trace:
I20260709 12:23:30.504952 30928 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:30.507205  2380 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.504695 30781 rpcz_store.cc:276] 0709 12:23:28.995549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:28.995906 (+   357us) service_pool.cc:224] Handling call
0709 12:23:28.996262 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:29.551185 (+554923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:29.551222 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:29.556267 (+  5045us) log.cc:844] Serialized 26 byte log entry
0709 12:23:29.743687 (+187420us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:29.743739 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:29.744257 (+   518us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:30.341286 (+597029us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:30.503589 (+162303us) raft_consensus.cc:1685] finished
0709 12:23:30.503617 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:30.503915 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":584644,"raft.queue_time_us":555530,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4144,"spinlock_wait_cycles":6496512,"thread_start_us":139871,"threads_started":1,"wal-append.queue_time_us":298589}
W20260709 12:23:30.513968  2385 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:23:30.517585 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.521464 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:30.522040  2225 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.522709 30931 raft_consensus.cc:2393] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 9: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:30.528512  1765 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.530822  2225 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:30.531772  2225 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.487712  2174 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:30.532035 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 87605.4us
I20260709 12:23:30.538820  2225 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.533857 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:30.540215 30854 raft_consensus.cc:2393] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:30.536161  2334 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.545905  2334 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.542610 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:30.554497 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 132921us
W20260709 12:23:30.583627 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 86118.5us
W20260709 12:23:30.585945 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 46841.3us
W20260709 12:23:30.588655 31474 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.589795 30858 raft_consensus.cc:1275] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:23:30.586261 30854 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:30.585726 31477 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:23:30.587989  2149 consensus_meta.cc:287] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.012s
I20260709 12:23:30.588846 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:30.589874 30899 leader_election.cc:336] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:30.597412  2266 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.598905  2108 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.618942  2373 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:30.605237  2333 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:30.589534  2334 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:30.636405 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:30.648702 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 483683us
W20260709 12:23:30.649853 30825 leader_election.cc:336] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:30.650509 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:30.651072 31475 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.651711  2334 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:30.674088  2108 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:30.678707 30825 leader_election.cc:336] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:30.680461 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:30.647244 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:30.702917 30825 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:30.699790 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:30.718305 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:30.718950 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 70537.1us
I20260709 12:23:30.597661  2355 consensus_queue.cc:1048] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 12:23:30.678797  2174 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:30.680866  2108 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.630373  2149 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.733887 30860 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:30.734339 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 55731.9us
I20260709 12:23:30.738572  2204 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:30.739502  2383 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:30.758641 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 48555us
W20260709 12:23:30.759474 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 48068.4us
I20260709 12:23:30.709158  2334 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:30.772137  2116 consensus_meta.cc:287] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.937s	user 0.009s	sys 0.017s
I20260709 12:23:30.803481 30858 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 7: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:30.678985  2333 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.789330 30825 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:30.796348 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.805848 30860 raft_consensus.cc:2468] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:30.784858 30900 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:30.809719 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 386946us
I20260709 12:23:30.813113  2116 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8.
W20260709 12:23:30.815407 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.816087 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
W20260709 12:23:30.816080 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 96390.4us
I20260709 12:23:30.797308  2383 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.720382  2266 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:30.819237 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:30.823861 30854 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:30.729440  2241 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.825263 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.830106 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:30.832734 30860 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 12: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:30.824540  2383 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:30.836261 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:30.830461 31476 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:30.837069 30899 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:30.853524 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 257420us
I20260709 12:23:30.860249 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:30.828996  2204 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:30.865212 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:30.849519  2174 raft_consensus.cc:2804] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:23:30.853307 30899 leader_election.cc:336] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:30.869616 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 80377.6us
I20260709 12:23:30.858258  1765 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:30.901819  2174 raft_consensus.cc:697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:30.911474  2174 consensus_queue.cc:237] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:30.912317 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 88813.4us
W20260709 12:23:30.913836  2348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.031s	sys 0.030s
I20260709 12:23:30.905067 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:30.914273  2348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.032s	sys 0.030s
I20260709 12:23:30.914640  2348 raft_consensus.cc:697] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:30.916673 30858 raft_consensus.cc:1275] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:30.918545 30858 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:23:30.902077 30899 leader_election.cc:336] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:30.919055  2333 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:30.919412 30899 leader_election.cc:336] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:30.919564 30853 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:30.920279 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:30.922760 30855 raft_consensus.cc:1275] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:30.921425  2348 consensus_queue.cc:237] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:30.925969 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:30.926571  2149 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.926708 30857 raft_consensus.cc:1275] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:30.927996  2241 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:30.929598  2266 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:30.905040  1765 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:30.951978 30853 raft_consensus.cc:2468] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
W20260709 12:23:30.954028 30825 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:30.926829 30852 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:30.955952 30854 raft_consensus.cc:2468] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
W20260709 12:23:30.953009 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:30.957666 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 44554.3us
I20260709 12:23:30.953606 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:30.962610 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:30.963155 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:30.967087 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:30.998975 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.000555 30899 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:30.932476 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:23:31.003741 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 71298.6us
W20260709 12:23:31.005053 30899 leader_election.cc:336] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.010910 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 59946.4us
W20260709 12:23:31.013638 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49142us
I20260709 12:23:31.006947 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.014565 30928 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 14.
W20260709 12:23:31.010231 30899 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.015770 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.016420 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.014470 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.031279  2333 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:31.034222 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.035063 30928 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:31.036007 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.036666 30927 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 10.
I20260709 12:23:31.038947 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.039057  2287 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:31.045534  2204 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:31.062374  1765 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:31.070189 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.074438 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:31.079391 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.083190 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.082542 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.087669 31476 leader_election.cc:336] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.098459 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.099994 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.100896 30927 raft_consensus.cc:2393] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:23:31.132407 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 44797.9us
W20260709 12:23:31.138545 31476 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.136415 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 261409us
W20260709 12:23:31.144279 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 238018us
I20260709 12:23:31.141552 31476 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:31.147037 31476 leader_election.cc:336] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.163136 30825 leader_election.cc:336] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.166457 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.162273 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:31.176957 30825 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.200708  2108 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:23:31.222506  2383 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:31.224427 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.221472 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:31.225134 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.226799 30899 leader_election.cc:336] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.229490 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 67355.5us
I20260709 12:23:31.215143  2108 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.216777  2284 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:31.232375 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 55566.4us
W20260709 12:23:31.230832 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.233520  2383 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:31.234431 30825 leader_election.cc:336] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.234973 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:31.233608 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.236006 30899 leader_election.cc:336] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.238622 30899 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.242252 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:31.242895  2333 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.243342  2357 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:23:31.243863  2357 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.244270  2357 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.243358  2333 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.249596  2333 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.250551  2309 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.251140  2309 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:31.254361  2309 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:31.256309  2409 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:23:31.257411  2411 log.cc:927] Time spent T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:23:31.263110  2333 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.265553 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:31.266441  2417 log.cc:927] Time spent T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:23:31.267424  2357 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.268129 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.268864 30927 raft_consensus.cc:2468] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 8.
I20260709 12:23:31.269667  2357 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:31.229167  2287 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:23:31.270382  2357 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:31.271286 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.273327 30750 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.274245 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:31.277139 30933 raft_consensus.cc:3060] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:23:31.268056  2410 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:23:31.232954  2108 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:31.290807 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 47042.8us
I20260709 12:23:31.227468  2225 consensus_queue.cc:1048] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:23:31.276620  2333 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:31.311730 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 112594us
I20260709 12:23:31.293573  1765 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:31.316030 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.321894 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:31.319605 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.338161 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:31.338893 30934 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.344578  2425 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.345323  2425 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:31.348512  2425 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:31.354198 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 119782us
W20260709 12:23:31.355242 30825 leader_election.cc:336] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.359025 30825 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:31.358355 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.363420  2398 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.297s	user 0.005s	sys 0.003s
I20260709 12:23:31.363811  2225 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:31.368031  2416 raft_consensus.cc:2804] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.368748  2416 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:31.369127  2416 raft_consensus.cc:3060] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.369819  2147 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.370352  2147 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:31.371027 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 61574.7us
I20260709 12:23:31.372591  2147 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:31.372790 30899 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.373732 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.394074 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.400040  2421 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:23:31.374444 31476 leader_election.cc:336] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.401508 31476 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.401947 31476 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:31.402695 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 83281.2us
I20260709 12:23:31.403021 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:31.403680 30927 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:31.404465 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:31.405473  2420 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:31.405898  2420 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:31.406324  2420 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:31.445545 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:31.450330 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 76649.6us
I20260709 12:23:31.452948  2113 consensus_queue.cc:1059] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:31.454061  2435 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:31.454295  2113 raft_consensus.cc:3055] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:31.454675  2113 raft_consensus.cc:740] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:31.454816  2435 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.455714  2113 consensus_queue.cc:260] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.458537  2113 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:31.458626 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.470815 30900 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:31.444563  2147 raft_consensus.cc:2804] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:31.461911  2305 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:31.471516  2147 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:31.459585  2425 consensus_queue.cc:1048] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:31.471999  2305 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:31.472029  2147 raft_consensus.cc:3060] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:31.473649  2425 raft_consensus.cc:2804] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:31.474216  2425 raft_consensus.cc:697] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:31.475083  2425 consensus_queue.cc:237] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:31.477370 30899 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 107 similar messages]
I20260709 12:23:31.482507 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.483939 30900 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.484404  2147 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.485033  2355 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:31.485731  2355 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:31.488417  2355 consensus_queue.cc:1048] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:23:31.471042  2412 log.cc:927] Time spent T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 12:23:31.490869  2334 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.453470 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.518550 30934 raft_consensus.cc:2468] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 12.
W20260709 12:23:31.503095 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:31.521241 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.523205 30927 raft_consensus.cc:2468] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:31.524502 30826 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:31.527918 30826 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:31.531790  2416 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.534570  2435 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:31.537729 30933 raft_consensus.cc:2468] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 9.
I20260709 12:23:31.539729 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:31.557744  2434 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.551594  2431 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:31.537096  2347 consensus_queue.cc:1048] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:31.569109  2431 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:31.568948  2434 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.545537  2334 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.570317  2431 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.571648  2434 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:31.565378 31477 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:31.555096  2399 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:31.572877  2399 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.573233  2399 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:31.573451  2289 raft_consensus.cc:2804] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:31.567308 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 113965us
I20260709 12:23:31.554704 30900 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:31.562407  2416 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:31.577107  2289 raft_consensus.cc:697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:31.558878  2241 raft_consensus.cc:2804] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:31.593951  2139 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.551775  2367 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.591825  2289 consensus_queue.cc:237] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:31.594660  2147 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:31.595543 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:31.573329  2334 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:31.545815  2119 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.563820  2432 raft_consensus.cc:2804] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:31.551656  2298 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:23:31.560487  2349 consensus_queue.cc:1048] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:23:31.612305 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:31.596781  2241 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:31.618556 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.563563  2420 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.608132  2434 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.614008  2432 raft_consensus.cc:697] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
W20260709 12:23:31.626542 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 71958.1us
I20260709 12:23:31.619946  2241 raft_consensus.cc:3060] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:31.629977 30900 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:31.616629  2139 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.630506  2147 raft_consensus.cc:2804] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:31.621534  2367 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.653450  2297 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:31.642120  2435 raft_consensus.cc:2804] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:23:31.627401  2119 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.662060 30851 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:23:31.695601  2119 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:31.661847  2113 consensus_queue.cc:1059] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:31.696923  2113 raft_consensus.cc:3055] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:31.697302  2113 raft_consensus.cc:740] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:31.698191  2113 consensus_queue.cc:260] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.669831 30852 raft_consensus.cc:1275] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:31.669718 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:31.670832 30854 raft_consensus.cc:1275] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:23:31.670048 30859 raft_consensus.cc:1275] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:31.676018 30855 raft_consensus.cc:1275] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:31.677326 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:31.641152  2434 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.682106  2436 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:31.684432 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:31.704320 30860 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:31.650243  2201 raft_consensus.cc:2804] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:31.690565  2367 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:31.690663 30823 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.693146 30856 raft_consensus.cc:1275] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:23:31.701848  2147 raft_consensus.cc:697] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:31.735162  2201 raft_consensus.cc:697] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:31.707883  2435 raft_consensus.cc:697] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:31.699647  2108 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:31.744704  2113 raft_consensus.cc:3060] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:31.728132  2436 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.740447  2201 consensus_queue.cc:237] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:31.798815 30825 leader_election.cc:336] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.807816 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:31.773991  2416 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:23:31.811683  1765 consensus_queue.cc:1059] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:31.743166  2119 consensus_queue.cc:1059] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:23:31.814540 30825 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:31.752553  2144 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:23:31.809258  2420 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:31.745052  2432 consensus_queue.cc:237] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:31.850136 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 51391.5us
I20260709 12:23:31.842572  2431 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:31.851274 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:31.854022 30825 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.844678  2139 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:31.866719  2119 raft_consensus.cc:3055] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:31.849748  2416 raft_consensus.cc:3055] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:31.872434 30825 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:31.936124  2241 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.836355  2435 consensus_queue.cc:237] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:31.937563  2444 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:23:31.870754  2416 raft_consensus.cc:740] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:31.938457  2443 log.cc:927] Time spent T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:23:31.939942 30927 raft_consensus.cc:1275] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:31.869437  2119 raft_consensus.cc:740] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:31.946336 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 73921.1us
W20260709 12:23:32.030426 30825 leader_election.cc:336] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:31.949378  2439 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:23:31.951472 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.033990 30934 raft_consensus.cc:2410] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:23:31.952944  2436 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:31.845620  2147 consensus_queue.cc:237] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:31.869107  2434 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:31.962109  2445 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:23:31.871057  2108 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 15 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:31.963697  2447 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:23:31.990937 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.038316 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:32.063542 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.072533 30750 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:32.071650  2432 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:23:32.086279 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 55910.6us
W20260709 12:23:32.087386 30825 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.092696  2452 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:32.067222  2431 consensus_queue.cc:1048] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 12:23:32.099992  2399 consensus_meta.cc:287] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.006s
I20260709 12:23:32.135548  2119 consensus_queue.cc:260] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:32.164192 30900 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:32.098685  2416 consensus_queue.cc:260] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:32.167616  2416 raft_consensus.cc:3060] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:32.170951 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 110632us
W20260709 12:23:32.175763 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 88419.8us
I20260709 12:23:32.178222  2119 raft_consensus.cc:3060] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:32.179214  2241 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:32.163456  2399 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:32.204645 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:32.170614  2422 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.278664 31508 raft_consensus.cc:2393] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 15: Already voted for candidate 7857bffc34ce4e1db3617488701b9810 in this term.
I20260709 12:23:32.281847 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:32.282513 30858 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:32.273398 30825 leader_election.cc:336] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.288300 30825 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:32.293731 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:32.303320 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:32.267428  2144 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.305104 30853 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
W20260709 12:23:32.305833 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:32.331409 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62728.1us
W20260709 12:23:32.341585 30825 leader_election.cc:336] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.342219 30825 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:32.344005 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.318553  2432 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:32.358816 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:32.356076 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:32.325279  2144 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:32.375412  2144 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:32.378935 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:32.380558 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:32.381309  2453 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:23:32.383569  1765 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.018s	sys 0.031s
W20260709 12:23:32.383994  1765 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.018s	sys 0.031s
W20260709 12:23:32.390506 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.391600  2454 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.392624  2454 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:32.503118 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.512405 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 132001us
W20260709 12:23:32.517037 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 204119us
W20260709 12:23:32.534211 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 219553us
I20260709 12:23:32.515071  2399 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:32.534318 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:32.515396  2428 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.518576  2422 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:32.522154  2174 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:32.543864 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 247488us
W20260709 12:23:32.554316 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 212789us
W20260709 12:23:32.561985 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.564926 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:32.544327  2347 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:32.569355 30825 leader_election.cc:336] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:32.569116 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 203822us
I20260709 12:23:32.538754  2348 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:23:32.548645  2174 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:32.561007  2266 consensus_queue.cc:1048] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 12:23:32.596133 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.596316  2464 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:23:32.598479  2461 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:23:32.561424  2399 consensus_queue.cc:1048] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:23:32.580552  2334 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.545423  2428 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:32.569033  2201 consensus_queue.cc:1048] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:23:32.606006 30858 raft_consensus.cc:2468] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:32.615257  2266 consensus_queue.cc:1048] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:32.617409  2431 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:32.636173  2431 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:32.608963  2347 consensus_queue.cc:1048] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:23:32.625909  2174 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:32.626108 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62781.2us
W20260709 12:23:32.640442 30825 leader_election.cc:336] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.640944 30825 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:32.642292 30825 leader_election.cc:336] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.642750 30825 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:32.643129  2478 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:32.644069  2478 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:32.629926  2469 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:32.551282  2422 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:32.631348 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 109795us
W20260709 12:23:32.645073 31476 leader_election.cc:336] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:32.644074 30825 leader_election.cc:336] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:32.657553 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.679423 30825 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:32.680152 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:32.645226 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:23:32.683856 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 105675us
I20260709 12:23:32.683532 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:32.691412 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.671624  2469 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:32.699491 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 55440.7us
W20260709 12:23:32.703877 30825 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.708588 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.689850  2204 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:32.702378  2399 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:32.721396  2399 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e7509fe1be74f179626fb4fcb4b4e65)
I20260709 12:23:32.730566  2399 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:32.722319  2431 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:32.723390  2479 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:23:32.723917  2466 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:23:32.721168  2471 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.706144  2469 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:32.742331  2471 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:32.748816  2422 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:32.749800  2462 log.cc:927] Time spent T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:23:32.750485  2428 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:32.744423  2467 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 12:23:32.773149 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.779975  2420 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:32.780690  2420 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:32.782325 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 78489.3us
I20260709 12:23:32.783428  2296 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:32.784029  2296 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:32.783449 30825 leader_election.cc:336] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.788036 30825 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:32.791836 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:32.792498 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.793255 30933 raft_consensus.cc:2368] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:32.793408 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.794106  2225 raft_consensus.cc:2749] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:32.794380 30930 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:32.794438 30928 raft_consensus.cc:2368] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:32.795657 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.796880 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:32.789489 30825 leader_election.cc:336] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.797966 30825 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:32.798383  2296 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:32.799294 30931 raft_consensus.cc:1240] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:32.799764  2478 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:32.801088 30825 leader_election.cc:336] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.802493 30825 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:32.804369  2473 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:32.805184 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:32.805598  2458 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
W20260709 12:23:32.806751 30825 leader_election.cc:336] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:32.808115 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:32.809293 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.810316 30933 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
W20260709 12:23:32.810413 31476 leader_election.cc:336] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.812038 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.807744 30825 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:32.812945 30931 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 11.
I20260709 12:23:32.820809 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.822219 30927 raft_consensus.cc:1275] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:23:32.823768  2465 log.cc:927] Time spent T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:23:32.831629 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.835588 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.854369 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:32.863119 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.868386 30931 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:32.872388 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.875120 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.875379 30931 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:32.876466 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:32.880812 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 51664.7us
I20260709 12:23:32.886507 30927 raft_consensus.cc:1240] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:32.894225 30930 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:32.884217  2485 raft_consensus.cc:493] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:32.906437 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.906867  2485 raft_consensus.cc:515] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:32.907577 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.908237 30929 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:32.908795 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.909322 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.911074 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
W20260709 12:23:32.911463 30750 connection.cc:256] RPC call timeout handler was delayed by -3.8528286529999605s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:23:32.912863 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:32.913460 31506 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 15 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:32.914472 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:32.914824 30931 raft_consensus.cc:1240] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:32.909366  2485 leader_election.cc:290] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:32.915727 30927 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:32.915972 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.918042 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.890756  2470 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.960867 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.925222 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.961617 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.962016 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:32.934008 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:32.936770  2420 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:32.964986 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.971691 30928 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:32.971989 30926 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:32.973392 30926 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:32.971711 30934 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:23:32.940186  2469 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:32.941399 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 134694us
W20260709 12:23:32.982033 30825 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:32.982533 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:32.882557  2471 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329)
I20260709 12:23:32.959056 30932 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:23:32.956287 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:32.930748 30679 catalog_manager.cc:5697] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 2 to 10, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 10 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:32.985283 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 675245us
I20260709 12:23:32.963186 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:32.973649 30928 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:23:32.978411 30934 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:23:32.984002 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:32.995223 30926 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:32.997538 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 308119us
W20260709 12:23:32.998381 30899 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:33.002442 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 46275.7us
I20260709 12:23:33.005456 30934 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 12. Ops: []
I20260709 12:23:33.008034 30930 raft_consensus.cc:1275] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:23:33.010282 30826 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:33.001416 30899 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:33.014917 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:32.997123  2478 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:32.997035  2119 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:33.023993 30935 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:33.024506 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:33.028643 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.031730 30750 leader_election.cc:400] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:33.032258 30750 leader_election.cc:403] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:23:33.033951 30825 leader_election.cc:336] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.034869 31510 raft_consensus.cc:1275] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:23:33.012676  2470 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:33.020784  2485 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:33.051888 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:33.053156  2469 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:33.054728 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:33.051111 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:33.067225 30825 leader_election.cc:336] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.067978 30825 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:33.037353  2470 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:33.024899  2483 consensus_queue.cc:1048] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:23:33.075481  2416 consensus_queue.cc:1059] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:33.078253  2478 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:33.059015  2119 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.080024 30750 leader_election.cc:400] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:33.085352 30750 leader_election.cc:403] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:23:33.082437 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 118401us
I20260709 12:23:33.074393  2470 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:33.087976 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:33.093973 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.097357  2484 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 12:23:33.099653 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.104600  2399 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:33.092501 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.088977 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:33.107793 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.093729  2416 consensus_queue.cc:1243] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:33.112227  2428 consensus_queue.cc:1048] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:33.112455  2416 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.118003  2370 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:33.122864  2416 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:33.126700  2471 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.127457  2471 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:33.130111  2471 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:33.140974  2399 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:33.141155  2139 raft_consensus.cc:3055] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:33.141614  2139 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:33.141736 30928 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:33.142524  2139 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:33.143757  2139 raft_consensus.cc:3060] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:33.149266 30857 raft_consensus.cc:1275] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:33.150625 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:33.151481 30860 raft_consensus.cc:3060] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:23:33.157951 30825 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:33.159226 30825 leader_election.cc:336] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.159682 30825 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:33.160666 30856 raft_consensus.cc:1275] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:33.161441  2485 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:33.162715 30825 leader_election.cc:336] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.173116 30825 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:33.177856 30932 raft_consensus.cc:2468] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 15.
I20260709 12:23:33.179121 30927 raft_consensus.cc:1240] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 14. Current term is 15. Ops: []
I20260709 12:23:33.182961  2491 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:33.183383 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:33.183009 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 184664us
W20260709 12:23:33.184741 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.185292 30899 leader_election.cc:336] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.187667 30900 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:33.188469  2436 consensus_queue.cc:1048] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:33.191668 30679 catalog_manager.cc:5697] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 4 to 7, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 7 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.204900 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49daeb92ae08415eb56869e7df8fc686" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:33.194049  2489 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:33.181564  2119 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729) with higher term. Message: Invalid argument: T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:33.209300  2399 raft_consensus.cc:2804] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:33.209997  2399 raft_consensus.cc:697] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:33.210355 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 47631.8us
W20260709 12:23:33.211097 30825 leader_election.cc:336] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.210920  2399 consensus_queue.cc:237] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:33.211547 30825 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:33.221534 30860 raft_consensus.cc:2468] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:33.227378 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:33.250152 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:33.219194  2431 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:33.218148  2119 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:33.262543 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 51469.3us
W20260709 12:23:33.266270 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.261080  2478 raft_consensus.cc:2749] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.267598  2469 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.277005 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:33.286093 30860 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:33.265673  2119 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:33.333269 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 259430us
I20260709 12:23:33.349151 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:33.319249  2469 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:33.343750  2436 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.374101 30826 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:33.385901 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.389561 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.341952  2470 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:33.400300 30899 leader_election.cc:336] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.402552  2349 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:33.403187  2349 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:33.403868 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.406055  2349 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:33.409168 30851 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:33.379266  2435 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.410619  2470 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:33.410903  2435 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:33.413146 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:33.413365 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:33.413916 30859 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:33.418292  2334 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:33.401875 30899 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:33.429386 30899 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:33.395586 30860 raft_consensus.cc:2468] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:33.431392 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:33.432979 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:33.435009 30900 leader_election.cc:304] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:33.436064  2434 consensus_queue.cc:1048] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:33.436553 30900 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:33.437914  2489 consensus_queue.cc:1048] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:33.439790  2489 raft_consensus.cc:2749] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:33.440639  2489 raft_consensus.cc:2804] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:33.441212  2489 raft_consensus.cc:697] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:33.442764 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:33.454573 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 190937us
W20260709 12:23:33.456401 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.393959  2416 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:23:33.462795 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 348502us
I20260709 12:23:33.380223  2436 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:33.480554 30679 catalog_manager.cc:5697] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 6 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:33.463724  2416 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:33.481920  2349 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.528802 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:33.515885  2489 consensus_queue.cc:237] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:33.516305  2416 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:33.557997  2496 consensus_queue.cc:1059] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:33.565811 30859 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 13.
W20260709 12:23:33.575194 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.512460  2471 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:33.512162  2491 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:33.506086  2370 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:23:33.655880 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:33.607775  2119 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:33.693938 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 320295us
W20260709 12:23:33.703163 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.621742  2471 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:33.728885 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.704913  2119 consensus_queue.cc:1059] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:23:33.745108 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 302407us
I20260709 12:23:33.744050 30856 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 11.
I20260709 12:23:33.755542 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:33.765182 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 206999us
W20260709 12:23:33.783191 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.793529  2502 log.cc:927] Time spent T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:23:33.822784 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 67344.6us
I20260709 12:23:33.739641  2469 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:33.755442  2494 log.cc:927] Time spent T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.344s	user 0.001s	sys 0.001s
I20260709 12:23:33.765440  2435 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:33.825868  2481 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:23:33.844591 30900 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:33.849153 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 447275us
I20260709 12:23:33.851970 30851 raft_consensus.cc:1275] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:23:33.826998  2347 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:33.843011  2436 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:33.859098  2496 consensus_queue.cc:1243] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:33.868412  2349 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.868923  2421 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:33.904992 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 177394us
W20260709 12:23:33.910574 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:33.909104  2504 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:23:33.900215  2496 raft_consensus.cc:3055] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:33.915697  2499 log.cc:927] Time spent T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 12:23:33.938045 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 192913us
W20260709 12:23:33.994129 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 81356.4us
I20260709 12:23:33.905450  2349 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:33.972007 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.909658  2421 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:33.958374  2498 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
W20260709 12:23:33.948143  2139 consensus_meta.cc:287] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.772s	user 0.011s	sys 0.005s
I20260709 12:23:33.946313  2496 raft_consensus.cc:740] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:34.010474 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:33.993422  2119 consensus_queue.cc:1243] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:34.018425 31477 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:34.005460  2504 log.cc:927] Time spent T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:23:34.013607  2508 log.cc:927] Time spent T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 12:23:34.021934 30897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.016s
W20260709 12:23:34.027627 30897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.007s	sys 0.016s
W20260709 12:23:34.022611  2500 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 12:23:34.023303  2510 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 12:23:34.042142  2537 consensus_queue.cc:1059] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:34.043525  2537 consensus_queue.cc:1059] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:34.042030  2536 consensus_queue.cc:1059] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:34.044761  2536 consensus_queue.cc:1243] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:23:34.045305  2536 raft_consensus.cc:3055] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:34.045660  2536 raft_consensus.cc:740] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.016295  2137 raft_consensus.cc:2804] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:34.046581  2536 consensus_queue.cc:260] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.053643  2536 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:34.054936  2421 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:34.036191  2503 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
W20260709 12:23:33.999555  2509 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 12:23:34.001003  2530 consensus_queue.cc:1059] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:34.020216  2471 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:33.924603  2513 consensus_queue.cc:1059] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:23:34.030512  2119 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.063706  2473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.002s	sys 0.013s
W20260709 12:23:34.064764  2516 log.cc:927] Time spent T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:23:34.085711  2517 log.cc:927] Time spent T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:23:34.086597  2514 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:23:34.087435  2497 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:34.089241  2501 log.cc:927] Time spent T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.394s	user 0.000s	sys 0.006s
W20260709 12:23:34.091727 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 89401us
I20260709 12:23:34.063153  2495 raft_consensus.cc:2804] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:23:34.077665  2137 raft_consensus.cc:697] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:34.090521  2530 consensus_queue.cc:1243] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.096403  2497 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:34.084062  2119 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.117303  2495 raft_consensus.cc:697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 15 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:34.125157  2530 raft_consensus.cc:3055] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:23:34.167985 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 140781us
I20260709 12:23:34.165529  2513 consensus_queue.cc:1243] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:34.169327  2543 raft_consensus.cc:3055] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:34.184305  2548 consensus_queue.cc:1059] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:34.185285  2548 consensus_queue.cc:1243] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.111407  2496 consensus_queue.cc:260] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:34.169139  2530 raft_consensus.cc:740] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.186153  2534 raft_consensus.cc:3055] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:34.187770  2534 raft_consensus.cc:740] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.188596  2534 consensus_queue.cc:260] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.181895  2543 raft_consensus.cc:740] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.191198  2543 consensus_queue.cc:260] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.192582  2543 raft_consensus.cc:3060] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:34.202158 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.206183 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:23:34.208456 30857 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1809) took 1049 ms. Trace:
I20260709 12:23:34.209007 30857 rpcz_store.cc:276] 0709 12:23:33.159323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.168974 (+  9651us) service_pool.cc:224] Handling call
0709 12:23:33.169352 (+   378us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:23:33.169811 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:33.169841 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:23:33.170502 (+   661us) log.cc:844] Serialized 78 byte log entry
0709 12:23:33.348000 (+177498us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:33.610260 (+262260us) log.cc:844] Serialized 14 byte log entry
0709 12:23:33.610507 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.610585 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.088408 (+477823us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:34.200621 (+112213us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18000f55c0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:34.208131 (+  7510us) raft_consensus.cc:1685] finished
0709 12:23:34.208161 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.208375 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15966,"prepare.queue_time_us":242310,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":55078,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":32268,"spinlock_wait_cycles":39440128,"thread_start_us":428195,"threads_started":2,"wal-append.queue_time_us":419624}
I20260709 12:23:34.214903  2119 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:34.215939 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.240062 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.218593  2495 consensus_queue.cc:237] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:34.224995  2349 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:34.226780  2538 log.cc:927] Time spent T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:34.227265  2540 consensus_queue.cc:1059] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
W20260709 12:23:34.241310 30680 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48042 (request call id 179) took 18094 ms (client timeout 15000 ms). Trace:
I20260709 12:23:34.241545  2540 consensus_queue.cc:1243] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:23:34.228725  2496 raft_consensus.cc:3060] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:34.233165  2503 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.177s	user 0.001s	sys 0.002s
W20260709 12:23:34.233695 30899 leader_election.cc:336] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:34.234007  2513 raft_consensus.cc:3055] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:34.234058  2139 raft_consensus.cc:3055] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:34.248075  2513 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:34.248281 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.186735  2137 consensus_queue.cc:237] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:34.241750 30680 rpcz_store.cc:269] 0709 12:23:16.146551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:16.174057 (+ 27506us) service_pool.cc:224] Handling call
0709 12:23:17.021109 (+847052us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610989090 00007f9610a27f3a 00007f96167dde9c 00007f96168dc04e 00007f9614d9d2a4 00007f9614d9d232 00007f9614d9d161 00007f9614d9d0dc 00007f9614d9c392 00007f960ed5a48c 00007f960ed598c6
0709 12:23:34.241019 (+17219910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:29.974230 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:29.975055 (+   825us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:29.975108 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:23:29.975136 (+    28us) tablet.cc:662] Decoding operations
0709 12:23:29.983378 (+  8242us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:29.983489 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:29.983532 (+    43us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:23:29.985573 (+  2041us) tablet.cc:701] Row locks acquired
0709 12:23:29.985594 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:23:29.985836 (+   242us) write_op.cc:270] Start()
0709 12:23:29.985991 (+   155us) write_op.cc:276] Timestamp: P: 1783599809985735 usec, L: 0
0709 12:23:29.986015 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:29.986992 (+   977us) log.cc:844] Serialized 7908 byte log entry
0709 12:23:30.675393 (+688401us) op_driver.cc:464] REPLICATION: finished
0709 12:23:31.164360 (+488967us) write_op.cc:301] APPLY: starting
0709 12:23:31.175178 (+ 10818us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:31.222593 (+ 47415us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:31.222752 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:31.376461 (+153709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:31.377129 (+   668us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:23:31.377174 (+    45us) write_op.cc:312] APPLY: finished
0709 12:23:31.377839 (+   665us) log.cc:844] Serialized 138 byte log entry
0709 12:23:31.378082 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:31.378514 (+   432us) write_op.cc:454] Released schema lock
0709 12:23:31.378613 (+    99us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:31.379125 (+   512us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:31.379166 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":589267,"reported_tablets":52,"spinlock_wait_cycles":249053568,"child_traces":[["op",{"apply.queue_time_us":458720,"apply.run_cpu_time_us":10398,"apply.run_wall_time_us":230616,"num_ops":20,"prepare.queue_time_us":142500,"prepare.run_cpu_time_us":17312,"prepare.run_wall_time_us":49721,"raft.queue_time_us":266244,"raft.run_cpu_time_us":48432,"raft.run_wall_time_us":330984,"replication_time_us":689167,"thread_start_us":752172,"threads_started":4,"wal-append.queue_time_us":87322,"wal-append.run_cpu_time_us":40039,"wal-append.run_wall_time_us":2304484}]]}
I20260709 12:23:34.235467  2530 consensus_queue.cc:260] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.254379  2530 raft_consensus.cc:3060] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.238204 30679 catalog_manager.cc:5697] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 6 to 9, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 9 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:34.256042 30679 catalog_manager.cc:5697] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 4 to 7, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 7 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:34.259289 30899 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:34.248196  2139 raft_consensus.cc:740] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.265514  2139 consensus_queue.cc:260] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.266728  2139 raft_consensus.cc:3060] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:34.266871 30679 catalog_manager.cc:5697] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:34.268345 30679 catalog_manager.cc:5697] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 1 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:34.234827  2416 consensus_meta.cc:287] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.005s
I20260709 12:23:34.270025  2416 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.270228 30679 catalog_manager.cc:5697] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 5 to 7, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 7 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:34.272316  2416 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:34.259429 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1813) took 1078 ms. Trace:
W20260709 12:23:34.260690 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.273015 30852 rpcz_store.cc:276] 0709 12:23:33.181006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.181160 (+   154us) service_pool.cc:224] Handling call
0709 12:23:33.182287 (+  1127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.194895 (+ 12608us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:23:33.207132 (+ 12237us) log.cc:844] Serialized 14 byte log entry
0709 12:23:33.397164 (+190032us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b1800440fe0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f96148f358f 00007f960d932571 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd
0709 12:23:33.704652 (+307488us) log.cc:844] Serialized 14 byte log entry
0709 12:23:33.711137 (+  6485us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:33.711655 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:23:33.790948 (+ 79293us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b1800440fe0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f96105d5d70 00007f96105c9293 00007f96105becea 00007f96105bf0d1 00007f96109daa0f 00007f9610996621 00007f9610a1f92b
0709 12:23:33.791179 (+   231us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:33.791221 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:33.791298 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.232842 (+441544us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b2400297f68. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d7b89c4 00007f960d7b6acb 00007f960d971dc9 00007f960d971a55 00007f960d97109d 00007f96105a310e 00007f96105ba88c 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221
0709 12:23:34.259175 (+ 26333us) raft_consensus.cc:1685] finished
0709 12:23:34.259196 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.259343 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55283,"prepare.queue_time_us":383058,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":82541,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":30268,"spinlock_wait_cycles":25124352,"thread_start_us":481787,"threads_started":2,"wal-append.queue_time_us":488693}
I20260709 12:23:34.189678  2534 raft_consensus.cc:3060] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:23:34.276651 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.249128  2513 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:34.287346 30899 leader_election.cc:336] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:34.293941  2416 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.294687  2416 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:34.301231 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.303479  2416 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:34.304389 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 177604us
I20260709 12:23:34.308774  2537 raft_consensus.cc:3055] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:34.309229  2537 raft_consensus.cc:740] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.310576  2537 consensus_queue.cc:260] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.311939  2537 raft_consensus.cc:3060] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:23:34.320890 30899 leader_election.cc:336] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:34.321867 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.271795 30679 catalog_manager.cc:5697] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 5 to 8, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:34.340299  2530 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:34.341634 30679 catalog_manager.cc:5697] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.342670  2530 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:34.344992  2530 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:34.345512  2534 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:34.346167  2534 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:34.348413  2534 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:34.346629  2528 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:34.349428  2548 consensus_queue.cc:1059] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:34.349725  2528 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.350683  2548 consensus_queue.cc:1059] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:34.351366  2548 consensus_queue.cc:1243] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:23:34.351959  2496 raft_consensus.cc:3055] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:34.352361  2496 raft_consensus.cc:740] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.352639  2528 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:34.353246  2496 consensus_queue.cc:260] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.354674  2496 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:34.326401  2416 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:34.358531  2139 consensus_queue.cc:1059] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:23:34.379938 30679 catalog_manager.cc:5697] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:34.390079 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.388527  2537 consensus_queue.cc:1059] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:23:34.388623 30899 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:34.395411 30899 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:34.396205 30899 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:34.399411  2540 consensus_queue.cc:1059] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:34.400367  2540 consensus_queue.cc:1243] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:34.400980  2540 raft_consensus.cc:3055] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:34.401432  2540 raft_consensus.cc:740] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:34.403330 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 633190us
I20260709 12:23:34.405957  2543 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.406685  2543 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.400382  2496 consensus_queue.cc:1059] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:23:34.409237  2543 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:34.414798 30860 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1825) took 1078 ms. Trace:
I20260709 12:23:34.415336 30860 rpcz_store.cc:276] 0709 12:23:33.336775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.507780 (+171005us) service_pool.cc:224] Handling call
0709 12:23:33.550972 (+ 43192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:33.551277 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:23:33.843826 (+292549us) log.cc:844] Serialized 14 byte log entry
0709 12:23:34.414352 (+570526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.414421 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:23:34.414478 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.414559 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.414713 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":471818,"prepare.queue_time_us":345719,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4274,"thread_start_us":372328,"threads_started":2,"wal-append.queue_time_us":288066}
I20260709 12:23:34.417076 30858 raft_consensus.cc:1217] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:23:34.417634 30858 raft_consensus.cc:1240] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:23:34.418221 30857 raft_consensus.cc:1240] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:34.417654 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ad2fde72a4917a713ec09d50d16ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.419591 30853 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 12. Ops: [10.7-10.7]
I20260709 12:23:34.420876 30855 raft_consensus.cc:1240] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: []
I20260709 12:23:34.421957 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1812) took 1253 ms. Trace:
I20260709 12:23:34.422340 30854 rpcz_store.cc:276] 0709 12:23:33.168704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.171052 (+  2348us) service_pool.cc:224] Handling call
0709 12:23:33.193782 (+ 22730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:33.217401 (+ 23619us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:23:33.344515 (+127114us) log.cc:844] Serialized 14 byte log entry
0709 12:23:33.827974 (+483459us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b180015ef20. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d9323f3 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:34.389060 (+561086us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:34.389603 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:23:34.389796 (+   193us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:23:34.389835 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.389907 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:34.421652 (+ 31745us) raft_consensus.cc:1685] finished
0709 12:23:34.421771 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.421901 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":793834,"prepare.queue_time_us":40582,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2356,"raft.queue_time_us":660103,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":17288,"spinlock_wait_cycles":16242304,"thread_start_us":476994,"threads_started":2,"wal-append.queue_time_us":629114}
I20260709 12:23:34.424286  2471 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:34.424486  2416 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:34.424979  2471 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.427443  2471 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:34.394482 30679 catalog_manager.cc:5697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 reported cstate change: term changed from 6 to 8, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 8 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.366290  2530 raft_consensus.cc:3055] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:34.417711 30860 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:34.405673 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:34.431370 30859 raft_consensus.cc:1240] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.431591 30858 raft_consensus.cc:1240] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:23:34.433490 30856 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:23:34.435464 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.438809 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.443248 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.443523 30859 raft_consensus.cc:1217] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-8.5]   Dedup: 8.5->[]
I20260709 12:23:34.444272 30859 raft_consensus.cc:1240] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 12:23:34.361725  2547 raft_consensus.cc:3055] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:34.447212 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:34.457474 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 59697.3us
I20260709 12:23:34.458326 30854 raft_consensus.cc:1217] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 6.3->[8.4-11.6]   Dedup: 11.6->[]
I20260709 12:23:34.458921 30854 raft_consensus.cc:1240] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: [8.4-11.6]
I20260709 12:23:34.460084 30860 raft_consensus.cc:1240] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.463488 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:34.464781 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:34.465704 30858 raft_consensus.cc:1240] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.466676 30935 raft_consensus.cc:1217] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Deduplicated request from leader. Original: 8.4->[10.5-10.5]   Dedup: 10.5->[]
I20260709 12:23:34.467139 30935 raft_consensus.cc:1240] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:23:34.468324 30855 raft_consensus.cc:1240] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: []
I20260709 12:23:34.462621 30900 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:34.465734 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:34.464794 31510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:34.475593 31509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:34.477384 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:34.402519  2540 consensus_queue.cc:260] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.429659  2139 consensus_queue.cc:1243] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer 47c0d0bc235a443aad3c62643e91b081 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:23:34.409221  2496 raft_consensus.cc:3055] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:23:34.481992 30933 raft_consensus.cc:2393] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 11: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:34.486151 30860 raft_consensus.cc:1240] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:34.483071 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 162709us
I20260709 12:23:34.440320  2530 raft_consensus.cc:740] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.446130  2527 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.489210 30931 raft_consensus.cc:1275] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:23:34.457221  2367 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.389052  2534 consensus_queue.cc:1059] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:23:34.390259  2536 consensus_queue.cc:1059] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:23:34.456928  2547 raft_consensus.cc:740] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.493216 30860 raft_consensus.cc:1240] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:23:34.497017 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.508538 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:34.508942 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:34.483354  2496 raft_consensus.cc:740] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.487959  2491 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:23:34.529596 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.536607 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:34.545853 30860 raft_consensus.cc:2368] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:34.547802 30859 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:34.553148 30929 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 9.
W20260709 12:23:34.572214 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.582894 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:34.524199  2534 raft_consensus.cc:3055] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:34.492405  2527 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.626456 30860 raft_consensus.cc:1240] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
I20260709 12:23:34.639860 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41694 (request call id 594) took 1140 ms. Trace:
I20260709 12:23:34.640508 30851 rpcz_store.cc:276] 0709 12:23:33.499021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:33.867511 (+368490us) service_pool.cc:224] Handling call
0709 12:23:34.432467 (+564956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:34.432656 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:34.432684 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:34.432734 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:34.432769 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:34.432828 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:34.639604 (+206776us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54004367d0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:34.639760 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271205248}
I20260709 12:23:34.599380  2491 raft_consensus.cc:697] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 13 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:34.522051  2518 consensus_queue.cc:1048] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 12:23:34.605181  2367 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:34.603679  2416 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:34.620230  2225 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.663949  2225 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.666805 30860 raft_consensus.cc:1240] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 11. Ops: []
I20260709 12:23:34.621068  2534 raft_consensus.cc:740] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.642539  2530 consensus_queue.cc:260] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.642773  2496 consensus_queue.cc:260] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:34.675141  2491 consensus_queue.cc:237] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.675738  2513 raft_consensus.cc:3060] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:34.677568  2119 raft_consensus.cc:3055] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:34.678040  2119 raft_consensus.cc:740] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:34.686214 30860 raft_consensus.cc:1240] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 11. Ops: []
W20260709 12:23:34.685999 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 210098us
I20260709 12:23:34.689116 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:34.602308  2540 raft_consensus.cc:3060] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:34.675935  2496 raft_consensus.cc:3060] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:23:34.703017 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.615280  2547 consensus_queue.cc:260] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.693895  2431 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.693997  2548 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.721341 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 46886.3us
I20260709 12:23:34.685067  2367 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.742666 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:34.738992 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.703604  2483 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:34.745739 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.748325 30851 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
W20260709 12:23:34.752985 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.767928 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.768105 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.768653 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.772101 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.773900 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.738286 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.731376  2225 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:34.785588 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:34.806619  2551 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:23:34.810112  2225 consensus_queue.cc:1048] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:34.815619 30826 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:34.816848  2478 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:34.819003  2497 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:34.820966  2497 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.825843  2416 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.826779  2416 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:34.831928 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:34.835494 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.842518 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.846122 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.847070 30854 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 7.
I20260709 12:23:34.733784  2548 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.851986 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.737797  2431 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:34.869125 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 223914us
I20260709 12:23:34.730830  2534 consensus_queue.cc:260] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.757933  2119 consensus_queue.cc:260] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.913403 30931 raft_consensus.cc:1275] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:23:34.758473  2483 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:34.915621 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.916411 30854 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:34.921106  2431 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:34.921844  2557 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:34.922362  2557 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:34.922724  2557 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:34.922618 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:34.923413 30854 raft_consensus.cc:2368] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:34.925454 30854 raft_consensus.cc:1275] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:34.882095  2536 raft_consensus.cc:493] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:34.935642 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:34.937033 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 194541us
W20260709 12:23:34.946259 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:34.952229 30854 raft_consensus.cc:1275] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:23:34.960141 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:34.960410 30857 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:23:34.936439  2534 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.935814  2555 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.965005 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:34.982251 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:34.985991 30854 raft_consensus.cc:2393] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:34.987206 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:34.987932 30854 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:34.955667  2561 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:34.959169  2416 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:35.009789 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.004541 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:34.958192  2380 consensus_queue.cc:1048] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 12:23:35.021854 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.024705 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.025707 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:34.962662  2536 raft_consensus.cc:515] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:35.039275 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:35.013985  2367 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.040971 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.039521 30932 raft_consensus.cc:1240] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 10. Current term is 12. Ops: []
I20260709 12:23:35.046909 30854 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 13.
I20260709 12:23:35.048892 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.008481  2483 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.049688 30933 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:35.057628 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.034869  2416 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:35.066170 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 84853us
I20260709 12:23:35.070065 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:35.071229 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:35.072902 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:34.984725  2555 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.073132 30900 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:35.012553  2561 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:35.077600 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.229403 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:23:35.191262 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.172931 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:35.093570 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.086829 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.263123 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 235209us
W20260709 12:23:35.272617 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 185844us
I20260709 12:23:35.163676  2536 leader_election.cc:290] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:35.179859  2513 consensus_meta.cc:287] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.000s
W20260709 12:23:35.128499  2559 log.cc:927] Time spent T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:23:35.275164  2137 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:23:35.217604  2540 consensus_meta.cc:287] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.001s
I20260709 12:23:35.264060 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.184520 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.191507 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.274930 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:35.281944 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.095840 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.162699  2578 log.cc:927] Time spent T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.093s	user 0.000s	sys 0.003s
I20260709 12:23:35.230918  2547 raft_consensus.cc:3060] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:35.303053 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.304291 30858 raft_consensus.cc:2393] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:35.305164 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.177644 30670 maintenance_manager.cc:419] P ed644613a0604f0ca9abeda3653f0a2f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033365
I20260709 12:23:35.338640  2561 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.130326  2543 raft_consensus.cc:3055] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:23:35.339222 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.308655 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.172420  2527 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.222182  2530 raft_consensus.cc:3060] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:35.310562 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.310753  2522 raft_consensus.cc:493] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:35.311621  2225 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:35.311470 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.085613 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:35.354921 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.312172  2367 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:35.315264 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.317463 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.318887  2555 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.321452 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:35.330883  2571 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 12:23:35.231616  2537 raft_consensus.cc:3055] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:23:35.333645  2119 raft_consensus.cc:3060] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:35.335044 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 52820.6us
I20260709 12:23:35.335134 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:35.336018  2590 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:23:35.335805 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.123061  2472 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:35.368454 30750 leader_election.cc:336] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Timed out: RequestConsensusVote RPC to 127.28.234.66:33903 timed out after 1.821s (SENT)
I20260709 12:23:35.338442 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.339417  2543 raft_consensus.cc:740] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:35.295346  2137 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.338826 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.222813  2557 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:35.310273 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.371381 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 61173.3us
W20260709 12:23:35.345992 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.189838  2548 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.275277  2420 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:35.363476  2537 raft_consensus.cc:740] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:35.349040 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.346459  2534 raft_consensus.cc:493] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.365420 30930 raft_consensus.cc:2410] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:23:35.367971 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.336796 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.309346 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.359128  2225 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:35.348368 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.397415 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.372907  2137 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:35.379714 29609 tablet_replica.cc:333] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
W20260709 12:23:35.380036 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 306962us
I20260709 12:23:35.400537 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.403518 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:35.384276 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.370232 30750 leader_election.cc:304] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.389343 30854 raft_consensus.cc:1240] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12. Ops: []
W20260709 12:23:35.405418 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.362402  2367 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.389216  2543 consensus_queue.cc:260] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.413295 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.406317  2548 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:35.394366  2579 log.cc:927] Time spent T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 12:23:35.356294  2522 raft_consensus.cc:515] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.412122  2367 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:35.417459 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.419368 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.395905  2534 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.419875  2420 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:35.433924 30899 leader_election.cc:336] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.419952  2548 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.421139  2557 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:35.420550  2537 consensus_queue.cc:260] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.378556  2472 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.421592  2555 raft_consensus.cc:2749] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:35.422870  2225 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:35.458412 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 55042.3us
I20260709 12:23:35.424122 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.434062  2420 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:35.435905 30899 leader_election.cc:336] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.463235 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.439244 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.464463 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.464916 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.446342 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 80692.3us
I20260709 12:23:35.413329  2543 raft_consensus.cc:3060] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:23:35.456267 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.457815  2537 raft_consensus.cc:3060] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:23:35.427803 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.468808 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 96659.1us
W20260709 12:23:35.469648 30825 leader_election.cc:336] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.470233 30825 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.471695 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.491151 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 
I20260709 12:23:35.463614  2420 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:35.499078 29609 raft_consensus.cc:2243] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.462257  2520 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:23:35.505400 30825 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.505970 30825 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.513072  2513 consensus_queue.cc:1059] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 12:23:35.516791 30825 leader_election.cc:336] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.517341 30825 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:35.518114  2573 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.381s	user 0.003s	sys 0.000s
I20260709 12:23:35.518608 30852 raft_consensus.cc:1217] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 7.5->[8.6-9.7]   Dedup: 8.6->[9.7-9.7]
I20260709 12:23:35.519168 30852 raft_consensus.cc:1240] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [8.6-9.7]
W20260709 12:23:35.518649 30825 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.521078 30825 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.521466 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.478284  2555 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:35.524194 30825 leader_election.cc:336] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.524674 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.525457 30825 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.524549 29609 raft_consensus.cc:2272] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.526836 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:35.525982 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cf061659071464dadafceeb712b1c5d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:35.528671 30825 leader_election.cc:336] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.537307 30825 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.503762  2540 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:23:35.526149 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 56020.7us
I20260709 12:23:35.511904  2520 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:35.544245 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.544473 30931 raft_consensus.cc:1217] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Deduplicated request from leader. Original: 7.5->[8.6-8.6]   Dedup: 8.6->[]
W20260709 12:23:35.544955 30825 leader_election.cc:336] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.545225 30931 raft_consensus.cc:1240] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:23:35.545635 30825 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:35.546676 30899 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.547202 30899 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:35.543924 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.469208  2570 consensus_queue.cc:1048] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:23:35.551106 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.527316  2225 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:35.523746  2367 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:23:35.560700 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.536587  2485 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:35.547546  2431 raft_consensus.cc:2749] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:35.537317  2594 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:35.553423  2471 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:35.548581  2520 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.553234  2478 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:35.559578  2572 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.553303  2540 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
W20260709 12:23:35.584208 30825 leader_election.cc:336] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.563289  2491 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.584694 30825 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.510416  2587 consensus_queue.cc:1048] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:23:35.568487  2485 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.591284  2485 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.567157  2513 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.566710 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
W20260709 12:23:35.593559 30825 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.596042 30825 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.599797 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.600414 30825 leader_election.cc:336] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.600797 30825 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.601002  2137 raft_consensus.cc:515] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.601598  2478 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:35.601998 30825 leader_election.cc:336] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.602468 30825 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.603261  2478 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.612121  2513 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:35.620345 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.625056 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.633749 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.634788 30860 raft_consensus.cc:2410] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:23:35.594959  2485 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.638304 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.638695 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.633824  2522 leader_election.cc:290] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.640455 30857 raft_consensus.cc:2410] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:23:35.640995 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.641342 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.642104 30853 raft_consensus.cc:2368] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
W20260709 12:23:35.642743  2584 log.cc:927] Time spent T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.479s	user 0.000s	sys 0.004s
I20260709 12:23:35.644999  2137 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:35.645987 30933 raft_consensus.cc:1240] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:23:35.591341  2540 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:35.661197 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.661895 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:35.662717 31476 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.663709 29609 tablet_replica.cc:333] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:35.664673 29609 raft_consensus.cc:2243] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.665194 29609 raft_consensus.cc:2272] T 2d2b1416a04848d99913731a9259dc8e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.668735 30860 raft_consensus.cc:2393] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 9: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
W20260709 12:23:35.669492 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:35.631618  2472 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:35.672678 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.675817 30825 leader_election.cc:336] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.678233 29609 tablet_replica.cc:333] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
W20260709 12:23:35.678678 30748 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.679453  2420 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.680169  2119 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.681973 30825 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.684954 30859 raft_consensus.cc:1275] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:35.686614 30853 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:35.688190  2119 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:35.687903 30825 leader_election.cc:336] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.690904 30825 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.691967 29609 raft_consensus.cc:2243] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.694725 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:35.698355 30899 leader_election.cc:336] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.674887  2534 leader_election.cc:290] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.711771  2420 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:35.739943 30825 leader_election.cc:336] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.740654 30825 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:35.746483 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.751622 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 50166.7us
W20260709 12:23:35.752736 30825 leader_election.cc:336] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.753108 30900 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.753311 30825 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.756465  2542 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.756906 29609 pending_rounds.cc:70] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:35.757251 29609 pending_rounds.cc:77] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7305624783920128000 op_type: NO_OP noop_request { }
I20260709 12:23:35.757683 29609 raft_consensus.cc:2889] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:35.758023 29609 raft_consensus.cc:2272] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.758641  2483 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:35.759881 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:35.760591  2599 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:35.762318  2568 consensus_queue.cc:1048] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:35.763871  2568 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:35.764765  2539 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.768286  2491 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:35.768850  2491 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:35.776638  2548 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.689616  2518 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:35.777730  2518 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:35.778595  2568 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:35.779007  2568 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:35.779167  2520 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.780179 29609 tablet_replica.cc:333] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:35.780346  2518 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:35.781213 29609 raft_consensus.cc:2243] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.781283  2520 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:35.782099 29609 raft_consensus.cc:2272] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:35.785678 30749 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.786146 30852 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42858 (request call id 1876) took 1081 ms. Trace:
I20260709 12:23:35.786698 30852 rpcz_store.cc:276] 0709 12:23:34.705334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.705528 (+   194us) service_pool.cc:224] Handling call
0709 12:23:35.518431 (+812903us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:35.519496 (+  1065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:35.785953 (+266457us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540003edd0. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610988571 00007f9610a1e8ad 00007f96159e3419 00007f960ef5abd4 00007f960ef5ab62 00007f960ef5aa91 00007f960ef5aa0c 00007f960ef59cc2 00007f960ed5a48c 00007f960ed598c6 00007f960ed5926f
0709 12:23:35.786090 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812319104}
I20260709 12:23:35.756927  2536 raft_consensus.cc:3055] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:35.789994  2536 raft_consensus.cc:740] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:35.790864  2536 consensus_queue.cc:260] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.792016  2536 raft_consensus.cc:3060] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:35.751672  2296 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.793751 29609 tablet_replica.cc:333] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:35.779958  2568 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.797241 29609 raft_consensus.cc:2243] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:35.800956 30899 leader_election.cc:336] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.802359 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 49669us
W20260709 12:23:35.809013 30825 leader_election.cc:336] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.809700 30825 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.810480  2522 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:35.810725 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.811160 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.811480 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.811815 30750 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.811703 30825 leader_election.cc:336] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.812470 30825 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.813251  2542 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:35.818166 30825 leader_election.cc:336] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.818671 30825 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.819515  2594 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:35.819458 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:35.821890 30825 leader_election.cc:336] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.822321 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.823565 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.824162 30853 raft_consensus.cc:3060] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:35.825089 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.825482 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.826133 30859 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:35.826910  2513 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.831832 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:35.832489 30851 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:35.833039 30682 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.835424 30682 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 5 to 9, VOTER 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) evicted. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.838130 30682 catalog_manager.cc:5697] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.841909  2497 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:35.842504  2497 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:35.848961 30859 raft_consensus.cc:2468] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
I20260709 12:23:35.853533 30682 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.854852 30853 raft_consensus.cc:2468] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 13.
I20260709 12:23:35.858129 30825 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:35.860014 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:35.860607 30825 leader_election.cc:336] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.869277 30750 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:35.869882 30825 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.870131 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:35.874351 30825 leader_election.cc:336] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.879856 30851 raft_consensus.cc:2468] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
W20260709 12:23:35.881984 30825 leader_election.cc:336] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.888127 30825 leader_election.cc:336] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.891840 29609 raft_consensus.cc:2272] T c86ad2fde72a4917a713ec09d50d16ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.889330 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.889478 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:35.901932 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:35.903128 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.869117  2594 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.905871  2540 raft_consensus.cc:3060] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:23:35.891737  2513 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:35.914455 29609 tablet_replica.cc:333] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:35.915401 29609 raft_consensus.cc:2243] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:35.922178  2491 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:35.871063  2497 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.930562  2568 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:23:35.934460 31476 leader_election.cc:336] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:35.933951 30899 leader_election.cc:336] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:35.936659 30900 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.934336 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:35.939991 29609 raft_consensus.cc:2272] T 91c561a0b4404fcb8adb9d2002e0c15d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:35.940935 30750 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.805389  2296 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.946108 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:35.948320 30900 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.946782 31507 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:35.952469 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:35.957652 30930 raft_consensus.cc:1240] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Rejecting Update request from peer 7857bffc34ce4e1db3617488701b9810 for earlier term 11. Current term is 12. Ops: []
I20260709 12:23:35.958920  2119 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:35.943041  2534 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:35.964128 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43064b77bf3a4ab5aa00dfd9ad2d31de" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:35.944911  2543 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:35.937614  2548 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.975792 30852 raft_consensus.cc:1275] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:35.970726 31477 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:35.937031  2592 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:35.943861  2513 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:35.973742 30900 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.982681  2532 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.917603  2540 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:35.949748  2576 raft_consensus.cc:2804] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:35.990157 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:35.991113 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 46400.6us
I20260709 12:23:35.993223 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:35.994637 30853 raft_consensus.cc:2393] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 in current term 12: Already voted for candidate 764ebfd36ce64b2a86e6d290ae92e276 in this term.
I20260709 12:23:35.995237 30900 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:35.995553 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.999176 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:35.992657 30750 leader_election.cc:400] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 11. Current term is 12.
I20260709 12:23:35.978653  2420 raft_consensus.cc:2804] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:36.003819 30750 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:35.997608  2119 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:23:36.066761 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 172141us
I20260709 12:23:36.002940  2543 raft_consensus.cc:493] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.999946  2525 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:36.015060  2497 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.080399  2296 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:36.003819  2576 raft_consensus.cc:697] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:36.091920  2576 consensus_queue.cc:237] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:36.004034  2422 raft_consensus.cc:2804] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:36.094092  2422 raft_consensus.cc:697] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:36.095118  2422 consensus_queue.cc:237] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:35.989022  2592 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:35.993098  2561 consensus_queue.cc:1059] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:23:36.100536  2561 raft_consensus.cc:3055] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:23:36.101047  2561 raft_consensus.cc:740] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
W20260709 12:23:36.101853 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 123926us
I20260709 12:23:36.102013  2561 consensus_queue.cc:260] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:36.102710 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:36.103261  2561 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:36.104249 30826 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:36.103797  2542 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:36.105060  2367 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.105882 29609 tablet_replica.cc:333] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:36.106843 29609 raft_consensus.cc:2243] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.090312  2534 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.108016  2534 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:36.008147  2537 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:36.110374 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.015779  2556 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:23:36.122653 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.127923 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.125516 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.126214 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.129221 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.129634 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.130915 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.131111 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.060034  2548 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.126084  2534 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:36.132354 30856 raft_consensus.cc:2393] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 13: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:36.128015 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.138121 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.133689 29609 raft_consensus.cc:2272] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:36.138393 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.138125 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.136706 30826 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:36.139950 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.086848  2540 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.149252 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.151423 30826 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:36.122483  2530 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.130957  2547 raft_consensus.cc:493] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.130511  2556 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:36.257575 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:36.257153 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 68227.9us
I20260709 12:23:36.133719  2431 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.136497  2537 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.111552  2543 raft_consensus.cc:515] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:36.264287  2612 log.cc:927] Time spent T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:23:36.262609 30826 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:36.267623 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3139ddb2dda48ce8a138dbb3cf05035" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.187361  2470 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.189023  2534 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.281214 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.257140  2594 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:36.292524 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99675411e6424bd6a95cbc666a5ece32" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.286247 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.293435 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.264873  2556 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:23:36.152839  2548 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:36.318754  2613 log.cc:927] Time spent T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:36.294534  2119 raft_consensus.cc:493] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.331760 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:36.333070 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:36.334246 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:36.261679  2540 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:36.366315 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 105917us
I20260709 12:23:36.279083  2537 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:36.297916  2420 raft_consensus.cc:697] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 13 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:36.276064  2530 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:36.281708  2547 raft_consensus.cc:515] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:36.297379  2534 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:36.366773  2603 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:23:36.452627 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
W20260709 12:23:36.479053 30899 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 199 similar messages]
I20260709 12:23:36.470745 30857 raft_consensus.cc:2376] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 13. Re-sending same reply.
I20260709 12:23:36.450299  2624 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.366209  2119 raft_consensus.cc:515] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:36.485669  2420 consensus_queue.cc:237] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:36.491189  2536 consensus_meta.cc:287] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.004s
W20260709 12:23:36.495074 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 162054us
I20260709 12:23:36.527069 30750 leader_election.cc:304] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:36.495858 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:36.497818 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 195652us
I20260709 12:23:36.535466 29609 tablet_replica.cc:333] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:36.548947 29609 raft_consensus.cc:2243] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:36.550205 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:36.591483  2616 log.cc:927] Time spent T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
W20260709 12:23:36.593036  2615 log.cc:927] Time spent T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
W20260709 12:23:36.594985  2617 log.cc:927] Time spent T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 12:23:36.596388  2623 log.cc:927] Time spent T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:36.499116  2624 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:36.601176  2624 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:36.604625 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:23:36.608143  2534 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:36.562876  2536 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:36.610858  2530 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:36.611732  2530 raft_consensus.cc:2749] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:36.613720  2614 log.cc:927] Time spent T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:23:36.614524  2543 leader_election.cc:290] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:36.619236  2547 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:36.538312  2626 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:36.629688 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.633973  2548 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:36.568657  2581 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.640304  2581 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:36.687597 30747 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.833401 29609 raft_consensus.cc:2272] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:36.846577 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 583995us
I20260709 12:23:36.842052 30854 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1856) took 1157 ms. Trace:
I20260709 12:23:36.851926 30682 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.852083 30854 rpcz_store.cc:276] 0709 12:23:35.684530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.684661 (+   131us) service_pool.cc:224] Handling call
0709 12:23:35.684923 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:35.685098 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:35.987083 (+301985us) log.cc:844] Serialized 14 byte log entry
0709 12:23:36.189015 (+201932us) log.cc:844] Serialized 14 byte log entry
0709 12:23:36.841586 (+652571us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b1800362620. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d8acc0a 00007f9616fec219 00007f960d934a40 00007f960d92f4e4 00007f960d92f455 00007f9610a17060 00007f9610a29716 00007f9610a3a287 00007f9610a3a208
0709 12:23:36.841736 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:36.841802 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:36.841845 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.841907 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:36.841998 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119365,"prepare.queue_time_us":46107,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":764856,"raft.run_wall_time_us":3947,"spinlock_wait_cycles":27981952,"thread_start_us":427498,"threads_started":2,"wal-append.queue_time_us":288777}
W20260709 12:23:36.856145 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 375644us
W20260709 12:23:36.839133  2561 consensus_meta.cc:287] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.735s	user 0.007s	sys 0.006s
I20260709 12:23:36.864706  2478 raft_consensus.cc:493] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:36.871172  2478 raft_consensus.cc:515] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:36.845129  2225 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:36.845727  2619 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:36.857118  2472 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:36.903179  2478 leader_election.cc:290] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:36.893601  2594 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.915210  2540 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:36.929502 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 402512us
W20260709 12:23:36.928602 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 94555.8us
I20260709 12:23:36.922272  2119 leader_election.cc:290] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:36.923307  2581 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:36.951776 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.953837 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.954802 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.916385  2594 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:36.965265  2594 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:36.910833  2619 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:36.976907  2619 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:36.986769 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:36.994983 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.950578  2581 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:36.999384 30854 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:23:37.010330 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 136352us
I20260709 12:23:37.010797 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.013187 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.015228 30857 raft_consensus.cc:2393] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 10: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
W20260709 12:23:37.016008 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 58616.7us
I20260709 12:23:37.013741 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.016968 30854 raft_consensus.cc:2468] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e7509fe1be74f179626fb4fcb4b4e65 in term 13.
I20260709 12:23:37.022239 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf69f43966d4209837d8bca1cecb1ab" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.034651 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.141525 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:37.047693 30825 leader_election.cc:336] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:37.143002 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 95341.5us
I20260709 12:23:37.145119 30750 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.146553 30750 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:37.147162 30750 raft_consensus.cc:2686] T 7fe828317ecc4cca97bd1b284e5f2785 P 5e7509fe1be74f179626fb4fcb4b4e65: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:23:37.148077 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:37.141377 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 130252us
I20260709 12:23:37.003939  2522 raft_consensus.cc:493] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:37.184157 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.185223 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.188299 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.189464 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.190243 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.191197 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be932375e2fb44fa82101764b7f51427" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.198196 30860 raft_consensus.cc:2393] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e7509fe1be74f179626fb4fcb4b4e65 in current term 8: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:37.177784 29609 tablet_replica.cc:333] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:37.192625 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:37.193616 30931 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:23:37.202124 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:36.991825  2513 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.206753 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:37.207590 31502 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 12.
I20260709 12:23:37.207970  2631 raft_consensus.cc:493] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.178242  2137 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.196334  2626 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:37.211848 30750 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.185747  2636 raft_consensus.cc:493] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.194059  2543 raft_consensus.cc:493] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.194401  2547 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:23:37.217969 30750 raft_consensus.cc:2686] T 6dc94a27f1f74fcea7449d3b7823d96e P 5e7509fe1be74f179626fb4fcb4b4e65: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:23:37.196457  2644 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:37.204455  2530 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.012619  2581 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.226763 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.229724 30854 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 9.
I20260709 12:23:37.230774 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.231846 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:37.238165 30750 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.212146  2513 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.203519  2522 raft_consensus.cc:515] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.248150  2513 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.248713  2522 leader_election.cc:290] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.219163  2485 raft_consensus.cc:493] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:37.217126  2119 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:37.216894  2630 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.208794  2631 raft_consensus.cc:515] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:37.257843 30750 raft_consensus.cc:2686] T 66c752ebb5cb4a9da00940d6b57922d7 P 5e7509fe1be74f179626fb4fcb4b4e65: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:23:37.212496  2572 consensus_queue.cc:1048] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:23:37.259994 30750 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.260592  2478 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:37.266767  2478 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.267191  2478 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:37.234592  2644 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.216569  2137 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.252977  2485 raft_consensus.cc:515] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.276692  2119 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:37.259130  2589 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.235531  2530 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.278414  2589 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.280239  2530 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.281217  2589 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.222672  2543 raft_consensus.cc:515] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.288110  2543 leader_election.cc:290] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.291154 29609 raft_consensus.cc:2243] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.295204 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.296365 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.297986  2513 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:37.298503  2556 consensus_meta.cc:287] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Time spent flushing consensus metadata: real 0.984s	user 0.003s	sys 0.008s
I20260709 12:23:37.300695  2137 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.300505  2556 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.220120  2636 raft_consensus.cc:515] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.305001  2472 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:37.261613  2630 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.306902  2472 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.308707  2630 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.309262  2472 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.310454  2581 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.305743 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.315361  2556 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.319193  2636 leader_election.cc:290] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.322890 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.324605 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.326131  2630 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:37.327400  2631 leader_election.cc:290] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.305858  2513 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.309448  2478 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:37.350800 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:37.340132  2472 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
W20260709 12:23:37.357303 30899 leader_election.cc:336] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:37.350168  2631 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.339582  2636 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:37.363019  2472 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.365633  2472 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:37.369061  2622 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.906s	user 0.004s	sys 0.016s
I20260709 12:23:37.371680  2485 leader_election.cc:290] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.372419  2485 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:37.372920  2485 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:37.349440 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 94732.3us
I20260709 12:23:37.351161 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.382346 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:37.383626 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:37.383773 30750 leader_election.cc:304] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:37.385135 30825 leader_election.cc:336] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:37.389878 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:37.396899  2537 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.403749 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.409199 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.409967 30859 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 13.
I20260709 12:23:37.398998 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.411679 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.378544  2636 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:37.412714 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:37.413515 30858 raft_consensus.cc:2368] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 12. Current term is 13.
I20260709 12:23:37.386924  2631 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:37.418009 30851 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42868 (request call id 1869) took 1589 ms. Trace:
I20260709 12:23:37.384577  2650 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.419051  2520 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:37.419685  2520 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.418458 30851 rpcz_store.cc:276] 0709 12:23:35.828276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.880974 (+ 52698us) service_pool.cc:224] Handling call
0709 12:23:35.881468 (+   494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:23:36.094335 (+212867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:36.094371 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:23:36.094997 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 12:23:36.267015 (+172018us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:36.267055 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:36.267119 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:37.368427 (+1101308us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f96105ba86e 00007f96105b9bb6 00007f96105b97d8 00007f96105c3221 00007f96105c31d9 00007f96105c3169
0709 12:23:37.417600 (+ 49173us) raft_consensus.cc:1685] finished
0709 12:23:37.417626 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:37.417937 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":212334,"raft.queue_time_us":214660,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":7843072,"thread_start_us":171636,"threads_started":1,"wal-append.queue_time_us":215866}
I20260709 12:23:37.420068  2520 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:37.424546  2485 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.400714  2513 raft_consensus.cc:2749] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:23:37.430905 30750 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081
W20260709 12:23:37.432507 30825 leader_election.cc:336] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:37.433563 30825 leader_election.cc:336] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:37.443758 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:37.444674 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:37.445695 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:37.447199  2537 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:37.447597 30750 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:37.447827  2537 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 LEADER]: Becoming Leader. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:37.448849  2537 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.450155 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:37.437116  2631 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:23:37.453994  2520 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.418984  2650 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.460047  2478 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 election: Requested vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.462489  2636 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.463330 30750 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.464598 29609 raft_consensus.cc:2272] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.466552  2137 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:37.436559  2367 raft_consensus.cc:493] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:37.470973  2589 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.476383  2592 leader_election.cc:290] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:37.488440 30750 raft_consensus.cc:2686] T 9a6b5782c4be491f89e3db5e94722436 P 5e7509fe1be74f179626fb4fcb4b4e65: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:23:37.513234 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 66862.9us
W20260709 12:23:37.524019 30825 leader_election.cc:336] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:37.487284  2556 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.492165  2420 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:37.525630 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:37.522543 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 59313.8us
I20260709 12:23:37.533569 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.536764 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "047196043bb744a6b94cb3b634b80771" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:37.537333 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
W20260709 12:23:37.546614 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:37.546864 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.549530 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c752ebb5cb4a9da00940d6b57922d7" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.505113  2137 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.505172  2367 raft_consensus.cc:515] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.645488  2542 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:37.646510  2367 leader_election.cc:290] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.646231  2542 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.647742  2367 raft_consensus.cc:493] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:37.648252  2367 raft_consensus.cc:515] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.648597  2542 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.649221  2594 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:37.649802  2594 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.650064 30682 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.652071  2594 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.651743 30682 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.652585  2137 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.652698  2537 raft_consensus.cc:2804] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:37.653205  2537 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:37.539340  2420 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.655057 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.656565  2420 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.506491  2589 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.656832 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.657552 30932 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 12.
I20260709 12:23:37.658595  2589 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.653630  2537 raft_consensus.cc:3060] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:37.653497 30682 catalog_manager.cc:5697] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.536571  2631 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.540472  2636 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:23:37.671723 30900 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:37.672854 31502 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
I20260709 12:23:37.523000  2641 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.536360  2522 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:37.523000  2491 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.641845  2576 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.538735  2556 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.736018  2522 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.740370  2556 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.729379 30929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17ff7050be449b8928f071ef46b1d4c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.667465 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:37.740037 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.745508 30934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.747112 30935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.683069 29609 tablet_replica.cc:333] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:37.749955 29609 raft_consensus.cc:2243] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.728820  2636 raft_consensus.cc:493] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.750674 29609 raft_consensus.cc:2272] T d1bb0331e5b641b99a413ba3e4475499 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.750725  2636 raft_consensus.cc:515] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.752987  2636 leader_election.cc:290] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.673781  2422 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:37.685312  2644 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.686877 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
W20260709 12:23:37.756578 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 69797.3us
I20260709 12:23:37.695374 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.696794 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.697224 30854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.698694 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:37.759423  2422 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:23:37.760129  2422 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:37.684536  2650 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.640365  2572 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.699687  2641 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.763792  2572 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.765941  2641 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.761184  2422 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.773787  2572 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.776948  2522 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.753599 29609 tablet_replica.cc:333] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:37.778890 29609 raft_consensus.cc:2243] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.693004  2643 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:37.779652  2643 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.705706 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.780514 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:37.706457 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.707072 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.708016 30928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.709277 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.686795  2520 leader_election.cc:290] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:37.710533 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 70336.5us
I20260709 12:23:37.709595 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:37.785025 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:37.785601 30899 leader_election.cc:336] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:37.671744  2557 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
W20260709 12:23:37.785794 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 76533.7us
W20260709 12:23:37.786496 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:37.786661  2636 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:37.786965 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.719969 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb8ca824cf6744b2ac7815f82ca8b276" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.788288 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.737061  2546 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:37.796167  2546 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:37.796825  2631 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:37.798906  2546 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:37.737151  2576 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.800889  2576 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.749571  2491 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.804471  2491 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:37.795761 30679 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 178) took 22356 ms (client timeout 15000 ms). Trace:
W20260709 12:23:37.787122 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.721627 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3e3882211ee442daf1d37e6649ccb9f" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.788815  2543 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:37.722414 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3635826198a49c885a3b5c762743eb3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.728660 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:37.786502  2557 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:37.794107 29609 raft_consensus.cc:2272] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.795020  2367 leader_election.cc:290] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.826540 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.835206 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:37.962724 30857 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 11.
I20260709 12:23:37.871567 30851 raft_consensus.cc:1275] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:23:37.886047 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d15199b73310443a816e4f4916c77ebb" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:37.961908 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 173683us
I20260709 12:23:37.967676 30750 leader_election.cc:304] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.971586 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:37.973495 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:37.975426 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:37.805950 30679 rpcz_store.cc:269] 0709 12:23:15.503802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:15.529783 (+ 25981us) service_pool.cc:224] Handling call
0709 12:23:16.849694 (+1319911us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54000a9bd4. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f9610989090 00007f9610a27f3a 00007f96167dde9c 00007f96168dc04e 00007f9614d9d2a4 00007f9614d9d232 00007f9614d9d161 00007f9614d9d0dc 00007f9614d9c392 00007f960ed5a48c 00007f960ed598c6
0709 12:23:37.795686 (+20945992us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:34.975633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:35.080371 (+104738us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:35.122960 (+ 42589us) write_op.cc:435] Acquired schema lock
0709 12:23:35.124836 (+  1876us) tablet.cc:662] Decoding operations
0709 12:23:35.128822 (+  3986us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:35.128904 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:35.128933 (+    29us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:23:35.135161 (+  6228us) tablet.cc:701] Row locks acquired
0709 12:23:35.135216 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:23:35.135406 (+   190us) write_op.cc:270] Start()
0709 12:23:35.135577 (+   171us) write_op.cc:276] Timestamp: P: 1783599815135334 usec, L: 0
0709 12:23:35.135596 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:23:35.136353 (+   757us) log.cc:844] Serialized 4805 byte log entry
0709 12:23:35.564046 (+427693us) op_driver.cc:464] REPLICATION: finished
0709 12:23:35.622796 (+ 58750us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4400022b4c. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f960d7badb1 00007f960d858c85 00007f960d8596a2 00007f96105cb1db 00007f96105c6aaf 00007f960d9150ac 00007f961676f9a9 00007f960d93169b 00007f960d92f93f 00007f960d931c02 00007f9614455ef0
0709 12:23:35.709982 (+ 87186us) write_op.cc:301] APPLY: starting
0709 12:23:35.710090 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:35.711502 (+  1412us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:35.711539 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:35.712875 (+  1336us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:35.713264 (+   389us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:23:35.713351 (+    87us) write_op.cc:312] APPLY: finished
0709 12:23:35.723362 (+ 10011us) log.cc:844] Serialized 88 byte log entry
0709 12:23:35.774445 (+ 51083us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:35.774597 (+   152us) write_op.cc:454] Released schema lock
0709 12:23:35.774649 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:35.775094 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:35.775122 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1109341,"reported_tablets":55,"spinlock_wait_cycles":1815511296,"child_traces":[["op",{"apply.queue_time_us":142908,"apply.run_cpu_time_us":4795,"apply.run_wall_time_us":65099,"num_ops":12,"prepare.queue_time_us":237866,"prepare.run_cpu_time_us":58842,"prepare.run_wall_time_us":391760,"raft.queue_time_us":97547,"raft.run_cpu_time_us":11002,"raft.run_wall_time_us":155268,"replication_time_us":405100,"spinlock_wait_cycles":10156800,"thread_start_us":547760,"threads_started":4,"wal-append.queue_time_us":272339,"wal-append.run_cpu_time_us":23674,"wal-append.run_wall_time_us":1364104}]]}
I20260709 12:23:37.870736  2537 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:38.002755 30825 leader_election.cc:336] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:37.795750  2643 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:23:38.010573 30825 leader_election.cc:336] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:37.951674  2478 raft_consensus.cc:493] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:37.971016  2636 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.016772 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:38.017419 30856 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.017138  2636 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.019232  2636 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.019767  2636 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.020428  2636 raft_consensus.cc:493] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.020910  2636 raft_consensus.cc:515] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.021015  2478 raft_consensus.cc:515] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.023233  2478 leader_election.cc:290] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:37.999847  2546 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:23:38.023864  2546 raft_consensus.cc:493] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.024246  2546 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.026695  2576 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:38.027333  2576 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.030432  2576 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:37.946899  2491 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:37.920789  2367 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:38.032609  2491 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.033208  2367 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.034899  2491 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:38.035557  2367 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.016469 30926 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 12.
W20260709 12:23:38.037258 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 253679us
I20260709 12:23:37.912741  2543 raft_consensus.cc:493] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
W20260709 12:23:38.052697 30825 leader_election.cc:336] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:38.054168 30825 leader_election.cc:336] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.001998  2631 raft_consensus.cc:3060] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.071476 29609 tablet_replica.cc:333] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:38.072886 29609 raft_consensus.cc:2243] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.072666  2546 raft_consensus.cc:515] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.080060 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.083145 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.084795 29609 raft_consensus.cc:2272] T 9cf061659071464dadafceeb712b1c5d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.085294 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.089239 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe828317ecc4cca97bd1b284e5f2785" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.091049 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.057055  2557 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:38.056389  2537 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.110117 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc94a27f1f74fcea7449d3b7823d96e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.056807  2543 raft_consensus.cc:515] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.086591  2478 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.139530 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.160163 30856 raft_consensus.cc:2468] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 10.
I20260709 12:23:38.121269  2537 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.177883 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89472c03e684475c9254c1b3c2ad6350" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.178766 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.180528 30926 raft_consensus.cc:2393] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 in current term 12: Already voted for candidate 47c0d0bc235a443aad3c62643e91b081 in this term.
I20260709 12:23:38.187455 30927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:38.189601 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.186348 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.195475 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae2135797f024066b30a0fb14e174518" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.199657 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84dde2d8ff054417a11a7ec410d2ffd2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.200810 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:38.202669 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 229157us
I20260709 12:23:38.207131 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:38.209815 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.211395 30900 leader_election.cc:400] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 election: Vote denied by peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903) with higher term. Message: Invalid argument: T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 47c0d0bc235a443aad3c62643e91b081 for earlier term 12. Current term is 13.
I20260709 12:23:38.156503  2478 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.215793 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.181531  2537 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.227592 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.229557 29609 tablet_replica.cc:333] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:38.213495  2491 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:23:38.230492 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91c561a0b4404fcb8adb9d2002e0c15d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.237004 31508 raft_consensus.cc:2368] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 12. Current term is 13.
I20260709 12:23:38.239406 30750 leader_election.cc:304] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:38.242527 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2323a4fe46444265864acf0869016ef4" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.246349 29609 raft_consensus.cc:2243] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.226126  2636 leader_election.cc:290] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.227952 31502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:23:38.251295 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:38.254010 30856 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.255575  2543 leader_election.cc:290] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:38.233584  2491 raft_consensus.cc:493] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:38.259910  2491 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.256381 31502 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.258286 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.275312 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.282604 30750 leader_election.cc:304] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:38.285193 30825 leader_election.cc:336] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.289142 30750 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.296486 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:38.299505 30825 leader_election.cc:336] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.302485 29609 raft_consensus.cc:2272] T a17ff7050be449b8928f071ef46b1d4c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:38.301065 30825 leader_election.cc:336] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.308739 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bb0331e5b641b99a413ba3e4475499" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.319180 30856 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 13.
I20260709 12:23:38.294260  2665 raft_consensus.cc:493] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.293027  2543 raft_consensus.cc:2749] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:23:38.335498  2665 raft_consensus.cc:515] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.281906  2636 raft_consensus.cc:493] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:23:38.324930 31477 leader_election.cc:304] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:23:38.324865  2478 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:38.325977  2663 raft_consensus.cc:3060] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:38.346516  2625 raft_consensus.cc:2804] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:38.356699  2537 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.345353  2665 leader_election.cc:290] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.343945  2636 raft_consensus.cc:515] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:38.365417 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 139894us
I20260709 12:23:38.358702  2543 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.370343 29609 tablet_replica.cc:333] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:38.366168  2665 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:38.394958 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 232310us
I20260709 12:23:38.364960  2625 raft_consensus.cc:697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 LEADER]: Becoming Leader. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Running, Role: LEADER
I20260709 12:23:38.405601 30900 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:38.402976 30899 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.406857 30899 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:38.411660 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:38.416052 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 126995us
I20260709 12:23:38.417081 30750 leader_election.cc:304] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:38.427326 30750 raft_consensus.cc:2686] T 99675411e6424bd6a95cbc666a5ece32 P 5e7509fe1be74f179626fb4fcb4b4e65: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:23:38.425978 30899 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.431107 30899 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.431207 30826 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.439894 30826 leader_election.cc:304] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.441016 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.442175 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.442713 30851 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Refusing update from remote peer 5e7509fe1be74f179626fb4fcb4b4e65: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:23:38.443743 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:38.444391 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:38.445705 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.447414 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.449021 30856 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [8.7-9.8]
I20260709 12:23:38.450273 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de79bb6a5d7d4dea85d1e4029984c0d3" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.414626  2570 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.452656 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e5ec4b5b8a34d7192f60102179eb425" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.454551  2650 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.460832  2491 raft_consensus.cc:515] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.461999  2625 consensus_queue.cc:237] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.429284  2543 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:23:38.463740  2367 raft_consensus.cc:2749] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.464378  2631 raft_consensus.cc:2749] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:38.407178  2665 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.435670  2522 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:38.471557 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bb0278198af4c1aba82199de860057a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:38.467293 31476 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 75936.3us
I20260709 12:23:38.477674 30932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.477921 30855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.448133  2537 raft_consensus.cc:493] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.482044 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.448338  2667 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:23:38.483661 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 78163.6us
I20260709 12:23:38.484634 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d22f521a944e4f66a81bcb842c1ae363" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.486202 30750 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.492097 29609 raft_consensus.cc:2243] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.494091 30750 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.492620  2537 raft_consensus.cc:515] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.494331  2669 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.501585  2631 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.503031  2537 leader_election.cc:290] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:38.489320 30826 leader_election.cc:304] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.503562 30750 leader_election.cc:304] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:38.505440 30750 raft_consensus.cc:2686] T bb8ca824cf6744b2ac7815f82ca8b276 P 5e7509fe1be74f179626fb4fcb4b4e65: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:23:38.506927 30750 leader_election.cc:304] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.508093 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.516026  2669 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.517109 30750 leader_election.cc:304] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:38.521476 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 106265us
W20260709 12:23:38.522472 30899 leader_election.cc:336] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:38.523617 30899 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.524137 30899 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.508234  2367 raft_consensus.cc:2749] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:38.546967  2671 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 12:23:38.570312 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 62197.3us
I20260709 12:23:38.519541  2537 raft_consensus.cc:2749] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.520424  2636 leader_election.cc:290] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:23:38.508046  2556 consensus_queue.cc:1048] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:23:38.528735  2631 raft_consensus.cc:2749] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:38.587579 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 63985.2us
I20260709 12:23:38.589139  2675 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.593067 30826 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:38.599668 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 81399.6us
I20260709 12:23:38.601497 30826 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.600492 30900 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:38.610997 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 90089.4us
I20260709 12:23:38.617722 30900 leader_election.cc:304] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:38.618896 30860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48c55f87983e421bae7549aa563643a2" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.619139 30750 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:38.622318 30750 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:38.625685 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.627707 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea1fc0f15e994691a2edf5f0c3b096eb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.628007 29609 raft_consensus.cc:2272] T fcf69f43966d4209837d8bca1cecb1ab P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.625838 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.631812 30932 raft_consensus.cc:1240] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:23:38.632149 30750 leader_election.cc:304] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.634487 30750 leader_election.cc:304] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.642490 31508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
W20260709 12:23:38.645841 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:38.614329  2643 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:38.650430 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:38.650918 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 51992.7us
I20260709 12:23:38.615226  2570 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:38.676900 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 70173.3us
I20260709 12:23:38.612663  2677 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:38.646221  2669 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:23:38.678194 30826 leader_election.cc:304] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:23:38.658735 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 77832.8us
I20260709 12:23:38.680524 30926 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 13. Current term is 14. Ops: []
I20260709 12:23:38.633038  2636 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:38.628722  2537 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.642591  2491 leader_election.cc:290] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 election: Requested vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:23:38.687000 30825 leader_election.cc:336] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.624614  2631 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:23:38.689793 30826 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.692981  2546 leader_election.cc:290] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.660458  2641 raft_consensus.cc:2804] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:23:38.721119 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.721019 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1459f4eb71440ae996b2745034179c9" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081"
I20260709 12:23:38.723645 30926 raft_consensus.cc:3060] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.690764  2665 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.693317  2644 raft_consensus.cc:2749] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:38.755151  2681 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:23:38.724058  2367 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:38.755200  2678 log.cc:927] Time spent T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:23:38.738453  2669 raft_consensus.cc:2749] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.744328  2670 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.734373  2683 raft_consensus.cc:2749] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:38.737141  2641 raft_consensus.cc:697] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
W20260709 12:23:38.798931 31502 consensus_meta.cc:287] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.003s
W20260709 12:23:38.818198 30750 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 183822us
I20260709 12:23:38.819041 30750 leader_election.cc:304] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.820618 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.823716 30926 raft_consensus.cc:2468] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 13.
W20260709 12:23:38.821604 30899 leader_election.cc:336] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:38.826223 30899 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.827423 30899 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.828187 29609 tablet_replica.cc:333] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:38.828964 29609 raft_consensus.cc:2243] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.823674  2546 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:23:38.831609  2641 consensus_queue.cc:237] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.832119  2546 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.836544 29609 pending_rounds.cc:70] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:38.836951 29609 pending_rounds.cc:77] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 10 index: 7 } timestamp: 7305624813135212544 op_type: NO_OP noop_request { }
I20260709 12:23:38.837356 29609 raft_consensus.cc:2889] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:38.837877 29609 raft_consensus.cc:2272] T f3139ddb2dda48ce8a138dbb3cf05035 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.840914 29609 tablet_replica.cc:333] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:38.842293  2671 consensus_queue.cc:1059] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:38.845031  2663 raft_consensus.cc:2749] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:38.824556  2537 raft_consensus.cc:2749] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:38.852864 31476 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.853899 29609 raft_consensus.cc:2243] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.854809  2665 raft_consensus.cc:3055] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:23:38.855274  2665 raft_consensus.cc:740] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:38.856242  2665 consensus_queue.cc:260] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.819427 31502 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 764ebfd36ce64b2a86e6d290ae92e276 in term 13.
I20260709 12:23:38.858289 31507 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:38.827082  2631 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.867530 29609 raft_consensus.cc:2272] T 64f8ac94405742eb87e6d195387d7c6f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.871058  2694 consensus_queue.cc:1059] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:38.874465  2631 raft_consensus.cc:3055] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:23:38.874941  2631 raft_consensus.cc:740] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e7509fe1be74f179626fb4fcb4b4e65, State: Running, Role: LEADER
I20260709 12:23:38.876008  2631 consensus_queue.cc:260] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:38.871420 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 145573us
I20260709 12:23:38.878181 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec82b6c4e54048a8a16a319c0cb38d23" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.878580 30826 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.880266 29609 tablet_replica.cc:333] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:38.880371 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.880940 30750 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.881400 29609 raft_consensus.cc:2243] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.882018  2688 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.883708 30826 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:38.885483 29609 raft_consensus.cc:2272] T 3e5ec4b5b8a34d7192f60102179eb425 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.886161  2543 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.886198  2688 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:38.885660 30750 leader_election.cc:304] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:38.889806  2543 raft_consensus.cc:493] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.890401  2543 raft_consensus.cc:515] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.891930 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:38.892719  2543 leader_election.cc:290] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.897624 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:23:38.899128  2694 raft_consensus.cc:2749] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.901434  2546 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.901799 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.905627 30857 raft_consensus.cc:1240] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Rejecting Update request from peer 47c0d0bc235a443aad3c62643e91b081 for earlier term 12. Current term is 13. Ops: []
I20260709 12:23:38.907339 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b23b41846a694f24a76e3aa05d9e54b2" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.910504  2631 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.911067  2688 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:38.911629  2688 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.913407  2520 consensus_queue.cc:1059] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:23:38.910537  2698 raft_consensus.cc:493] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:38.914852  2675 raft_consensus.cc:3055] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:23:38.915385  2675 raft_consensus.cc:740] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:38.916491  2675 consensus_queue.cc:260] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:38.913812  2688 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.919250  2688 raft_consensus.cc:493] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:38.919919  2688 raft_consensus.cc:515] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.920912 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:38.922642  2688 leader_election.cc:290] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:38.914697  2698 raft_consensus.cc:515] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:38.926054 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3496a4982a343f782fa2b4adc27d108" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276"
I20260709 12:23:38.926692 30851 raft_consensus.cc:3060] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:23:38.932288 30750 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:38.933799 30750 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:38.939121 30825 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.944545 30851 raft_consensus.cc:2468] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 14.
I20260709 12:23:38.947430 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.949256 30851 raft_consensus.cc:1240] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 14 FOLLOWER]: Rejecting Update request from peer 5e7509fe1be74f179626fb4fcb4b4e65 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:23:38.949388 30852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e63671b1e5b245ca8343f52f6239b6ae" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:38.954203 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 128661us
W20260709 12:23:38.959686 30899 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.858542  2665 raft_consensus.cc:3060] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:38.960317 30899 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.937245  2694 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:38.965799 30750 leader_election.cc:304] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:38.975294 30899 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:38.976205 30899 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:38.945631  2543 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:38.972762 30680 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.959841  2576 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.987246 29609 tablet_replica.cc:333] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:38.992573 29609 raft_consensus.cc:2243] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:38.996173 30682 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 83) took 14501 ms (client timeout 15000 ms). Trace:
I20260709 12:23:38.977427  2422 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:38.996670 29609 raft_consensus.cc:2272] T 89472c03e684475c9254c1b3c2ad6350 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.977041  2636 raft_consensus.cc:2749] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:38.977177  2664 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:38.988104  2675 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:23:38.990190 30680 catalog_manager.cc:5697] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:39.008131 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.994141  2520 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:39.011193 30680 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:38.996646 30682 rpcz_store.cc:269] 0709 12:23:24.501979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.502238 (+   259us) service_pool.cc:224] Handling call
0709 12:23:38.996084 (+14493846us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:38.156794 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:38.246394 (+ 89600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:38.249030 (+  2636us) write_op.cc:435] Acquired schema lock
0709 12:23:38.250113 (+  1083us) tablet.cc:662] Decoding operations
0709 12:23:38.336093 (+ 85980us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:38.336153 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:38.336187 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:23:38.336863 (+   676us) tablet.cc:701] Row locks acquired
0709 12:23:38.336890 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:23:38.337050 (+   160us) write_op.cc:270] Start()
0709 12:23:38.337178 (+   128us) write_op.cc:276] Timestamp: P: 1783599818337001 usec, L: 0
0709 12:23:38.337204 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:23:38.355616 (+ 18412us) log.cc:844] Serialized 3217 byte log entry
0709 12:23:38.632254 (+276638us) op_driver.cc:464] REPLICATION: finished
0709 12:23:38.762119 (+129865us) write_op.cc:301] APPLY: starting
0709 12:23:38.762210 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:38.762887 (+   677us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:38.763001 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:38.763777 (+   776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:38.764005 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:23:38.764054 (+    49us) write_op.cc:312] APPLY: finished
0709 12:23:38.764332 (+   278us) log.cc:844] Serialized 64 byte log entry
0709 12:23:38.764517 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.764661 (+   144us) write_op.cc:454] Released schema lock
0709 12:23:38.764710 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:38.765159 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:38.765196 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4603949,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":129560,"apply.run_cpu_time_us":2999,"apply.run_wall_time_us":3004,"num_ops":8,"prepare.queue_time_us":348062,"prepare.run_cpu_time_us":27477,"prepare.run_wall_time_us":375072,"raft.queue_time_us":54254,"raft.run_cpu_time_us":33704,"raft.run_wall_time_us":98848,"replication_time_us":294897,"spinlock_wait_cycles":18176,"thread_start_us":391071,"threads_started":4,"wal-append.queue_time_us":153892}]]}
I20260709 12:23:39.014214 30680 catalog_manager.cc:5697] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.015407 30680 catalog_manager.cc:5697] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.016285 30680 catalog_manager.cc:5697] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.017395 30680 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.018899 30826 leader_election.cc:304] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:39.019222 30680 catalog_manager.cc:5697] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 9 to 11, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 11 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.021837 30680 catalog_manager.cc:5697] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.023332 30826 leader_election.cc:304] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:39.025027 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.006106  2695 raft_consensus.cc:493] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:23:39.025576 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64f8ac94405742eb87e6d195387d7c6f" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.024201 30680 catalog_manager.cc:5697] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 9, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 9 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.033727 30680 catalog_manager.cc:5697] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 9 to 10, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.034960 30826 leader_election.cc:304] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:39.035158 30680 catalog_manager.cc:5697] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 5 to 12, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 12 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.036238 30826 leader_election.cc:400] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 12. Current term is 13.
I20260709 12:23:39.036548 30826 leader_election.cc:403] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:39.037415  2478 raft_consensus.cc:2749] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:39.041458 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.042449 30826 leader_election.cc:304] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:39.042208 30680 catalog_manager.cc:5697] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 7 to 8, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:39.050041 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.026582  2688 raft_consensus.cc:2749] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:39.052225 30680 catalog_manager.cc:5697] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 11, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 11 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:39.055681 30680 catalog_manager.cc:5697] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.058091 30680 catalog_manager.cc:5697] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 11, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 11 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:39.063375 30899 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.043376  2367 raft_consensus.cc:2749] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.051147  2478 raft_consensus.cc:2749] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747) with higher term. Message: Invalid argument: T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 764ebfd36ce64b2a86e6d290ae92e276 for earlier term 12. Current term is 13.
W20260709 12:23:39.073860 30899 leader_election.cc:336] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.050941  2636 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.075489 30680 catalog_manager.cc:5697] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.054963  2543 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.076823 30899 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.033917  2695 raft_consensus.cc:515] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.098110  2543 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.099160  2520 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:39.100173 30899 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.127085 30899 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.092643 30680 catalog_manager.cc:5697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 12, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.075312  2688 raft_consensus.cc:2749] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:39.073282  2694 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.132515 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:38747, user_credentials={real_user=slave}} blocked reactor thread for 90139.1us
I20260709 12:23:39.134171 30826 leader_election.cc:304] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:39.136081 30826 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276, 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081
I20260709 12:23:39.135996 30680 catalog_manager.cc:5697] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 5 to 9, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 9 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.137504 30680 catalog_manager.cc:5697] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 1 to 8, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:39.139293 30899 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.139837 30899 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.140806  2710 raft_consensus.cc:2749] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:23:39.142517 30899 leader_election.cc:336] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.142992 30899 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.143544 30826 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:39.148303 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:39.148792 30899 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.144235 30680 catalog_manager.cc:5697] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 2 to 8, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.149277 30899 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.128742  2537 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:39.151597 30899 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.153368 30680 catalog_manager.cc:5697] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:39.153045 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2b1416a04848d99913731a9259dc8e" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.155128 30899 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:39.156752 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.160079  2692 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.150453  2670 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:39.163059 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.157196  2691 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.133205  2694 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.170153  2694 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:39.174175  2703 log.cc:927] Time spent T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:23:39.145572  2576 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.177115 29609 tablet_replica.cc:333] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.154438  2572 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:39.178594 29609 raft_consensus.cc:2243] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.179566  2543 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.179970 29609 raft_consensus.cc:2272] T 2323a4fe46444265864acf0869016ef4 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.188884  2537 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.193413 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abd414d2ac774e99a1548b0ff34a4f37" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.197614 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.197063 30858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.196607 30680 catalog_manager.cc:5697] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.198148 30900 leader_election.cc:304] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276; no voters: 
I20260709 12:23:39.121651  2636 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.201653 30680 catalog_manager.cc:5697] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 11, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 11 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.209471 30931 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:39.151993  2698 leader_election.cc:290] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:39.213330 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 61721.6us
W20260709 12:23:39.214450 30899 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.215247 30680 catalog_manager.cc:5697] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 9 to 11, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 11 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:39.215871 30899 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:23:39.221212 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:39.221089 30899 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.223626 30855 raft_consensus.cc:1275] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Refusing update from remote peer 7857bffc34ce4e1db3617488701b9810: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:23:39.224856  2704 log.cc:927] Time spent T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:23:39.226172  2543 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.226733  2543 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.227949  2636 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.229151  2543 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.231402  2537 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.231984  2537 raft_consensus.cc:493] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.232533  2537 raft_consensus.cc:515] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.234193 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21608c221fae4caf8e15b6588f457432" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.235831 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.243014  2695 leader_election.cc:290] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.194824  2711 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:23:39.245808 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d48dd4a93a42d09268f3dee7887550" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.246291  2684 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:39.248673 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 50620.8us
I20260709 12:23:39.222266  2625 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:23:39.249750  2692 raft_consensus.cc:2804] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:23:39.252040  2711 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 LEADER]: Becoming Leader. State: Replica: 764ebfd36ce64b2a86e6d290ae92e276, State: Running, Role: LEADER
I20260709 12:23:39.253090  2711 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:39.252058  2692 raft_consensus.cc:697] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 14 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:23:39.256489 29609 tablet_replica.cc:333] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.255995  2692 consensus_queue.cc:237] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.257418 29609 raft_consensus.cc:2243] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.259930 30750 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.261564 30750 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.263005 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.264407  2631 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.265239  2631 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.267338 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.267485 29609 raft_consensus.cc:2272] T 48c55f87983e421bae7549aa563643a2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:39.268210 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 52354.7us
W20260709 12:23:39.268998 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.270612 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:39.273185 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.273233 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "576cba7acdde4bbda553612d2ad1076d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:39.273977 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.274993 30750 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.280169 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68688b51d09c48d6b63fec7f6e414d95" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.280685 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:39.280130 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.281929 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.282500 30750 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:39.283545 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.272207  2620 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.278677  2543 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.290438 30857 raft_consensus.cc:1275] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:23:39.294708 30899 leader_election.cc:336] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.300439 30750 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.287076  2665 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:39.299571 30825 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.310366 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:39.310145  2631 raft_consensus.cc:2749] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.320626  2537 leader_election.cc:290] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.322814 29609 tablet_replica.cc:333] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.322963  2673 consensus_queue.cc:1048] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:39.323819 29609 raft_consensus.cc:2243] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.324313 30848 tablet_service.cc:1558] Processing DeleteTablet for tablet b23b41846a694f24a76e3aa05d9e54b2 with delete_type TABLET_DATA_TOMBSTONED (TS 764ebfd36ce64b2a86e6d290ae92e276 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:39214
I20260709 12:23:39.324496 29609 raft_consensus.cc:2272] T ae2135797f024066b30a0fb14e174518 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.331892 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:39.343245 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 43705.5us
W20260709 12:23:39.344156 30825 leader_election.cc:336] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.344625 30825 leader_election.cc:304] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:39.356678 29609 tablet_replica.cc:333] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.357946 29609 raft_consensus.cc:2243] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.349946  2710 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.352403  2688 raft_consensus.cc:2749] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.358979 29609 pending_rounds.cc:70] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:39.395835 29609 pending_rounds.cc:77] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 14 index: 11 } timestamp: 7305624826125246464 op_type: NO_OP noop_request { }
I20260709 12:23:39.396512 29609 raft_consensus.cc:2889] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:39.397389 29609 raft_consensus.cc:2272] T 047196043bb744a6b94cb3b634b80771 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:39.399111 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.404274 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.404698 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 53093.8us
W20260709 12:23:39.405241 30825 leader_election.cc:336] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.414531 30825 leader_election.cc:304] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:39.380129  2537 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.429222 29609 tablet_replica.cc:333] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.434010  2695 raft_consensus.cc:2749] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:23:39.426882 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.442076  2631 raft_consensus.cc:493] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.442860  2631 raft_consensus.cc:515] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.445017  2631 leader_election.cc:290] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:39.442723 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.447124 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.447866 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.450016 29609 raft_consensus.cc:2243] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.426905  2715 tablet_replica.cc:333] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:23:39.374583  2691 consensus_queue.cc:1048] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:23:39.454412 29609 pending_rounds.cc:70] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:39.459080 29609 pending_rounds.cc:77] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 9 index: 7 } timestamp: 7305624803632295936 op_type: NO_OP noop_request { }
I20260709 12:23:39.459507 29609 raft_consensus.cc:2889] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:39.459933 29609 raft_consensus.cc:2272] T abd414d2ac774e99a1548b0ff34a4f37 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.451642  2631 raft_consensus.cc:493] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.453945  2537 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.469894 30851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32de69a76624466ad038a06e78980dd" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.470206 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c518d33b8e184a1089ca6c043d90c270" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.471123  2715 raft_consensus.cc:2243] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.472152  2715 raft_consensus.cc:2272] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.480062  2537 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.482823 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.484556 30750 leader_election.cc:304] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.485560 30750 leader_election.cc:304] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.463764  2631 raft_consensus.cc:515] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:23:39.501444 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.502415 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.497278  2537 raft_consensus.cc:2749] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:23:39.509413  2631 leader_election.cc:290] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.511508 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.497392  2543 raft_consensus.cc:2749] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:39.531960 30825 leader_election.cc:336] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:39.532492 30825 leader_election.cc:304] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:23:39.535486 29609 tablet_replica.cc:333] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.536804 29609 raft_consensus.cc:2243] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:39.538241 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.541236  2715 ts_tablet_manager.cc:1916] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:39.543643  2695 raft_consensus.cc:2749] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:23:39.550802 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9956c598e54d3cb1778d39d8196a85" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
W20260709 12:23:39.557976 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:39.558614 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58ba86a26f747dba6c34dc628302aaf" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.620456  2715 ts_tablet_manager.cc:1929] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:23:39.624255  2715 log.cc:1199] T b23b41846a694f24a76e3aa05d9e54b2 P 764ebfd36ce64b2a86e6d290ae92e276: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/wals/b23b41846a694f24a76e3aa05d9e54b2
I20260709 12:23:39.793713 30859 raft_consensus.cc:1275] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 14 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:23:39.795225  2641 consensus_queue.cc:1048] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:39.798239 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.833575  2543 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.837226  2543 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.839351  2543 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.844394  2543 raft_consensus.cc:493] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.844899  2543 raft_consensus.cc:515] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } }
I20260709 12:23:39.846207 29609 raft_consensus.cc:2272] T ec82b6c4e54048a8a16a319c0cb38d23 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.847465  2543 leader_election.cc:290] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:39.849191 29609 tablet_replica.cc:333] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.868211 29609 raft_consensus.cc:2243] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.869515 29609 raft_consensus.cc:2272] T 576cba7acdde4bbda553612d2ad1076d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.877959 30668 catalog_manager.cc:5028] TS 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): tablet b23b41846a694f24a76e3aa05d9e54b2 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:23:39.872561 29609 tablet_replica.cc:333] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:39.888432 29609 raft_consensus.cc:2243] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.891269  2543 raft_consensus.cc:493] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.891403 31507 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:23:39.899274  2543 raft_consensus.cc:515] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.901595 30930 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 12:23:39.901984  2543 leader_election.cc:290] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:39.902240 30930 pending_rounds.cc:85] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Aborting all ops after (but not including) 9
I20260709 12:23:39.902665 30930 pending_rounds.cc:107] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 12:23:39.903004 30930 raft_consensus.cc:2889] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:39.904310 29609 pending_rounds.cc:70] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:39.906514 30750 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.910455 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.911835 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.912331 30853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e4b6cc51cc8447b9a8b62bee637d000" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.913070 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.913446 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.915498  2631 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.916303  2631 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.916793  2631 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:39.923748  2631 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:39.924506 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.918308 30750 leader_election.cc:304] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.928274  2631 raft_consensus.cc:2749] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.929224 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98f068de024412f94b2929c4ee5d313" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.937386 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:39.938591 30750 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.939920 30750 leader_election.cc:304] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.940721  2543 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.941488  2543 raft_consensus.cc:2749] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:23:39.945748 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:39.951220 30750 leader_election.cc:304] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:39.952034 29609 pending_rounds.cc:77] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7305624812242137088 op_type: NO_OP noop_request { }
I20260709 12:23:39.952471 29609 raft_consensus.cc:2889] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:39.952863 29609 raft_consensus.cc:2272] T e63671b1e5b245ca8343f52f6239b6ae P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.971000  2631 raft_consensus.cc:2749] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:39.972405 30750 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:23:39.944278 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:39.991770 30825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 47512.6us
W20260709 12:23:39.992449 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:39.997016  2688 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:23:40.002434 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.014134  2367 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:23:39.996034  2631 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:23:40.016893 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:40.017644 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.019197 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.019867 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.020462 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.022028 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.031483 30848 tablet_service.cc:1558] Processing DeleteTablet for tablet b23b41846a694f24a76e3aa05d9e54b2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:39214
I20260709 12:23:40.033492 30668 catalog_manager.cc:5028] TS 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): tablet b23b41846a694f24a76e3aa05d9e54b2 (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
I20260709 12:23:40.038990 30680 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48042 (request call id 180) took 4626 ms. Trace:
I20260709 12:23:40.042805 29609 tablet_replica.cc:333] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.048195 29609 raft_consensus.cc:2243] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.041915 30680 rpcz_store.cc:276] 0709 12:23:35.412825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:35.413007 (+   182us) service_pool.cc:224] Handling call
0709 12:23:40.038891 (+4625884us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:39.479554 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:39.480115 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:39.480157 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:23:39.480173 (+    16us) tablet.cc:662] Decoding operations
0709 12:23:39.486774 (+  6601us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:39.486862 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:39.486904 (+    42us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:23:39.559671 (+ 72767us) tablet.cc:701] Row locks acquired
0709 12:23:39.559690 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:39.569820 (+ 10130us) write_op.cc:270] Start()
0709 12:23:39.572021 (+  2201us) write_op.cc:276] Timestamp: P: 1783599819563215 usec, L: 0
0709 12:23:39.572983 (+   962us) op_driver.cc:348] REPLICATION: starting
0709 12:23:39.586192 (+ 13209us) log.cc:844] Serialized 9908 byte log entry
0709 12:23:39.616064 (+ 29872us) op_driver.cc:464] REPLICATION: finished
0709 12:23:39.632393 (+ 16329us) write_op.cc:301] APPLY: starting
0709 12:23:39.632487 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:39.634096 (+  1609us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:39.634212 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:39.636206 (+  1994us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:39.636562 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=50
0709 12:23:39.636612 (+    50us) write_op.cc:312] APPLY: finished
0709 12:23:39.637069 (+   457us) log.cc:844] Serialized 170 byte log entry
0709 12:23:39.637254 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.637489 (+   235us) write_op.cc:454] Released schema lock
0709 12:23:39.637548 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:39.638040 (+   492us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.638071 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":756,"reported_tablets":54,"spinlock_wait_cycles":162048,"child_traces":[["op",{"apply.queue_time_us":16046,"apply.run_cpu_time_us":5616,"apply.run_wall_time_us":5616,"num_ops":25,"prepare.queue_time_us":100348,"prepare.run_cpu_time_us":7810,"prepare.run_wall_time_us":108398,"replication_time_us":38874,"thread_start_us":87269,"threads_started":2}]]}
I20260709 12:23:40.078310 29609 raft_consensus.cc:2272] T d3635826198a49c885a3b5c762743eb3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.078485  2631 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.081609  2631 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:40.084937  2631 leader_election.cc:290] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:40.085513 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:40.088758 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:40.094558 30750 leader_election.cc:304] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:40.122082 29609 tablet_replica.cc:333] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.139240 29609 raft_consensus.cc:2243] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.139916 29609 pending_rounds.cc:70] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:40.140264 29609 pending_rounds.cc:77] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 9 index: 7 } timestamp: 7305624802344718336 op_type: NO_OP noop_request { }
I20260709 12:23:40.140741 29609 raft_consensus.cc:2889] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:40.141180 29609 raft_consensus.cc:2272] T b3e3882211ee442daf1d37e6649ccb9f P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.118450  2631 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:23:40.156093 30677 catalog_manager.cc:5697] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 6 to 11, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 11 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:40.158996 30677 catalog_manager.cc:5697] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 5 to 6, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 6 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:40.161402 30669 maintenance_manager.cc:643] P ed644613a0604f0ca9abeda3653f0a2f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.821s	user 0.163s	sys 0.075s Metrics: {"bytes_written":31067,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":241612,"dirs.run_cpu_time_us":426,"dirs.run_wall_time_us":20293,"drs_written":1,"lbm_read_time_us":418,"lbm_reads_lt_1ms":4,"lbm_write_time_us":120592,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":182553,"threads_started":1,"update_count":45}
W20260709 12:23:40.229743 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 61169.1us
W20260709 12:23:40.170282  2726 log.cc:927] Time spent T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:23:40.245288 30670 maintenance_manager.cc:419] P ed644613a0604f0ca9abeda3653f0a2f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7941 bytes on disk
I20260709 12:23:40.246150 29609 tablet_replica.cc:333] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.247072 29609 raft_consensus.cc:2243] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.247629 29609 pending_rounds.cc:70] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:40.247853 29609 pending_rounds.cc:77] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 11 index: 7 } timestamp: 7305624830523281408 op_type: NO_OP noop_request { }
I20260709 12:23:40.248195 29609 raft_consensus.cc:2889] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:40.248543 29609 raft_consensus.cc:2272] T d15199b73310443a816e4f4916c77ebb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.242980  2631 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.252978  2631 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:40.257161  2631 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:40.259035 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:23:40.244185 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:40.243110  2543 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.282979 30669 maintenance_manager.cc:643] P ed644613a0604f0ca9abeda3653f0a2f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.023s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":517,"lbm_reads_lt_1ms":4}
I20260709 12:23:40.283538 29609 tablet_replica.cc:333] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.284473 29609 raft_consensus.cc:2243] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:40.276054  2722 log.cc:927] Time spent T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.107s	user 0.005s	sys 0.000s
I20260709 12:23:40.285046 29609 raft_consensus.cc:2272] T 68688b51d09c48d6b63fec7f6e414d95 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.276216  2631 raft_consensus.cc:493] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.292181  2631 raft_consensus.cc:515] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:40.293107 29609 tablet_replica.cc:333] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.294123 29609 raft_consensus.cc:2243] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.294648 29609 pending_rounds.cc:70] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:40.294938 29609 pending_rounds.cc:77] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 13 index: 9 } timestamp: 7305624852283256832 op_type: NO_OP noop_request { }
I20260709 12:23:40.295365 29609 raft_consensus.cc:2889] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:40.295709 29609 raft_consensus.cc:2272] T e3496a4982a343f782fa2b4adc27d108 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.297645 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1b446a35b93488395d93db5de7d9d0b" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:40.297504  2543 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:40.299741  2543 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:40.302750 30750 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:40.304049  2543 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.307838 30859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:40.313454 29609 tablet_replica.cc:333] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.314532 29609 raft_consensus.cc:2243] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.315217 29609 raft_consensus.cc:2272] T 99ea8dcf093e47afa22421b9be4659ef P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:40.318791 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:40.320864 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:40.340714 30926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:40.343168 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:40.329160  2631 leader_election.cc:290] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:40.352030 30750 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:40.355404  2631 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:23:40.361999 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:40.365027 30857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464359e0b4944cf9868ca1cb6bd2546a" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:40.276109 30677 catalog_manager.cc:5697] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 5 to 8, leader changed from 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 8 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:40.370976 30750 leader_election.cc:304] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:40.384083 29609 tablet_replica.cc:333] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.388819  2631 raft_consensus.cc:2749] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:23:40.407297 30677 catalog_manager.cc:5697] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 5 to 7, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65). New cstate: current_term: 7 leader_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:40.510390 29609 raft_consensus.cc:2243] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.523674 29609 raft_consensus.cc:2272] T 5d9956c598e54d3cb1778d39d8196a85 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.522599 30677 catalog_manager.cc:5697] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 7 to 8, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.534986 29609 tablet_replica.cc:333] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.559000  2631 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.560021  2631 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:23:40.564872  2631 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:40.571645 30856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "764ebfd36ce64b2a86e6d290ae92e276" is_pre_election: true
I20260709 12:23:40.578627 30931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9506af0dc4e245e4a321265c053f82cb" candidate_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:23:40.585851 30750 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e7509fe1be74f179626fb4fcb4b4e65; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:23:40.593060  2631 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:23:40.610795 30853 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
W20260709 12:23:40.620442 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.621302 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 43815.3us
I20260709 12:23:40.671064 29609 raft_consensus.cc:2243] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:23:40.671341 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:40.672446 29609 raft_consensus.cc:2272] T de79bb6a5d7d4dea85d1e4029984c0d3 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.691159 30931 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:23:40.696030 30956 debug-util.cc:398] Leaking SignalData structure 0x7b08003cda60 after lost signal to thread 29612
W20260709 12:23:40.697909 30956 debug-util.cc:398] Leaking SignalData structure 0x7b08001977c0 after lost signal to thread 30716
W20260709 12:23:40.698664 30956 debug-util.cc:398] Leaking SignalData structure 0x7b0800190dc0 after lost signal to thread 30809
I20260709 12:23:40.703017 29609 tablet_replica.cc:333] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.704638 29609 raft_consensus.cc:2243] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.705451 29609 raft_consensus.cc:2272] T d1b446a35b93488395d93db5de7d9d0b P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:40.706179 30956 debug-util.cc:398] Leaking SignalData structure 0x7b080010c020 after lost signal to thread 30959
I20260709 12:23:40.725723 29609 tablet_replica.cc:333] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.726049  2688 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:23:40.729616 30826 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51aa6529d4b94351878a667ab81a26a8. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:40.734941 30956 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4cc0 after lost signal to thread 31535
W20260709 12:23:40.735371 30956 debug-util.cc:398] Leaking SignalData structure 0x7b080038a540 after lost signal to thread 31536
I20260709 12:23:40.746834 29609 raft_consensus.cc:2243] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.748386 29609 raft_consensus.cc:2272] T c5d48dd4a93a42d09268f3dee7887550 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:40.775844 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.781000 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 51872.8us
W20260709 12:23:40.784044 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:23:40.811088 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:40.819073 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.823841  2677 raft_consensus.cc:2955] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:40.846511 29609 tablet_replica.cc:333] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:40.859709 29609 raft_consensus.cc:2243] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.864655 30931 raft_consensus.cc:2955] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
W20260709 12:23:40.866175 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:40.888367  2631 raft_consensus.cc:670] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:23:40.893481 29609 raft_consensus.cc:2272] T be932375e2fb44fa82101764b7f51427 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.899040 29609 tablet_replica.cc:333] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
W20260709 12:23:40.927881 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:40.931252 30933 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
W20260709 12:23:40.933472 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.936578 30682 catalog_manager.cc:5697] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 9 to 10, leader changed from 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:40.943400 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:40.948164 29609 raft_consensus.cc:2243] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.949550 29609 raft_consensus.cc:2272] T 4e4b6cc51cc8447b9a8b62bee637d000 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:40.972162 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:40.978801 29609 tablet_replica.cc:333] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
W20260709 12:23:40.980026 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:40.985884 29609 raft_consensus.cc:2243] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.986886 29609 raft_consensus.cc:2272] T f58ba86a26f747dba6c34dc628302aaf P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.034343 29609 tablet_replica.cc:333] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.037618 30682 catalog_manager.cc:5697] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 11 to 12, leader changed from 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:41.039613 30682 catalog_manager.cc:5697] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.042143 30682 catalog_manager.cc:5697] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.049001 30853 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:23:41.053656 30900 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91c561a0b4404fcb8adb9d2002e0c15d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:41.062723 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:41.070230  2491 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:41.035285 29609 raft_consensus.cc:2243] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.119738 29609 raft_consensus.cc:2272] T 9506af0dc4e245e4a321265c053f82cb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:41.143183 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.146107 29609 tablet_replica.cc:333] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.147292 29609 raft_consensus.cc:2243] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.207710 29609 raft_consensus.cc:2272] T c98f068de024412f94b2929c4ee5d313 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.211156 29609 tablet_replica.cc:333] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.213230 29609 raft_consensus.cc:2243] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.214293 29609 raft_consensus.cc:2272] T e2f2d1a1b8c441c8958b81ea7473c359 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.222293 29609 tablet_replica.cc:333] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.223145 29609 raft_consensus.cc:2243] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.224226 29609 raft_consensus.cc:2272] T ea1fc0f15e994691a2edf5f0c3b096eb P 5e7509fe1be74f179626fb4fcb4b4e65 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.227361 29609 tablet_replica.cc:333] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.228215 29609 raft_consensus.cc:2243] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.229243 29609 raft_consensus.cc:2272] T 145501f8904547999755a27a5d421157 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.231961 29609 tablet_replica.cc:333] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.232932 29609 raft_consensus.cc:2243] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.233739 29609 raft_consensus.cc:2272] T 5a0380987e96472c9097a4c4df135a2c P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.236869 29609 tablet_replica.cc:333] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.237797 29609 raft_consensus.cc:2243] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.239640 29609 pending_rounds.cc:70] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:41.240520 29609 pending_rounds.cc:77] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7305624801610391552 op_type: NO_OP noop_request { }
I20260709 12:23:41.240965 29609 raft_consensus.cc:2889] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:41.241390 29609 raft_consensus.cc:2272] T 21608c221fae4caf8e15b6588f457432 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.244560 29609 tablet_replica.cc:333] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.245354 29609 raft_consensus.cc:2243] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.246212 29609 raft_consensus.cc:2272] T c32de69a76624466ad038a06e78980dd P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.249385 29609 tablet_replica.cc:333] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.250221 29609 raft_consensus.cc:2243] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.251672 29609 raft_consensus.cc:2272] T d22f521a944e4f66a81bcb842c1ae363 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.255173 29609 tablet_replica.cc:333] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.255949 29609 raft_consensus.cc:2243] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.257251 29609 raft_consensus.cc:2272] T b23b41846a694f24a76e3aa05d9e54b2 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.260275 29609 tablet_replica.cc:333] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.261103 29609 raft_consensus.cc:2243] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.263834 29609 raft_consensus.cc:2272] T 464359e0b4944cf9868ca1cb6bd2546a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.266846 29609 tablet_replica.cc:333] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.267647 29609 raft_consensus.cc:2243] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.268378 29609 raft_consensus.cc:2272] T 3bb0278198af4c1aba82199de860057a P 5e7509fe1be74f179626fb4fcb4b4e65 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.271433 29609 tablet_replica.cc:333] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.272255 29609 raft_consensus.cc:2243] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.273011 29609 raft_consensus.cc:2272] T 51aa6529d4b94351878a667ab81a26a8 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.275990 29609 tablet_replica.cc:333] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.277860 29609 raft_consensus.cc:2243] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.278453 29609 pending_rounds.cc:70] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 1 pending ops.
I20260709 12:23:41.278664 29609 pending_rounds.cc:77] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 8 index: 6 } timestamp: 7305624790582390784 op_type: NO_OP noop_request { }
I20260709 12:23:41.278977 29609 raft_consensus.cc:2889] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:41.279297 29609 raft_consensus.cc:2272] T c518d33b8e184a1089ca6c043d90c270 P 5e7509fe1be74f179626fb4fcb4b4e65 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:41.282027 29609 tablet_replica.cc:333] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: stopping tablet replica
I20260709 12:23:41.282569 29609 raft_consensus.cc:2243] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:41.283636 29609 pending_rounds.cc:70] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Trying to abort 2 pending ops.
I20260709 12:23:41.283951 29609 pending_rounds.cc:77] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 9 index: 8 } timestamp: 7305624844931674112 op_type: NO_OP noop_request { }
I20260709 12:23:41.284348 29609 raft_consensus.cc:2889] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:41.284639 29609 pending_rounds.cc:77] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65: Aborting op as it isn't in flight: id { term: 8 index: 7 } timestamp: 7305624812383993856 op_type: NO_OP noop_request { }
I20260709 12:23:41.285006 29609 raft_consensus.cc:2889] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:23:41.285342 29609 raft_consensus.cc:2272] T edd831e647294525a980327a839a575d P 5e7509fe1be74f179626fb4fcb4b4e65 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:41.292119 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.389946 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.422677 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.429901 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.461911 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.466369 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:41.457513 30682 catalog_manager.cc:5697] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.469321 30682 catalog_manager.cc:5697] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7857bffc34ce4e1db3617488701b9810" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:41.477449 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.499231 30899 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 383 similar messages]
W20260709 12:23:41.503811 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.507838 30677 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 206) took 16771 ms (client timeout 15000 ms). Trace:
W20260709 12:23:41.508351 30677 rpcz_store.cc:269] 0709 12:23:24.736881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:24.738514 (+  1633us) service_pool.cc:224] Handling call
0709 12:23:41.507704 (+16769190us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:40.654312 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:40.655029 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:40.655079 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:23:40.655115 (+    36us) tablet.cc:662] Decoding operations
0709 12:23:40.656033 (+   918us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:40.656162 (+   129us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:40.656192 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:23:40.656940 (+   748us) tablet.cc:701] Row locks acquired
0709 12:23:40.656990 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:23:40.657171 (+   181us) write_op.cc:270] Start()
0709 12:23:40.657328 (+   157us) write_op.cc:276] Timestamp: P: 1783599820657108 usec, L: 0
0709 12:23:40.657380 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 12:23:40.676272 (+ 18892us) log.cc:844] Serialized 2094 byte log entry
0709 12:23:40.734829 (+ 58557us) op_driver.cc:464] REPLICATION: finished
0709 12:23:40.803284 (+ 68455us) write_op.cc:301] APPLY: starting
0709 12:23:40.803398 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:40.851045 (+ 47647us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:40.851218 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:40.868711 (+ 17493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:40.869108 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:23:40.869181 (+    73us) write_op.cc:312] APPLY: finished
0709 12:23:40.873952 (+  4771us) log.cc:844] Serialized 57 byte log entry
0709 12:23:40.874183 (+   231us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:40.874308 (+   125us) write_op.cc:454] Released schema lock
0709 12:23:40.874394 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:40.874879 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:40.874911 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2237916,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":68046,"apply.run_cpu_time_us":17573,"apply.run_wall_time_us":71585,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18819,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":4531,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":5,"prepare.queue_time_us":18881,"prepare.run_cpu_time_us":4438,"prepare.run_wall_time_us":24477,"replication_time_us":77242,"thread_start_us":65510,"threads_started":2}]]}
W20260709 12:23:41.534020 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.540223 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.545580 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.550911 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:41.553682 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.562943 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.565651 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:41.553800  2747 ts_tablet_manager.cc:933] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:41.611610  2750 ts_tablet_manager.cc:933] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:23:41.609272  2676 raft_consensus.cc:2955] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:41.633436  2750 tablet_copy_client.cc:323] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:23:41.636333 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet 91c561a0b4404fcb8adb9d2002e0c15d from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:23:41.637020 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet 91c561a0b4404fcb8adb9d2002e0c15d from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-91c561a0b4404fcb8adb9d2002e0c15d
I20260709 12:23:41.658733  2747 tablet_copy_client.cc:323] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.66:33903
I20260709 12:23:41.667793 30870 tablet_copy_service.cc:140] P 764ebfd36ce64b2a86e6d290ae92e276: Received BeginTabletCopySession request for tablet 51aa6529d4b94351878a667ab81a26a8 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:41694)
I20260709 12:23:41.668655 30870 tablet_copy_service.cc:161] P 764ebfd36ce64b2a86e6d290ae92e276: Beginning new tablet copy session on tablet 51aa6529d4b94351878a667ab81a26a8 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:41694: session id = 7857bffc34ce4e1db3617488701b9810-51aa6529d4b94351878a667ab81a26a8
W20260709 12:23:41.698015 30900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 50866.8us
W20260709 12:23:41.698755 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:41.705298 30859 raft_consensus.cc:2955] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:41.708280 30851 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
W20260709 12:23:41.711404 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:41.712220 30945 tablet_copy_source_session.cc:215] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:41.725786 30933 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:23:41.715335 30682 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42312 (request call id 84) took 2432 ms. Trace:
W20260709 12:23:41.728775 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.726420 30682 rpcz_store.cc:276] 0709 12:23:39.283247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.284092 (+   845us) service_pool.cc:224] Handling call
0709 12:23:41.715244 (+2431152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:41.530427 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:41.531191 (+   764us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:41.531246 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:23:41.531275 (+    29us) tablet.cc:662] Decoding operations
0709 12:23:41.532431 (+  1156us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:41.532536 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:41.532580 (+    44us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:23:41.538983 (+  6403us) tablet.cc:701] Row locks acquired
0709 12:23:41.539015 (+    32us) write_op.cc:260] PREPARE: finished
0709 12:23:41.539225 (+   210us) write_op.cc:270] Start()
0709 12:23:41.539406 (+   181us) write_op.cc:276] Timestamp: P: 1783599821539161 usec, L: 0
0709 12:23:41.539439 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:23:41.540451 (+  1012us) log.cc:844] Serialized 2452 byte log entry
0709 12:23:41.613833 (+ 73382us) op_driver.cc:464] REPLICATION: finished
0709 12:23:41.664239 (+ 50406us) write_op.cc:301] APPLY: starting
0709 12:23:41.664349 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:41.684921 (+ 20572us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:41.685024 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:41.688502 (+  3478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:41.688765 (+   263us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:23:41.688811 (+    46us) write_op.cc:312] APPLY: finished
0709 12:23:41.689079 (+   268us) log.cc:844] Serialized 65 byte log entry
0709 12:23:41.689250 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:41.689365 (+   115us) write_op.cc:454] Released schema lock
0709 12:23:41.689408 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:41.696484 (+  7076us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:41.696524 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":532209,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":50088,"apply.run_cpu_time_us":9459,"apply.run_wall_time_us":25558,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":19811,"prepare.run_cpu_time_us":4825,"prepare.run_wall_time_us":10381,"replication_time_us":74153,"thread_start_us":65120,"threads_started":2}]]}
W20260709 12:23:41.730456 30826 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a6b5782c4be491f89e3db5e94722436. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.720980 30870 tablet_copy_source_session.cc:215] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:41.732887  2754 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:41.736367  2750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91c561a0b4404fcb8adb9d2002e0c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:41.718072 30680 catalog_manager.cc:5697] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.755136  2747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51aa6529d4b94351878a667ab81a26a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:41.770746 30680 catalog_manager.cc:5697] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 12, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } }
I20260709 12:23:41.786888 30680 catalog_manager.cc:5697] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 11 to 12, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.788475 30680 catalog_manager.cc:5697] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 13, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 13 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.792867  2644 raft_consensus.cc:2955] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:41.794938 30931 raft_consensus.cc:2955] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
W20260709 12:23:41.799078 30899 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:41.827723 30933 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:41.829871 30680 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 11 to 13, leader changed from 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) to 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66). New cstate: current_term: 13 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.832580  2750 tablet_copy_client.cc:806] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:41.831990 30680 catalog_manager.cc:5697] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.833511  2750 tablet_copy_client.cc:670] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:41.833945 30680 catalog_manager.cc:5697] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.835496 30680 catalog_manager.cc:5697] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.841657  2750 tablet_copy_client.cc:538] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:41.849861 30680 catalog_manager.cc:5697] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:41.867247 31476 connection.cc:573] client connection to 127.28.234.65:46329 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:23:41.872531 30900 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747): Couldn't send request to peer 7857bffc34ce4e1db3617488701b9810. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e5ec4b5b8a34d7192f60102179eb425. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:41.865182 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.877074 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:41.885439  2750 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:23:41.900687 30680 catalog_manager.cc:5697] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 6 to 8, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.911724 30857 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:23:41.914345  2747 tablet_copy_client.cc:806] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:41.915066  2747 tablet_copy_client.cc:670] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:41.920019  2747 tablet_copy_client.cc:538] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:41.922530  2696 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:41.927743 30680 catalog_manager.cc:5697] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 8 to 11, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 11 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.929594 30680 catalog_manager.cc:5697] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 7 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.938463 30680 catalog_manager.cc:5697] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 7 to 10, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:41.955133 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.959924 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:41.972493 30680 catalog_manager.cc:5697] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 9 to 12, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.977388 30680 catalog_manager.cc:5697] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
W20260709 12:23:41.979156 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:41.981878 30899 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.994710  2676 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:41.996716  2747 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:23:41.997210 30680 catalog_manager.cc:5697] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: term changed from 10 to 13, leader changed from 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 13 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } }
I20260709 12:23:41.999244 30859 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:42.083675  2750 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.087203  2750 tablet_bootstrap.cc:492] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:23:42.088197  2750 ts_tablet_manager.cc:1403] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.203s	user 0.049s	sys 0.009s
I20260709 12:23:42.104756  2750 raft_consensus.cc:359] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:42.117498  2750 raft_consensus.cc:740] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:23:42.128225  2750 consensus_queue.cc:260] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:42.135275  2750 ts_tablet_manager.cc:1434] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 12:23:42.137329 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-91c561a0b4404fcb8adb9d2002e0c15d received from {username='slave'} at 127.0.0.1:33366
I20260709 12:23:42.137939 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-91c561a0b4404fcb8adb9d2002e0c15d on tablet 91c561a0b4404fcb8adb9d2002e0c15d with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:42.170181  2750 ts_tablet_manager.cc:933] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:23:42.185931  2747 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.187079  2747 tablet_bootstrap.cc:492] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:23:42.187951  2747 ts_tablet_manager.cc:1403] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.192s	user 0.026s	sys 0.013s
I20260709 12:23:42.191689  2747 raft_consensus.cc:359] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:42.192723  2747 raft_consensus.cc:740] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:23:42.193614  2747 consensus_queue.cc:260] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:42.196646  2747 ts_tablet_manager.cc:1434] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:42.198884 30870 tablet_copy_service.cc:342] P 764ebfd36ce64b2a86e6d290ae92e276: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-51aa6529d4b94351878a667ab81a26a8 received from {username='slave'} at 127.0.0.1:41694
I20260709 12:23:42.199013  2750 tablet_copy_client.cc:323] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.66:33903
I20260709 12:23:42.199424 30870 tablet_copy_service.cc:434] P 764ebfd36ce64b2a86e6d290ae92e276: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-51aa6529d4b94351878a667ab81a26a8 on tablet 51aa6529d4b94351878a667ab81a26a8 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:42.201045 30870 tablet_copy_service.cc:140] P 764ebfd36ce64b2a86e6d290ae92e276: Received BeginTabletCopySession request for tablet 9a6b5782c4be491f89e3db5e94722436 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:41694)
I20260709 12:23:42.201618 30870 tablet_copy_service.cc:161] P 764ebfd36ce64b2a86e6d290ae92e276: Beginning new tablet copy session on tablet 9a6b5782c4be491f89e3db5e94722436 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:41694: session id = 7857bffc34ce4e1db3617488701b9810-9a6b5782c4be491f89e3db5e94722436
W20260709 12:23:42.206934 30806 debug-util.cc:398] Leaking SignalData structure 0x7b080019d840 after lost signal to thread 29612
W20260709 12:23:42.208338 30806 debug-util.cc:398] Leaking SignalData structure 0x7b0800278920 after lost signal to thread 30716
W20260709 12:23:42.209061 30806 debug-util.cc:398] Leaking SignalData structure 0x7b0800388d00 after lost signal to thread 30809
W20260709 12:23:42.210458 30806 debug-util.cc:398] Leaking SignalData structure 0x7b08002e46e0 after lost signal to thread 30884
W20260709 12:23:42.210834 30806 debug-util.cc:398] Leaking SignalData structure 0x7b08001ccfa0 after lost signal to thread 30885
W20260709 12:23:42.212093 30806 debug-util.cc:398] Leaking SignalData structure 0x7b0800356220 after lost signal to thread 30959
W20260709 12:23:42.212440 30806 debug-util.cc:398] Leaking SignalData structure 0x7b080018cf00 after lost signal to thread 30960
W20260709 12:23:42.213014 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.213908 30806 debug-util.cc:398] Leaking SignalData structure 0x7b080035dac0 after lost signal to thread 31535
W20260709 12:23:42.221822 30806 debug-util.cc:398] Leaking SignalData structure 0x7b0800334640 after lost signal to thread 31536
I20260709 12:23:42.232074 31507 raft_consensus.cc:1217] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
W20260709 12:23:42.235065 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:42.245385 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.216948 30870 tablet_copy_source_session.cc:215] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.220613 30680 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48042 (request call id 181) took 1830 ms. Trace:
I20260709 12:23:42.261847 30680 rpcz_store.cc:276] 0709 12:23:40.389882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.390073 (+   191us) service_pool.cc:224] Handling call
0709 12:23:42.220515 (+1830442us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:42.027841 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:42.028967 (+  1126us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:42.029008 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:23:42.029030 (+    22us) tablet.cc:662] Decoding operations
0709 12:23:42.030652 (+  1622us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:42.030724 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:42.030762 (+    38us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:23:42.032139 (+  1377us) tablet.cc:701] Row locks acquired
0709 12:23:42.032160 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:23:42.032423 (+   263us) write_op.cc:270] Start()
0709 12:23:42.032559 (+   136us) write_op.cc:276] Timestamp: P: 1783599822032363 usec, L: 0
0709 12:23:42.032581 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:23:42.033429 (+   848us) log.cc:844] Serialized 6353 byte log entry
0709 12:23:42.044962 (+ 11533us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18000ac360. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f961445641d 00007f961445871a 00007f96144586a8 00007f9614458628 00007f96144585e3 00007f96144577fc 00007f961688a2f6 00007f9616884aa8 00007f9610a2b310
0709 12:23:42.045025 (+    63us) op_driver.cc:464] REPLICATION: finished
0709 12:23:42.049993 (+  4968us) write_op.cc:301] APPLY: starting
0709 12:23:42.050082 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:42.051290 (+  1208us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b18000ac360. stack: 00007f960d900343 00007f960d900240 00007f960d28f1d4 00007f9616fcd304 00007f9616fcd299 00007f96167faab1 00007f9616807281 00007f960d932557 00007f960d9347c1 00007f960d934779 00007f960d934709 00007f960d9346d1 00007f960d9339cd 0000000000388634 0000000000388479 00007f960d91583a
0709 12:23:42.069174 (+ 17884us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:42.069221 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:42.110958 (+ 41737us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:42.111250 (+   292us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:23:42.111300 (+    50us) write_op.cc:312] APPLY: finished
0709 12:23:42.111689 (+   389us) log.cc:844] Serialized 148 byte log entry
0709 12:23:42.111883 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:42.112042 (+   159us) write_op.cc:454] Released schema lock
0709 12:23:42.112097 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:42.131238 (+ 19141us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:42.131271 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4973,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":4675,"apply.run_cpu_time_us":21396,"apply.run_wall_time_us":81207,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66912,"num_ops":16,"prepare.queue_time_us":169,"prepare.run_cpu_time_us":5758,"prepare.run_wall_time_us":5963,"replication_time_us":3418,"spinlock_wait_cycles":28153600}]]}
I20260709 12:23:42.269451  2750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a6b5782c4be491f89e3db5e94722436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.289973  2747 ts_tablet_manager.cc:933] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: Initiating tablet copy from peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:23:42.285995 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.309268  2747 tablet_copy_client.cc:323] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Beginning tablet copy session from remote peer at address 127.28.234.67:38729
I20260709 12:23:42.311791 30945 tablet_copy_service.cc:140] P 47c0d0bc235a443aad3c62643e91b081: Received BeginTabletCopySession request for tablet 3e5ec4b5b8a34d7192f60102179eb425 from peer 7857bffc34ce4e1db3617488701b9810 ({username='slave'} at 127.0.0.1:33366)
I20260709 12:23:42.312515 30945 tablet_copy_service.cc:161] P 47c0d0bc235a443aad3c62643e91b081: Beginning new tablet copy session on tablet 3e5ec4b5b8a34d7192f60102179eb425 from peer 7857bffc34ce4e1db3617488701b9810 at {username='slave'} at 127.0.0.1:33366: session id = 7857bffc34ce4e1db3617488701b9810-3e5ec4b5b8a34d7192f60102179eb425
I20260709 12:23:42.322903 30945 tablet_copy_source_session.cc:215] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.337953  2747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e5ec4b5b8a34d7192f60102179eb425. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:42.372984 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.386904 30682 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index -1 to 8, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:42.418135  2750 tablet_copy_client.cc:806] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.418840  2750 tablet_copy_client.cc:670] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.424394  2750 tablet_copy_client.cc:538] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.438310  2747 tablet_copy_client.cc:806] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.450770  2747 tablet_copy_client.cc:670] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.469540  2747 tablet_copy_client.cc:538] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:23:42.473544 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:42.478935 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.492636 31507 raft_consensus.cc:1217] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.7->[8.8-8.8]   Dedup: 8.8->[]
W20260709 12:23:42.495555 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:23:42.522187  2747 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
I20260709 12:23:42.524624  2750 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: Bootstrap starting.
W20260709 12:23:42.564079 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.564899 30679 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 207) took 2601 ms. Trace:
I20260709 12:23:42.565376 30679 rpcz_store.cc:276] 0709 12:23:39.963602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:39.963770 (+   168us) service_pool.cc:224] Handling call
0709 12:23:42.564681 (+2600911us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2312,"reported_tablets":55}
W20260709 12:23:42.577530 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.610585 30680 catalog_manager.cc:5697] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index -1 to 6, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
W20260709 12:23:42.613000 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.613585 30680 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index -1 to 7, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } } }
I20260709 12:23:42.615412 30680 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index -1 to 8, NON_VOTER 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) added. New cstate: current_term: 12 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:42.661231 30678 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48052 (request call id 205) took 39280 ms (client timeout 15000 ms). Trace:
W20260709 12:23:42.661792 30678 rpcz_store.cc:269] 0709 12:23:03.384053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:03.384705 (+   652us) service_pool.cc:224] Handling call
0709 12:23:42.661003 (+39276298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137178,"reported_tablets":54}
W20260709 12:23:42.707804 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:42.713904 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:42.742311  2754 raft_consensus.cc:1064] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
W20260709 12:23:42.743628 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:42.746452  2754 consensus_queue.cc:237] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:42.785446 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:42.862319 31507 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:42.883821  2747 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.894713  2747 tablet_bootstrap.cc:492] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:23:42.889174 30931 raft_consensus.cc:1275] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:23:42.887583  2754 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:23:42.896226 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.897140  2747 ts_tablet_manager.cc:1403] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.375s	user 0.038s	sys 0.008s
I20260709 12:23:42.909861  2747 raft_consensus.cc:359] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:42.911006  2747 raft_consensus.cc:740] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:23:42.911835  2747 consensus_queue.cc:260] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:42.904284  2754 consensus_queue.cc:1048] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:42.915910  2747 ts_tablet_manager.cc:1434] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
W20260709 12:23:42.926110  2770 log.cc:927] Time spent T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:42.929045 30945 tablet_copy_service.cc:342] P 47c0d0bc235a443aad3c62643e91b081: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-3e5ec4b5b8a34d7192f60102179eb425 received from {username='slave'} at 127.0.0.1:33366
I20260709 12:23:42.929607 30945 tablet_copy_service.cc:434] P 47c0d0bc235a443aad3c62643e91b081: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-3e5ec4b5b8a34d7192f60102179eb425 on tablet 3e5ec4b5b8a34d7192f60102179eb425 with peer 7857bffc34ce4e1db3617488701b9810
W20260709 12:23:42.942687 29609 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30806)
I20260709 12:23:42.948519  2750 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.973814  2750 tablet_bootstrap.cc:492] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: Bootstrap complete.
I20260709 12:23:42.974679  2750 ts_tablet_manager.cc:1403] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: Time spent bootstrapping tablet: real 0.463s	user 0.035s	sys 0.008s
W20260709 12:23:42.974764 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:42.984424  2750 raft_consensus.cc:359] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:42.991262  2750 raft_consensus.cc:740] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 7857bffc34ce4e1db3617488701b9810, State: Initialized, Role: LEARNER
I20260709 12:23:42.992661  2750 consensus_queue.cc:260] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: NON_VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: true } }
I20260709 12:23:43.001708  2750 ts_tablet_manager.cc:1434] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.004s
I20260709 12:23:43.025717 30870 tablet_copy_service.cc:342] P 764ebfd36ce64b2a86e6d290ae92e276: Request end of tablet copy session 7857bffc34ce4e1db3617488701b9810-9a6b5782c4be491f89e3db5e94722436 received from {username='slave'} at 127.0.0.1:41694
I20260709 12:23:43.027052 30870 tablet_copy_service.cc:434] P 764ebfd36ce64b2a86e6d290ae92e276: ending tablet copy session 7857bffc34ce4e1db3617488701b9810-9a6b5782c4be491f89e3db5e94722436 on tablet 9a6b5782c4be491f89e3db5e94722436 with peer 7857bffc34ce4e1db3617488701b9810
I20260709 12:23:43.036079  2754 raft_consensus.cc:2955] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:43.057874  2676 raft_consensus.cc:1064] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:23:43.047328 30931 raft_consensus.cc:2955] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:43.064649  2676 consensus_queue.cc:237] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:43.146515 31507 raft_consensus.cc:1217] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
W20260709 12:23:43.159827 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.169490 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:23:43.192987 31507 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:43.194965  2676 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:43.188823 30678 catalog_manager.cc:5697] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 6 to 7, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:43.205525 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:43.208231 30851 raft_consensus.cc:1275] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:23:43.211179 31502 raft_consensus.cc:2955] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:43.221665  2641 consensus_queue.cc:1048] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:23:43.287461 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:43.291181  2676 raft_consensus.cc:2955] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:43.294864 30859 raft_consensus.cc:2955] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:43.314644 31502 raft_consensus.cc:1217] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:23:43.374158 31502 raft_consensus.cc:2955] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:43.397523 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:43.398793 30678 catalog_manager.cc:5697] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 reported cstate change: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:43.408995 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:43.415232 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.415786 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.483003 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.515753 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:43.578838 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:43.608523 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:43.664541 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:43.671619 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:43.746124  2754 raft_consensus.cc:1064] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:23:43.749198  2754 consensus_queue.cc:237] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:43.794368 31502 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 LEARNER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:43.796022 30931 raft_consensus.cc:1275] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:23:43.800421  2746 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:43.801307  2644 consensus_queue.cc:1048] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:23:43.805536 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:43.833392 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:43.861150  2556 raft_consensus.cc:1064] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: attempting to promote NON_VOTER 7857bffc34ce4e1db3617488701b9810 to VOTER
I20260709 12:23:43.864993  2556 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:43.875190 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:43.898862  2776 raft_consensus.cc:2955] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:43.904765 30931 raft_consensus.cc:2955] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:43.927742 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:43.943203 29609 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:43.957845 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:43.962270 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:43.945267 30678 catalog_manager.cc:5697] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:43.986995 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:44.017835 31502 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 LEARNER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:44.023638 30855 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:23:44.023643  2676 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:44.032542 31502 raft_consensus.cc:2955] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:44.034403  2572 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:23:44.050936 30899 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:44.065436 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.067612 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.126093 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.126858 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.127374 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.130630 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:44.131953  2641 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:44.143937 30856 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:44.145686 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:44.151824 31507 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:44.194875 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:44.214682 30680 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 7 to 8, 7857bffc34ce4e1db3617488701b9810 (127.28.234.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } attrs { replace: true } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:44.244537 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:44.254767 30931 consensus_queue.cc:237] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:23:44.271868 31507 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:44.273952 30851 raft_consensus.cc:1275] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:23:44.275776  2641 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:23:44.277115  2572 consensus_queue.cc:1048] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:44.301179  2556 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:44.312544 31507 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:44.305263 30851 raft_consensus.cc:2955] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:44.325103 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:44.340636 30678 catalog_manager.cc:5697] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 8 to 9, VOTER 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65) evicted. New cstate: current_term: 10 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:44.364753 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:23:44.395514 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e5ec4b5b8a34d7192f60102179eb425 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:23:44.420384 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3e5ec4b5b8a34d7192f60102179eb425: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:23:44.432384 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:44.486377 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.490446 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.648926 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.778604 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.806190 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.812703 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:44.820685 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.854525 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:44.888614 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.943746 29609 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:44.950445 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:44.978541 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.023146 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.080833 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:45.206121 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.227670 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:45.257779 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:45.302170 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.347770 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.415151 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:45.476821 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:45.596204 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:45.623521 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:45.654538 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3e5ec4b5b8a34d7192f60102179eb425: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:23:45.718664 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.755934 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:45.833025 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:45.895489 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:45.944294 29609 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:45.950030 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.019356 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.019606 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.019917 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.035341 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.069607 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.133796 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:46.192657 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.300855 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.368033 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.377597 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.407364 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.445161 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.471392 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.493000 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.510156 30899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111) [suppressed 531 similar messages]
W20260709 12:23:46.604187 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.663949 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:46.685539 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.722625 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.733368 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3e5ec4b5b8a34d7192f60102179eb425: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:23:46.740785 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.785909 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.807554 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.820178 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.876989 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.886524 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:46.911384 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:46.944798 29609 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:47.082687 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.212769 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.262058 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.265573 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.310206 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.464605 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.492431 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:47.544536 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.569406 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:47.572562 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:47.595665 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:47.652916 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.658138 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.658766 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.761343 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:47.773523 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.782243 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.854957 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:47.896426 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:47.945370 29609 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:48.154780 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.169072 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.199528 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:48.235427 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.259586 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.274365 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.285920 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.385603 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.568408 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:48.613883 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.647974 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:48.657028 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:48.671032 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.696933 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.706503 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:23:48.761699 30856 consensus_queue.cc:237] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:23:48.775161 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:48.810060 31502 raft_consensus.cc:1275] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Refusing update from remote peer 764ebfd36ce64b2a86e6d290ae92e276: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:23:48.816606  2808 consensus_queue.cc:1048] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:23:48.820801 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:48.851846  2644 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 3 to 8, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
I20260709 12:23:48.853106 31502 raft_consensus.cc:2955] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 3 to 8, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:48.854878 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:48.865506 30668 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64f8ac94405742eb87e6d195387d7c6f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
W20260709 12:23:48.881211 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:48.945946 29609 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:48.941962 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 79080.1us
W20260709 12:23:48.961720 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3e5ec4b5b8a34d7192f60102179eb425: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:23:48.963940 30678 catalog_manager.cc:5697] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 reported cstate change: config changed from index 3 to 8, VOTER 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67) evicted. New cstate: current_term: 8 leader_uuid: "764ebfd36ce64b2a86e6d290ae92e276" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } } }
W20260709 12:23:49.074754 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:49.078552 30916 tablet_service.cc:1558] Processing DeleteTablet for tablet 64f8ac94405742eb87e6d195387d7c6f with delete_type TABLET_DATA_TOMBSTONED (TS 47c0d0bc235a443aad3c62643e91b081 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:49608
W20260709 12:23:49.079620 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.092779 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.123404 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:23:49.130816  2819 tablet_replica.cc:333] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
W20260709 12:23:49.130816 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:49.137959  2819 raft_consensus.cc:2243] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:49.138739  2819 raft_consensus.cc:2272] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:49.155539 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:23:49.161909  2819 ts_tablet_manager.cc:1916] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:49.232550  2819 ts_tablet_manager.cc:1929] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 12:23:49.240729  2819 log.cc:1199] T 64f8ac94405742eb87e6d195387d7c6f P 47c0d0bc235a443aad3c62643e91b081: Deleting WAL directory at /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/wals/64f8ac94405742eb87e6d195387d7c6f
I20260709 12:23:49.257026 30668 catalog_manager.cc:5028] TS 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): tablet 64f8ac94405742eb87e6d195387d7c6f (table test-workload [id=7c950502687e4d09a4581a48a2cf1944]) successfully deleted
W20260709 12:23:49.277384 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.278133 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.308120 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.387171 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.393150 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.393745 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.467274 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.520047 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.555428 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.621599 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.689302 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:49.743887 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.809921 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.880018 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.896387 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:49.937192 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:49.946512 29609 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:50.001652 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.087853 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:50.133458 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:50.167613 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.251376 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:50.286860 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.336838 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.389394 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.410732 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.477804 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.531193 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:50.537688 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:50.542096 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:50.628100 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:50.654248 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:50.892127 30899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 65760.8us
W20260709 12:23:50.903954 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:50.908150 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:33903, user_credentials={real_user=slave}} blocked reactor thread for 45809.2us
W20260709 12:23:50.925433 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:50.926831 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:50.947175 29609 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:50.964352 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:51.056382 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.086608 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 67604.3us
W20260709 12:23:51.099141 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:51.124029 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:51.146045 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:51.391041 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:51.470790 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:23:51.505910 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:51.518307 31476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111) [suppressed 489 similar messages]
W20260709 12:23:51.529913 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:51.640949 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:51.899152 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:51.947738 29609 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:51.998816 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.078295 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.123275 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.195394 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.241384 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.253865 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.254869 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.255465 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.256335 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.257217 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:52.278683 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.287902 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.428128 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.454646 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:52.496233 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.532855 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.548406 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.550709 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:52.586064 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.728696 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.738242 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.792521 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.813071 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:52.948298 29609 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:53.148391 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:53.154538 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.167470 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.170315 30826 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 85714.1us
W20260709 12:23:53.170686 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.195837 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3e5ec4b5b8a34d7192f60102179eb425: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:23:53.207233 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:53.221532 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.222784 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.229125 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.252928 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:53.331703 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:53.465144 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.493984 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.494990 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.533985 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:53.592979 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:53.613750 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.672214 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:53.745576 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.746179 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.764587 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.811515 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.814518 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.854974 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.889961 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:53.891971 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:53.948809 29609 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:53.975243 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:54.044103 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:23:54.130975 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.189514 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:54.261904 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.309698 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.402697 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.510644 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.522225 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.544327 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.669556 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.669814 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.683333 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.738058 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.798796 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.870196 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:54.945150 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:54.949327 29609 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:55.001775 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:55.027499 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.033931 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.059863 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.191223 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.192232 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.283958 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.303265 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.303750 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.366636 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:55.376155 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.401026 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:55.414408 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:55.532164 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.576766 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.731894 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.795671 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:55.885375 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:55.886811 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:55.918455 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:55.943696 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:55.949842 29609 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:56.014128 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.015311 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:56.052902 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:23:56.103335 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:56.220400 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:56.318202 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.325448 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:56.334617 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.357232 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:56.358275 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:56.404188 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.451912 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.465292 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:56.535884 30899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111) [suppressed 507 similar messages]
W20260709 12:23:56.588313 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:56.608660 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.624257 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.651222 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.683979 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:56.766825 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:23:56.797710 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:56.955307 29609 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:56.965557 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:56.975123 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.066083 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.142951 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.187832 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.212899 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:57.257738 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.285475 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.322402 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.479663 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.553049 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.603885 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.629691 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.643873 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.645967 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:57.708415 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.787747 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.794716 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.797951 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:57.813544 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:57.872967 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.901858 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:57.955801 29609 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:58.107626 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.108431 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.246675 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:58.270567 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:58.283900 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.322028 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:58.341881 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:58.353834 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.354830 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.409547 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:58.519794 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:58.553897 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:58.607633 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.611397 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:58.642287 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.691213 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.696378 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:23:58.774262 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:58.859972 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:23:58.881834 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:58.894881 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:58.956439 29609 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 30806)
W20260709 12:23:58.959410 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:59.014420 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.041790 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:59.052089 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.089000 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:23:59.411574 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.421648 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:23:59.442441 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.494905 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:23:59.560132 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.649508 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.733357 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.835858 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.898492 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:23:59.957017 29609 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 30806)
W20260709 12:24:00.012909 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:00.021420 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.025926 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.180462 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:00.436486 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.437723 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:00.442807 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:00.443840 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.444495 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.446854 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.447597 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.448359 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.473371 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.479367 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.484930 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.592622 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.660198 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.703048 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:00.747279 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:00.769261 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.940073 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.953425 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.957906 29609 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 30806)
W20260709 12:24:00.965637 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.970160 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:00.981110 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:00.985450 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:00.994903 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:01.075685 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.149051 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:01.170502 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.184259 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:01.211273 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.218206 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:01.245178 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:24:01.253515 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:01.275745 30881 debug-util.cc:398] Leaking SignalData structure 0x7b08003132e0 after lost signal to thread 29612
W20260709 12:24:01.277484 30881 debug-util.cc:398] Leaking SignalData structure 0x7b080031d800 after lost signal to thread 30716
W20260709 12:24:01.279552 30881 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7de0 after lost signal to thread 30884
W20260709 12:24:01.280128 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:01.281172 30881 debug-util.cc:398] Leaking SignalData structure 0x7b080016c1a0 after lost signal to thread 30959
W20260709 12:24:01.283066 30881 debug-util.cc:398] Leaking SignalData structure 0x7b0800332020 after lost signal to thread 31535
W20260709 12:24:01.311587 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:01.326095 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.483346 30667 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.234.65:46329, user_credentials={real_user=slave}} blocked reactor thread for 62075.9us
W20260709 12:24:01.493726 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:01.495141 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3e5ec4b5b8a34d7192f60102179eb425: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:01.538781 30899 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111) [suppressed 504 similar messages]
W20260709 12:24:01.545065 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.621986 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:01.629659 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:01.703877 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:24:01.727049 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.935591 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:01.938568 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:01.957005 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:01.962847 29609 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 30806)
W20260709 12:24:01.985270 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.018786 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.315644 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.447536 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.479561 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.537230 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.555603 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.674222 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:02.689940 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.742967 30825 consensus_peers.cc:597] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.755555 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.756361 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.811554 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:02.840379 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:02.858170 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:02.963416 29609 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 30806)
W20260709 12:24:02.965852 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:03.074564 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.076715 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.090619 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.122097 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:03.136837 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.166374 30825 consensus_peers.cc:597] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.212546 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.309999 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.363745 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:03.372504 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:03.411156 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:03.426251 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.452353 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.505400 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:03.530671 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:03.535789 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.644593 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:03.654294 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.666870 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:03.687408 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.698879 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.755002 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:24:03.780915 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.818365 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:03.862643 30825 consensus_peers.cc:597] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:03.883932 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:03.928251 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:04.015825 30825 consensus_peers.cc:597] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:04.046216 30825 consensus_peers.cc:597] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:24:04.076210 30825 consensus_peers.cc:597] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:24:04.271049 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:04.290150 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:04.292042 30825 consensus_peers.cc:597] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:04.329897 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:04.377890 30825 consensus_peers.cc:597] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:04.435503 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
W20260709 12:24:04.437999 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:04.654328 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:04.664567 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:04.740701 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:04.793139 30825 consensus_peers.cc:597] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:04.801740 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:04.914238 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
W20260709 12:24:04.940729 31477 consensus_peers.cc:597] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:04.971135 30900 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:04.975925 30900 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:04.984136 30900 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.004434 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:05.022202 30900 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.029488 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.033126 30900 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.094055 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.104847 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.122344 31477 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.124979 31477 consensus_peers.cc:597] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.129731 30900 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.140954 30900 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.159703 30900 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.160552 31477 consensus_peers.cc:597] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.168939 30900 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.174695 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:05.182469 29609 tablet_replica.cc:333] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.183979 29609 raft_consensus.cc:2243] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.188227 29609 raft_consensus.cc:2272] T 66c752ebb5cb4a9da00940d6b57922d7 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.192006 29609 tablet_replica.cc:333] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.186687 30900 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.194353 29609 raft_consensus.cc:2243] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.195451 29609 raft_consensus.cc:2272] T 2d2b1416a04848d99913731a9259dc8e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.197849 30900 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.199067 29609 tablet_replica.cc:333] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.210616 29609 raft_consensus.cc:2243] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.211553 29609 raft_consensus.cc:2272] T 84dde2d8ff054417a11a7ec410d2ffd2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.214882 29609 tablet_replica.cc:333] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.217269 31477 consensus_peers.cc:597] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.201074 30900 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.232473 31477 consensus_peers.cc:597] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.237138 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:05.240584 31477 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.241843 30900 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.242542 30900 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.244485 29609 raft_consensus.cc:2243] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:05.245891 29609 raft_consensus.cc:2272] T 6dc94a27f1f74fcea7449d3b7823d96e P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.249192 29609 tablet_replica.cc:333] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.258421 29609 raft_consensus.cc:2243] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:05.262791 30900 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.278971 31477 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.283306 29609 raft_consensus.cc:2272] T 91c561a0b4404fcb8adb9d2002e0c15d P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.278607 30900 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.288786 29609 tablet_replica.cc:333] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.285466 31477 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.297366 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.301676 30900 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.301966 29609 raft_consensus.cc:2243] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:24:05.305182 30900 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.307051 29609 raft_consensus.cc:2272] T 9a6b5782c4be491f89e3db5e94722436 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.313529 29609 tablet_replica.cc:333] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.323735 29609 raft_consensus.cc:2243] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 LEADER]: Raft consensus shutting down.
W20260709 12:24:05.322319 30900 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.330506 29609 raft_consensus.cc:2272] T 7fe828317ecc4cca97bd1b284e5f2785 P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.331411 30900 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.333552 30900 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.333901 29609 tablet_replica.cc:333] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.338541 29609 raft_consensus.cc:2243] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.342634 29609 raft_consensus.cc:2272] T c86ad2fde72a4917a713ec09d50d16ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.346248 29609 tablet_replica.cc:333] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.360833 29609 raft_consensus.cc:2243] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:05.353536 30900 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.361825 29609 raft_consensus.cc:2272] T bb8ca824cf6744b2ac7815f82ca8b276 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.362360 30900 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.363101 30900 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.365911 29609 tablet_replica.cc:333] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.370678 30900 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.375336 29609 raft_consensus.cc:2243] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.378903 29609 raft_consensus.cc:2272] T a17ff7050be449b8928f071ef46b1d4c P 764ebfd36ce64b2a86e6d290ae92e276 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.382396 29609 tablet_replica.cc:333] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.397627 29609 raft_consensus.cc:2243] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:05.384186 30900 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.401535 29609 raft_consensus.cc:2272] T fcf69f43966d4209837d8bca1cecb1ab P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.404871 29609 tablet_replica.cc:333] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.414516 30900 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.414635 29609 raft_consensus.cc:2243] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.422971 29609 raft_consensus.cc:2272] T f3139ddb2dda48ce8a138dbb3cf05035 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.426468 29609 tablet_replica.cc:333] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.427491 29609 raft_consensus.cc:2243] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.435086 29609 raft_consensus.cc:2272] T d1bb0331e5b641b99a413ba3e4475499 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.438725 29609 tablet_replica.cc:333] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.444324 30825 consensus_peers.cc:597] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:05.446259 30825 consensus_peers.cc:597] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.447170 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:05.447598 29609 raft_consensus.cc:2243] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.453750 29609 raft_consensus.cc:2272] T 99675411e6424bd6a95cbc666a5ece32 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.433122 30900 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.466439 30900 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:05.487263 30900 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:05.465606 29609 tablet_replica.cc:333] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.503033 29609 raft_consensus.cc:2243] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.524314 29609 raft_consensus.cc:2272] T 2323a4fe46444265864acf0869016ef4 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.549853 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:05.549935 29609 tablet_replica.cc:333] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.555245 29609 raft_consensus.cc:2243] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:05.560580 29609 raft_consensus.cc:2272] T 48c55f87983e421bae7549aa563643a2 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.572731 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:05.575035 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:05.589628 29609 tablet_replica.cc:333] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.590886 29609 raft_consensus.cc:2243] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.594054 29609 raft_consensus.cc:2272] T 3e5ec4b5b8a34d7192f60102179eb425 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.606652 29609 tablet_replica.cc:333] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.612811 29609 raft_consensus.cc:2243] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:05.623637 29609 raft_consensus.cc:2272] T 89472c03e684475c9254c1b3c2ad6350 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.635233 30825 consensus_peers.cc:597] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:05.646690 29609 tablet_replica.cc:333] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.647867 29609 raft_consensus.cc:2243] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:05.655409 29609 raft_consensus.cc:2272] T e6c0595eb2284ea9b8da2832d8558f7e P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.668071 29609 tablet_replica.cc:333] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.664958 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.668437 30825 consensus_peers.cc:597] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:05.672856 29609 raft_consensus.cc:2243] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.674206 29609 raft_consensus.cc:2272] T d1459f4eb71440ae996b2745034179c9 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.712040 29609 tablet_replica.cc:333] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.712908 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:05.721135 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.724458 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.737186 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:05.712919 29609 raft_consensus.cc:2243] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.749262 29609 raft_consensus.cc:2272] T abd414d2ac774e99a1548b0ff34a4f37 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.762746 29609 tablet_replica.cc:333] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.765193 29609 raft_consensus.cc:2243] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.768352 29609 raft_consensus.cc:2272] T ae2135797f024066b30a0fb14e174518 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.769907 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:05.792660 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:05.800472 29609 tablet_replica.cc:333] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.809806 29609 raft_consensus.cc:2243] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:24:05.812551 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:24:05.815459 29609 raft_consensus.cc:2272] T d15199b73310443a816e4f4916c77ebb P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:05.830156 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:24:05.830688 29609 tablet_replica.cc:333] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.832149 29609 raft_consensus.cc:2243] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:05.834450 29609 raft_consensus.cc:2272] T 64f8ac94405742eb87e6d195387d7c6f P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.838778 29609 tablet_replica.cc:333] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.839762 29609 raft_consensus.cc:2243] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.840493 29609 raft_consensus.cc:2272] T b3e3882211ee442daf1d37e6649ccb9f P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.843426 29609 tablet_replica.cc:333] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.844343 29609 raft_consensus.cc:2243] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.844954 29609 raft_consensus.cc:2272] T 49daeb92ae08415eb56869e7df8fc686 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.848320 29609 tablet_replica.cc:333] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.849259 29609 raft_consensus.cc:2243] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.850045 29609 raft_consensus.cc:2272] T ec82b6c4e54048a8a16a319c0cb38d23 P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.857784 29609 tablet_replica.cc:333] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.866240 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:24:05.867177 29609 raft_consensus.cc:2243] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.868203 29609 raft_consensus.cc:2272] T 68688b51d09c48d6b63fec7f6e414d95 P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.872236 29609 tablet_replica.cc:333] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.873346 29609 raft_consensus.cc:2243] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.874296 29609 raft_consensus.cc:2272] T e3496a4982a343f782fa2b4adc27d108 P 764ebfd36ce64b2a86e6d290ae92e276 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.877473 29609 tablet_replica.cc:333] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.878408 29609 raft_consensus.cc:2243] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:05.879812 29609 raft_consensus.cc:2272] T 21608c221fae4caf8e15b6588f457432 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.884160  2862 raft_consensus.cc:493] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:05.891212  2862 raft_consensus.cc:515] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:05.894742  2862 leader_election.cc:290] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:24:05.897363 29609 tablet_replica.cc:333] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.903223 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:05.903486 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ea8dcf093e47afa22421b9be4659ef" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:24:05.907387 30825 leader_election.cc:336] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:05.908821 30826 leader_election.cc:304] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:24:05.910419  2876 raft_consensus.cc:2749] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:05.918299 29609 raft_consensus.cc:2243] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.919173 29609 raft_consensus.cc:2272] T c32de69a76624466ad038a06e78980dd P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.931043 29609 tablet_replica.cc:333] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.931882 29609 raft_consensus.cc:2243] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.932663 29609 raft_consensus.cc:2272] T 464359e0b4944cf9868ca1cb6bd2546a P 764ebfd36ce64b2a86e6d290ae92e276 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.943933 29609 tablet_replica.cc:333] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.949134 29609 raft_consensus.cc:2243] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:05.962245 29609 raft_consensus.cc:2272] T d22f521a944e4f66a81bcb842c1ae363 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.968904 29609 tablet_replica.cc:333] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:05.972321 29609 raft_consensus.cc:2243] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:05.981665 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:05.981616 29609 raft_consensus.cc:2272] T e63671b1e5b245ca8343f52f6239b6ae P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:05.996948 29609 tablet_replica.cc:333] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:05.999543 30825 consensus_peers.cc:597] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:24:06.011169 29609 raft_consensus.cc:2243] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.012488 29609 raft_consensus.cc:2272] T d3635826198a49c885a3b5c762743eb3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.021899 29609 tablet_replica.cc:333] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:06.022905 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:06.023005 29609 raft_consensus.cc:2243] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.028115 29609 raft_consensus.cc:2272] T 576cba7acdde4bbda553612d2ad1076d P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.031384 29609 tablet_replica.cc:333] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.034504 29609 raft_consensus.cc:2243] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.037730 29609 raft_consensus.cc:2272] T f58ba86a26f747dba6c34dc628302aaf P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:06.053638 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:24:06.055754 29609 tablet_replica.cc:333] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.066748 29609 raft_consensus.cc:2243] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.074716 29609 raft_consensus.cc:2272] T 5d9956c598e54d3cb1778d39d8196a85 P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.077710 29609 tablet_replica.cc:333] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.078418  2862 raft_consensus.cc:493] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:06.078584 29609 raft_consensus.cc:2243] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.079376 29609 raft_consensus.cc:2272] T 99ea8dcf093e47afa22421b9be4659ef P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.079039  2862 raft_consensus.cc:515] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:06.081678  2862 leader_election.cc:290] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:24:06.083204 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd831e647294525a980327a839a575d" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:24:06.092355  2862 raft_consensus.cc:493] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:06.093029  2862 raft_consensus.cc:515] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:24:06.094127 30825 leader_election.cc:336] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.094985 29609 tablet_replica.cc:333] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.096009 29609 raft_consensus.cc:2243] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.096364  2862 leader_election.cc:290] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:24:06.096585 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145501f8904547999755a27a5d421157" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:24:06.097433 29609 raft_consensus.cc:2272] T 9506af0dc4e245e4a321265c053f82cb P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.099031 30825 leader_election.cc:304] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:24:06.100492 29609 tablet_replica.cc:333] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.101141  2876 raft_consensus.cc:2749] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:06.103397  2862 raft_consensus.cc:493] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7857bffc34ce4e1db3617488701b9810)
I20260709 12:24:06.105939 29609 raft_consensus.cc:2243] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.106055  2862 raft_consensus.cc:515] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:06.121481  2862 leader_election.cc:290] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:24:06.122704 29609 raft_consensus.cc:2272] T c98f068de024412f94b2929c4ee5d313 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.122521 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:24:06.123030 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:06.123133 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd65da5a34854820ae636ab77116f737" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:24:06.125656 29609 tablet_replica.cc:333] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.126626 29609 raft_consensus.cc:2243] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.126933 30826 leader_election.cc:304] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810
I20260709 12:24:06.127409 29609 raft_consensus.cc:2272] T 4e4b6cc51cc8447b9a8b62bee637d000 P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.127843  2862 raft_consensus.cc:2749] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:06.112618 30825 leader_election.cc:336] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.131903 30825 leader_election.cc:304] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:24:06.138561  2862 raft_consensus.cc:2749] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:06.139122 29609 tablet_replica.cc:333] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.143666 29609 raft_consensus.cc:2243] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.144665 29609 raft_consensus.cc:2272] T be932375e2fb44fa82101764b7f51427 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.147866 29609 tablet_replica.cc:333] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.166496 29609 raft_consensus.cc:2243] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.168112 29609 raft_consensus.cc:2272] T d1b446a35b93488395d93db5de7d9d0b P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.171240 29609 tablet_replica.cc:333] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.172153 29609 raft_consensus.cc:2243] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.182073 29609 raft_consensus.cc:2272] T de79bb6a5d7d4dea85d1e4029984c0d3 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.217403 29609 tablet_replica.cc:333] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.218333 29609 raft_consensus.cc:2243] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.219436 29609 raft_consensus.cc:2272] T 3bb0278198af4c1aba82199de860057a P 764ebfd36ce64b2a86e6d290ae92e276 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.238858 29609 tablet_replica.cc:333] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
W20260709 12:24:06.239490 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:06.244998 29609 raft_consensus.cc:2243] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.251941 29609 raft_consensus.cc:2272] T dd65da5a34854820ae636ab77116f737 P 764ebfd36ce64b2a86e6d290ae92e276 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.255648 29609 tablet_replica.cc:333] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.264055  2862 raft_consensus.cc:493] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:06.264670  2862 raft_consensus.cc:515] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:06.264842 29609 raft_consensus.cc:2243] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.267822  2862 leader_election.cc:290] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:24:06.268420 29609 raft_consensus.cc:2272] T 51aa6529d4b94351878a667ab81a26a8 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.271092 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a0380987e96472c9097a4c4df135a2c" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:24:06.273512 30825 leader_election.cc:336] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.274044 30825 leader_election.cc:304] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:24:06.275377  2862 raft_consensus.cc:2749] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:06.277642 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:06.281378 29609 tablet_replica.cc:333] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.283547 29609 raft_consensus.cc:2243] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:06.284832 29609 raft_consensus.cc:2272] T c5d48dd4a93a42d09268f3dee7887550 P 764ebfd36ce64b2a86e6d290ae92e276 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.295496 29609 tablet_replica.cc:333] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.296391 29609 raft_consensus.cc:2243] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.297246 29609 raft_consensus.cc:2272] T c518d33b8e184a1089ca6c043d90c270 P 764ebfd36ce64b2a86e6d290ae92e276 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.347249  2881 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.347996  2881 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:06.354748  2862 raft_consensus.cc:493] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:06.355340  2862 raft_consensus.cc:515] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:06.355562  2881 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:24:06.358695 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:24:06.359549 31506 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
W20260709 12:24:06.461735 30825 leader_election.cc:336] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.468565 29609 tablet_replica.cc:333] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.469352 29609 raft_consensus.cc:2243] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.470129 29609 raft_consensus.cc:2272] T edd831e647294525a980327a839a575d P 764ebfd36ce64b2a86e6d290ae92e276 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.473063 29609 tablet_replica.cc:333] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.475693 29609 raft_consensus.cc:2243] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.483530 29609 raft_consensus.cc:2272] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.501971  2862 leader_election.cc:290] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:24:06.510224 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2f2d1a1b8c441c8958b81ea7473c359" candidate_uuid: "764ebfd36ce64b2a86e6d290ae92e276" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:24:06.516292  2857 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.516917  2857 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:06.517306 29609 tablet_replica.cc:333] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.518388 29609 raft_consensus.cc:2243] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.519248 29609 raft_consensus.cc:2272] T 145501f8904547999755a27a5d421157 P 764ebfd36ce64b2a86e6d290ae92e276 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.522564 29609 tablet_replica.cc:333] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276: stopping tablet replica
I20260709 12:24:06.528748 29609 raft_consensus.cc:2243] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.530267 30826 leader_election.cc:304] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 764ebfd36ce64b2a86e6d290ae92e276; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
W20260709 12:24:06.537463 30826 raft_consensus.cc:2686] T e2f2d1a1b8c441c8958b81ea7473c359 P 764ebfd36ce64b2a86e6d290ae92e276: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:24:06.537684 29609 raft_consensus.cc:2272] T 5a0380987e96472c9097a4c4df135a2c P 764ebfd36ce64b2a86e6d290ae92e276 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.524037  2857 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:06.547283 30900 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 608 similar messages]
W20260709 12:24:06.566403 30899 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:06.567334 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:06.580060 30900 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:06.580610 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:06.582182  2882 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:06.582224 31477 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:38729, user_credentials={real_user=slave}} blocked reactor thread for 71574.4us
W20260709 12:24:06.636209 30900 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:06.639504 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:06.640167 30899 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.641887 30899 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:06.646137  2884 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:06.666355 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:06.677999  2881 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.680590  2881 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:06.683449  2881 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:06.685973 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:06.695935  2884 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.696668  2884 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:06.699633  2884 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:06.723317 30900 leader_election.cc:336] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:06.725077 30900 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:06.725571 30899 leader_election.cc:336] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.728472 30899 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:06.731721  2884 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:06.742621 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:06.743176 30899 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.749986 30899 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:06.750959  2884 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:06.751355 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:06.772890  2883 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.773548  2883 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:24:06.779619 31477 leader_election.cc:336] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:24:06.787210  2883 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:24:06.788704 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:24:06.793084 31477 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:06.794970  2883 raft_consensus.cc:2749] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:24:06.881064 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:06.900749  2884 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.901388  2884 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:06.903807  2884 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:06.910657 30900 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:06.911675 30899 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:06.912191 30899 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:06.913074  2884 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:06.952001  2884 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.952656  2884 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:06.955153  2884 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:24:06.956775 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:24:06.957597 31506 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 13.
I20260709 12:24:06.959748 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:24:06.960668  2884 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:06.961108  2884 raft_consensus.cc:493] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.961634  2884 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:06.962455 30900 leader_election.cc:336] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:06.967886 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:06.971738  2884 raft_consensus.cc:515] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:06.974304  2883 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:06.986235  2883 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:06.987761  2884 leader_election.cc:290] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 election: Requested vote from peers 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:24:06.988883  2883 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:06.994690 31477 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:07.014447 31476 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:07.015122 31476 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.017419  2883 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:07.026939  2884 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.027603  2884 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:07.030119  2884 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:07.034560 30899 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:07.037716 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:07.041592 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6c0595eb2284ea9b8da2832d8558f7e" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810"
I20260709 12:24:07.042393 31506 raft_consensus.cc:3060] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:07.052561 31506 raft_consensus.cc:2468] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 14.
I20260709 12:24:07.114970 30900 leader_election.cc:304] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 
I20260709 12:24:07.119472  2881 raft_consensus.cc:2804] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:07.120071  2881 raft_consensus.cc:697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 14 LEADER]: Becoming Leader. State: Replica: 47c0d0bc235a443aad3c62643e91b081, State: Running, Role: LEADER
I20260709 12:24:07.121052  2881 consensus_queue.cc:237] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:24:07.126940 30900 leader_election.cc:336] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.167083 30678 catalog_manager.cc:5697] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 reported cstate change: term changed from 13 to 14, leader changed from 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66) to 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67). New cstate: current_term: 14 leader_uuid: "47c0d0bc235a443aad3c62643e91b081" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:07.176681 30900 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.179687  2881 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.182943  2881 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:07.185339  2881 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:24:07.187122 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.190646  2881 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:07.212505  2889 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.213258  2889 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:24:07.213737 30899 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:07.218068  2889 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:07.224203 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:07.230597 30899 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:07.222483 30900 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.232219 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.233083  2889 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:07.243091 30900 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.243760 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.250912  2889 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:07.264887 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:07.307826 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:07.358057 31477 consensus_peers.cc:597] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.367902 30881 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2cc0 after lost signal to thread 29612
W20260709 12:24:07.369073 30881 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7e60 after lost signal to thread 30716
W20260709 12:24:07.369725 30881 debug-util.cc:398] Leaking SignalData structure 0x7b080016c0c0 after lost signal to thread 30884
W20260709 12:24:07.370951 30881 debug-util.cc:398] Leaking SignalData structure 0x7b080016c420 after lost signal to thread 30959
W20260709 12:24:07.372176 30881 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7620 after lost signal to thread 31535
W20260709 12:24:07.386183 30900 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:07.414048  2884 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.414801  2884 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:24:07.424815 31477 consensus_peers.cc:597] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:07.425783  2884 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:07.426635 30900 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:07.428181 30899 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:07.428762 30899 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.430047  2884 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:07.430465 30900 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.441357 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:07.479308 30900 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:07.482131  2884 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.482668  2884 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:24:07.489182 30899 leader_election.cc:336] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:07.490890  2884 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:07.497937 30900 leader_election.cc:336] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.499382  2879 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.499706 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.500052  2879 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:07.502357  2884 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:07.511531  2884 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.512293  2884 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:24:07.515913 31477 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.518326  2884 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:07.518616 31476 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:07.519079 30899 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:07.519436 31476 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:24:07.520020 30900 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:07.523828  2883 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:07.523880 30933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
I20260709 12:24:07.526168  2879 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:24:07.538734 30900 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:07.539515 31477 consensus_peers.cc:597] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:07.543319 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.544307  2884 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:07.554283 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:07.555088  2884 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.555712  2884 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:07.558037  2884 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:07.562474 30899 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:07.564373 30900 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.564841 30900 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.565631  2884 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:07.593066 31477 consensus_peers.cc:597] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.606632 30900 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.610357 30900 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:07.629233 31506 raft_consensus.cc:1275] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Refusing update from remote peer 47c0d0bc235a443aad3c62643e91b081: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:24:07.631985  2884 consensus_queue.cc:1048] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:24:07.657588 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:07.671271  2884 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:07.672137  2884 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:24:07.679823 30900 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:07.704981  2884 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
W20260709 12:24:07.708114 30900 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:07.710778 31507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:24:07.711524 31507 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:24:07.714056 30900 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.717816 30899 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:07.719775 30899 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:07.721577  2884 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:07.721658 30900 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.732002 30900 consensus_peers.cc:597] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:07.745910 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:07.756860 30900 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.759223 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:07.782588 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:07.784003 30900 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.801091 30900 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.801738 30900 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.802309 30900 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.809680 30900 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.817960 31477 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.822139 30900 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.828557 30900 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.829584 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:07.854079 30900 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.866237 30900 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.909024 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:07.932040 31477 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.943483 31477 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.954072 29609 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30881)
W20260709 12:24:07.959115 30900 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:07.959554 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:24:07.977545 31477 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.003464 30900 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.008369 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:08.009188 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.038240 30900 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.055999 31477 consensus_peers.cc:597] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.061228 30900 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.061826 30900 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.062340 30900 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.122991 30900 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.131240 30900 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.205996 30900 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:08.213685 30900 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:08.224777  2881 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.225489  2881 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:08.227994  2881 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:08.246042 30899 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:08.252677 30900 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:08.253352 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.254372  2881 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:08.257983 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.269896 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.283229 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.283806 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.335335 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.386436 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:24:08.393072  2883 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.394093  2883 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:08.399160  2881 raft_consensus.cc:493] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.399799  2881 raft_consensus.cc:515] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:08.402510  2881 leader_election.cc:290] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:08.402699 30900 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:08.403573  2883 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:24:08.404546 31477 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:08.405944 30930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "7857bffc34ce4e1db3617488701b9810" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "47c0d0bc235a443aad3c62643e91b081" is_pre_election: true
W20260709 12:24:08.406273 31476 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:08.406612 30930 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7857bffc34ce4e1db3617488701b9810 in term 12.
I20260709 12:24:08.406697 31476 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.407995  2879 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:08.415500 30900 leader_election.cc:336] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:08.416424 30899 leader_election.cc:336] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:08.416937 30899 leader_election.cc:304] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.418112  2881 raft_consensus.cc:2749] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:08.424507  2881 raft_consensus.cc:493] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.425149  2881 raft_consensus.cc:515] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:08.427446  2881 leader_election.cc:290] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:08.434703 30900 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:08.441042 30899 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:24:08.441718 30899 leader_election.cc:336] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:08.442427 30899 leader_election.cc:304] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.443401  2881 raft_consensus.cc:2749] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:08.467852  2889 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.468642  2889 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:08.471278  2889 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:08.485805 30899 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:08.490183 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.494102 30900 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:08.494837 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.495877  2896 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:08.528017 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:08.585462 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:08.660568 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:08.685871  2879 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.686492  2879 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
W20260709 12:24:08.698014 31477 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:08.701475 31476 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:08.702116 31476 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.702957  2883 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:08.703178  2879 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:08.720644 30899 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:24:08.721280 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:08.787225  2889 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.788582  2889 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:08.792680  2889 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:08.807044 30899 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:08.818158 30899 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.821254 30900 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:08.821946 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.822899  2896 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:08.835162 30899 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:08.859140  2889 raft_consensus.cc:493] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:08.859807  2889 raft_consensus.cc:515] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:08.864868  2889 leader_election.cc:290] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:08.867225 30899 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:08.872061 30900 leader_election.cc:336] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:08.872619 30900 leader_election.cc:304] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:08.873405  2889 raft_consensus.cc:2749] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:08.954618 29609 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30881)
W20260709 12:24:08.997392 30899 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:08.999720 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:24:09.007481 30899 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:09.029940 30899 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:09.072932  2889 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:09.073678  2889 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:09.082659  2889 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:09.091003 30900 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:09.093591 30899 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:09.094120 30899 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:09.094941  2889 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:09.199292 30899 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:09.202697 30899 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:09.279603 30899 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:09.382669  2889 raft_consensus.cc:493] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:09.383433  2889 raft_consensus.cc:515] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:24:09.393668 30899 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:09.408517  2889 leader_election.cc:290] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:24:09.433044  2889 raft_consensus.cc:493] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:09.433807  2889 raft_consensus.cc:515] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:09.439371  2889 leader_election.cc:290] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:09.472779 30900 leader_election.cc:336] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:09.483214 30900 leader_election.cc:304] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:09.484234  2881 raft_consensus.cc:2749] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:09.482442 30899 leader_election.cc:336] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:09.515125 30900 leader_election.cc:336] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:09.515838 30900 leader_election.cc:304] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:09.517704  2889 raft_consensus.cc:2749] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:09.556658 30899 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:09.573529 30899 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:09.590696  2889 raft_consensus.cc:493] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:09.591356  2889 raft_consensus.cc:515] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:09.593924  2889 leader_election.cc:290] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:09.614148 30900 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:09.618557 30899 leader_election.cc:336] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:09.619206 30899 leader_election.cc:304] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:09.629714  2898 raft_consensus.cc:2749] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:09.676952  2889 raft_consensus.cc:493] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:09.677608  2889 raft_consensus.cc:515] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:09.680078  2889 leader_election.cc:290] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:09.685248 30900 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:09.713554 30899 leader_election.cc:336] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:09.714290 30899 leader_election.cc:304] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:09.725169  2898 raft_consensus.cc:2749] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:09.758080  2898 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:09.758709  2898 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:09.762320  2898 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:24:09.769019 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51aa6529d4b94351878a667ab81a26a8" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:24:09.769788 31506 raft_consensus.cc:2468] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 8.
W20260709 12:24:09.800818 30899 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:09.819614 30899 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:09.825382 30900 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:09.826104 30900 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:09.831984  2898 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:09.879395 30900 consensus_peers.cc:597] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:09.886018 30899 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:09.926709 31477 consensus_peers.cc:597] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:09.954092 31477 consensus_peers.cc:597] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:09.955641 29609 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30881)
W20260709 12:24:09.969828 30900 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:09.982574 31477 consensus_peers.cc:597] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.006567 31476 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:24:10.011070 30900 consensus_peers.cc:597] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.024794 30899 consensus_peers.cc:597] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:10.047479 30900 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.075963 30899 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 12:24:10.082415 30900 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.109978 30900 consensus_peers.cc:597] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.141940 30899 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:10.154098 30899 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:10.163957 30900 consensus_peers.cc:597] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.184621 31476 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:24:10.196725 30900 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.247367 31477 consensus_peers.cc:597] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.267087 30900 consensus_peers.cc:597] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.282981 31477 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.288369 30900 consensus_peers.cc:597] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.292816 30900 consensus_peers.cc:597] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.293394 30900 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.302165 31476 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:24:10.311362 30900 consensus_peers.cc:597] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:10.320369  2898 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:10.321085  2898 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:10.323982  2898 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 7857bffc34ce4e1db3617488701b9810 (127.28.234.68:38747)
I20260709 12:24:10.328513 31506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a6b5782c4be491f89e3db5e94722436" candidate_uuid: "47c0d0bc235a443aad3c62643e91b081" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7857bffc34ce4e1db3617488701b9810" is_pre_election: true
I20260709 12:24:10.329291 31506 raft_consensus.cc:2468] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c0d0bc235a443aad3c62643e91b081 in term 12.
W20260709 12:24:10.337395 30899 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:10.339541 30900 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:10.340159 30900 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081, 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:10.341037  2898 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:10.345453 30900 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.350219 30900 consensus_peers.cc:597] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.363363 30900 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.363960 30900 consensus_peers.cc:597] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.365499 31477 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.366374 30900 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.385632 31476 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:10.407239  2898 raft_consensus.cc:493] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:10.407807  2898 raft_consensus.cc:515] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
W20260709 12:24:10.422541 30899 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:10.425215 30900 consensus_peers.cc:597] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:10.426780  2898 leader_election.cc:290] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:10.452739 30900 consensus_peers.cc:597] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.461367 31476 consensus_peers.cc:597] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
W20260709 12:24:10.463655 30900 leader_election.cc:336] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:10.464367 30900 leader_election.cc:304] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:10.466614  2896 raft_consensus.cc:2749] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:10.485033 30900 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.486307 30899 consensus_peers.cc:597] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:10.536718 31477 consensus_peers.cc:597] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.571213 31476 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
W20260709 12:24:10.587404 31477 consensus_peers.cc:597] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:10.591673  2898 raft_consensus.cc:493] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:10.592669  2898 raft_consensus.cc:515] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:10.595140  2898 leader_election.cc:290] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:10.600536 30900 consensus_peers.cc:597] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.613886 30899 consensus_peers.cc:597] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:10.616315  2898 raft_consensus.cc:493] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:10.617527  2898 raft_consensus.cc:515] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:10.620373  2898 leader_election.cc:290] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:10.626380 30900 consensus_peers.cc:597] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.635910 30899 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:10.638159 30899 consensus_peers.cc:597] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:10.644341 30899 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:10.644490 30900 leader_election.cc:336] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:10.645108 30900 leader_election.cc:304] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:24:10.646179 30900 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:10.646706  2896 raft_consensus.cc:2749] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:10.646754 30900 consensus_peers.cc:597] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.650556 30900 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.655941 30900 leader_election.cc:336] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:10.656504 30900 leader_election.cc:304] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:10.657325  2896 raft_consensus.cc:2749] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:10.662375 30900 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.663235 30899 consensus_peers.cc:597] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:10.671806 30899 consensus_peers.cc:597] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
W20260709 12:24:10.689520 31477 consensus_peers.cc:597] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:10.703015 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
W20260709 12:24:10.709144 30900 consensus_peers.cc:597] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.773689 30900 consensus_peers.cc:597] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.774500 30900 consensus_peers.cc:597] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:24:10.787114 30899 consensus_peers.cc:597] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:10.848780 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
W20260709 12:24:10.918849 31477 consensus_peers.cc:597] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:10.923444 30899 consensus_peers.cc:597] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:10.924947 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:10.926047 29609 tablet_replica.cc:333] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:10.926939 29609 raft_consensus.cc:2243] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.929234 29609 raft_consensus.cc:2272] T 66c752ebb5cb4a9da00940d6b57922d7 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.932441 29609 tablet_replica.cc:333] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:10.933423 29609 raft_consensus.cc:2243] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:10.934758 29609 raft_consensus.cc:2272] T 2d2b1416a04848d99913731a9259dc8e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:10.938143 30900 consensus_peers.cc:597] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 -> Peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Couldn't send request to peer 764ebfd36ce64b2a86e6d290ae92e276. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:10.939765 29609 tablet_replica.cc:333] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:10.940723 29609 raft_consensus.cc:2243] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.941448 29609 raft_consensus.cc:2272] T 6dc94a27f1f74fcea7449d3b7823d96e P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.944353 29609 tablet_replica.cc:333] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:10.945246 29609 raft_consensus.cc:2243] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.946033 29609 raft_consensus.cc:2272] T 84dde2d8ff054417a11a7ec410d2ffd2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.948844 29609 tablet_replica.cc:333] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:10.949785 29609 raft_consensus.cc:2243] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.986505 29609 raft_consensus.cc:2272] T 9a6b5782c4be491f89e3db5e94722436 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.014609 30899 consensus_peers.cc:597] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:11.037963 29609 tablet_replica.cc:333] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
W20260709 12:24:11.043129 30899 consensus_peers.cc:597] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:11.047134 29609 raft_consensus.cc:2243] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.053095 29609 raft_consensus.cc:2272] T 7fe828317ecc4cca97bd1b284e5f2785 P 47c0d0bc235a443aad3c62643e91b081 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.051841 31477 consensus_peers.cc:597] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:11.054215 31477 consensus_peers.cc:597] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.058590 29609 tablet_replica.cc:333] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.060262 29609 raft_consensus.cc:2243] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.066054 29609 raft_consensus.cc:2272] T 91c561a0b4404fcb8adb9d2002e0c15d P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.067698 31477 consensus_peers.cc:597] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:11.071197 30899 consensus_peers.cc:597] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:11.080056 29609 tablet_replica.cc:333] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.081655  2889 raft_consensus.cc:493] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:11.082563 29609 raft_consensus.cc:2243] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:24:11.082916 31477 consensus_peers.cc:597] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.082816  2889 raft_consensus.cc:515] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } }
I20260709 12:24:11.085287 29609 raft_consensus.cc:2272] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.087029  2889 leader_election.cc:290] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
W20260709 12:24:11.081101 30899 consensus_peers.cc:597] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 71: this message will repeat every 5th retry.
I20260709 12:24:11.089808 29609 tablet_replica.cc:333] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.092664 29609 raft_consensus.cc:2243] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:11.093932 30899 consensus_peers.cc:597] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 12:24:11.094391 29609 raft_consensus.cc:2272] T 48c55f87983e421bae7549aa563643a2 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.099224 29609 tablet_replica.cc:333] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.100980 29609 raft_consensus.cc:2243] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:24:11.101186 30899 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:11.102730 30900 leader_election.cc:336] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:11.103261 30900 leader_election.cc:304] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47c0d0bc235a443aad3c62643e91b081; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:11.104179  2889 raft_consensus.cc:2749] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:11.105345 29609 raft_consensus.cc:2272] T bb8ca824cf6744b2ac7815f82ca8b276 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.109122 29609 tablet_replica.cc:333] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.111178 29609 raft_consensus.cc:2243] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.117195 29609 raft_consensus.cc:2272] T fcf69f43966d4209837d8bca1cecb1ab P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.119560  2909 raft_consensus.cc:493] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:11.120509  2909 raft_consensus.cc:515] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:11.122583 29609 tablet_replica.cc:333] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.123654  2909 leader_election.cc:290] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903)
I20260709 12:24:11.124162 29609 raft_consensus.cc:2243] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.126441 29609 raft_consensus.cc:2272] T a17ff7050be449b8928f071ef46b1d4c P 47c0d0bc235a443aad3c62643e91b081 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.129699 31476 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:11.130901 31477 leader_election.cc:336] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:11.131417 31477 leader_election.cc:304] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:11.132229  2909 raft_consensus.cc:2749] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:11.132483 29609 tablet_replica.cc:333] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
W20260709 12:24:11.134410 30899 consensus_peers.cc:597] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 66: this message will repeat every 5th retry.
I20260709 12:24:11.134791 29609 raft_consensus.cc:2243] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.136782 29609 raft_consensus.cc:2272] T f3139ddb2dda48ce8a138dbb3cf05035 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.139689 29609 tablet_replica.cc:333] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.140372 29609 raft_consensus.cc:2243] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.141965 29609 raft_consensus.cc:2272] T 9cf061659071464dadafceeb712b1c5d P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.144464 29609 tablet_replica.cc:333] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.145248 29609 raft_consensus.cc:2243] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.146838 29609 raft_consensus.cc:2272] T 3e5ec4b5b8a34d7192f60102179eb425 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.149550 29609 tablet_replica.cc:333] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.150318 29609 raft_consensus.cc:2243] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.151315 29609 raft_consensus.cc:2272] T 89472c03e684475c9254c1b3c2ad6350 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.153993 29609 tablet_replica.cc:333] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.154783 29609 raft_consensus.cc:2243] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.156584 29609 raft_consensus.cc:2272] T e6c0595eb2284ea9b8da2832d8558f7e P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.159677 29609 tablet_replica.cc:333] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.160687 29609 raft_consensus.cc:2243] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.161618 29609 raft_consensus.cc:2272] T d1459f4eb71440ae996b2745034179c9 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.165364 29609 tablet_replica.cc:333] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.166255 29609 raft_consensus.cc:2243] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.168220 29609 raft_consensus.cc:2272] T abd414d2ac774e99a1548b0ff34a4f37 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.170789 29609 tablet_replica.cc:333] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.171511 29609 raft_consensus.cc:2243] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.172196 29609 raft_consensus.cc:2272] T 49daeb92ae08415eb56869e7df8fc686 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.174613 29609 tablet_replica.cc:333] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.175272 29609 raft_consensus.cc:2243] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.176358 29609 raft_consensus.cc:2272] T 047196043bb744a6b94cb3b634b80771 P 47c0d0bc235a443aad3c62643e91b081 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.179000 29609 tablet_replica.cc:333] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.179981 29609 raft_consensus.cc:2243] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.180917 29609 raft_consensus.cc:2272] T d15199b73310443a816e4f4916c77ebb P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.183470 29609 tablet_replica.cc:333] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.184154 29609 raft_consensus.cc:2243] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.185863 29609 raft_consensus.cc:2272] T f58ba86a26f747dba6c34dc628302aaf P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.188625 29609 tablet_replica.cc:333] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.189558 29609 raft_consensus.cc:2243] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.190408 29609 raft_consensus.cc:2272] T 5d9956c598e54d3cb1778d39d8196a85 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.192968 29609 tablet_replica.cc:333] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.193897 29609 raft_consensus.cc:2243] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.196132 29609 raft_consensus.cc:2272] T 99ea8dcf093e47afa22421b9be4659ef P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.198983 29609 tablet_replica.cc:333] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.199994 29609 raft_consensus.cc:2243] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.200917 29609 raft_consensus.cc:2272] T 576cba7acdde4bbda553612d2ad1076d P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.204981 29609 tablet_replica.cc:333] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.206079 29609 raft_consensus.cc:2243] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.208871 29609 raft_consensus.cc:2272] T e63671b1e5b245ca8343f52f6239b6ae P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.212821 29609 tablet_replica.cc:333] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.214085 29609 raft_consensus.cc:2243] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.216516 29609 raft_consensus.cc:2272] T d3635826198a49c885a3b5c762743eb3 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.216317 31477 consensus_peers.cc:597] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.220996 29609 tablet_replica.cc:333] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.221951 29609 raft_consensus.cc:2243] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.223400 29609 raft_consensus.cc:2272] T 21608c221fae4caf8e15b6588f457432 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.227548 29609 tablet_replica.cc:333] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.228845 29609 raft_consensus.cc:2243] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:24:11.230156 30900 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.230716 29609 raft_consensus.cc:2272] T c32de69a76624466ad038a06e78980dd P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.234720 29609 tablet_replica.cc:333] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.235688 29609 raft_consensus.cc:2243] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.238207 29609 raft_consensus.cc:2272] T 464359e0b4944cf9868ca1cb6bd2546a P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.242448 29609 tablet_replica.cc:333] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.243528 29609 raft_consensus.cc:2243] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.245579 29609 raft_consensus.cc:2272] T d22f521a944e4f66a81bcb842c1ae363 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.249130 29609 tablet_replica.cc:333] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.250159 29609 raft_consensus.cc:2243] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.252660 29609 raft_consensus.cc:2272] T b23b41846a694f24a76e3aa05d9e54b2 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.256009 29609 tablet_replica.cc:333] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.256906 29609 raft_consensus.cc:2243] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.258898 29609 raft_consensus.cc:2272] T b3e3882211ee442daf1d37e6649ccb9f P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.262120 29609 tablet_replica.cc:333] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.262926 29609 raft_consensus.cc:2243] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.263839 29609 raft_consensus.cc:2272] T ea1fc0f15e994691a2edf5f0c3b096eb P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.266678 29609 tablet_replica.cc:333] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.267611 29609 raft_consensus.cc:2243] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.269012 29609 raft_consensus.cc:2272] T e2f2d1a1b8c441c8958b81ea7473c359 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.272233 29609 tablet_replica.cc:333] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.273021 29609 raft_consensus.cc:2243] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.275131 29609 raft_consensus.cc:2272] T ae2135797f024066b30a0fb14e174518 P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.278276 29609 tablet_replica.cc:333] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.279068 29609 raft_consensus.cc:2243] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.281008 29609 raft_consensus.cc:2272] T c518d33b8e184a1089ca6c043d90c270 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.284566 29609 tablet_replica.cc:333] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.285295 29609 raft_consensus.cc:2243] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:24:11.285888 31477 consensus_peers.cc:597] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.287073 29609 raft_consensus.cc:2272] T edd831e647294525a980327a839a575d P 47c0d0bc235a443aad3c62643e91b081 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.289978 29609 tablet_replica.cc:333] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.290596 29609 raft_consensus.cc:2243] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.292105 29609 raft_consensus.cc:2272] T 99675411e6424bd6a95cbc666a5ece32 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.294597 29609 tablet_replica.cc:333] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.295207 29609 raft_consensus.cc:2243] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.296221 29609 raft_consensus.cc:2272] T d1bb0331e5b641b99a413ba3e4475499 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.298694 29609 tablet_replica.cc:333] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.299292 29609 raft_consensus.cc:2243] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.300230 29609 raft_consensus.cc:2272] T d1b446a35b93488395d93db5de7d9d0b P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.302872 29609 tablet_replica.cc:333] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.303735 29609 raft_consensus.cc:2243] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.305361 29609 raft_consensus.cc:2272] T de79bb6a5d7d4dea85d1e4029984c0d3 P 47c0d0bc235a443aad3c62643e91b081 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.308588 29609 tablet_replica.cc:333] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.309429 29609 raft_consensus.cc:2243] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.310649 29609 raft_consensus.cc:2272] T dd65da5a34854820ae636ab77116f737 P 47c0d0bc235a443aad3c62643e91b081 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.313400 29609 tablet_replica.cc:333] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.314091 29609 raft_consensus.cc:2243] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.315470 29609 raft_consensus.cc:2272] T 51aa6529d4b94351878a667ab81a26a8 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.317989 29609 tablet_replica.cc:333] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.318840 29609 raft_consensus.cc:2243] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.320730 29609 raft_consensus.cc:2272] T 68688b51d09c48d6b63fec7f6e414d95 P 47c0d0bc235a443aad3c62643e91b081 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.324245 29609 tablet_replica.cc:333] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.324841 29609 raft_consensus.cc:2243] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.326627 29609 raft_consensus.cc:2272] T e3496a4982a343f782fa2b4adc27d108 P 47c0d0bc235a443aad3c62643e91b081 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.329941 29609 tablet_replica.cc:333] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.330617 29609 raft_consensus.cc:2243] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:11.331673 29609 raft_consensus.cc:2272] T 9506af0dc4e245e4a321265c053f82cb P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.334080 29609 tablet_replica.cc:333] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.334672 29609 raft_consensus.cc:2243] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.335757 29609 raft_consensus.cc:2272] T c98f068de024412f94b2929c4ee5d313 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.338497 29609 tablet_replica.cc:333] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.339296 29609 raft_consensus.cc:2243] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.340679 29609 raft_consensus.cc:2272] T 4e4b6cc51cc8447b9a8b62bee637d000 P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.344142 29609 tablet_replica.cc:333] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.344940 29609 raft_consensus.cc:2243] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.346709 29609 raft_consensus.cc:2272] T be932375e2fb44fa82101764b7f51427 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.350275 29609 tablet_replica.cc:333] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.351171 29609 raft_consensus.cc:2243] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:24:11.351464 31477 consensus_peers.cc:597] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 -> Peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Couldn't send request to peer 47c0d0bc235a443aad3c62643e91b081. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.352029 29609 raft_consensus.cc:2272] T c5d48dd4a93a42d09268f3dee7887550 P 47c0d0bc235a443aad3c62643e91b081 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.355074 29609 tablet_replica.cc:333] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.355697 29609 raft_consensus.cc:2243] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.357028 29609 raft_consensus.cc:2272] T 145501f8904547999755a27a5d421157 P 47c0d0bc235a443aad3c62643e91b081 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:11.359483 29609 tablet_replica.cc:333] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081: stopping tablet replica
I20260709 12:24:11.360040 29609 raft_consensus.cc:2243] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:24:11.361541 29609 raft_consensus.cc:2272] T 5a0380987e96472c9097a4c4df135a2c P 47c0d0bc235a443aad3c62643e91b081 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:11.547842 31477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111) [suppressed 820 similar messages]
I20260709 12:24:11.663612  2912 raft_consensus.cc:493] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:11.664425  2912 raft_consensus.cc:515] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:11.667375  2912 leader_election.cc:290] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:24:11.675328 31477 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:11.675899 31476 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:11.676357 31476 leader_election.cc:304] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
W20260709 12:24:11.676909 31477 leader_election.cc:336] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Network error: Client connection negotiation failed: client connection to 127.28.234.67:38729: connect: Connection refused (error 111)
W20260709 12:24:11.677103 31476 consensus_peers.cc:597] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 -> Peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Couldn't send request to peer 5e7509fe1be74f179626fb4fcb4b4e65. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111). This is attempt 76: this message will repeat every 5th retry.
I20260709 12:24:11.677964  2912 raft_consensus.cc:2749] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:12.097186  2913 raft_consensus.cc:493] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 764ebfd36ce64b2a86e6d290ae92e276)
I20260709 12:24:12.098162  2913 raft_consensus.cc:515] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } attrs { replace: true } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:12.101519  2913 leader_election.cc:290] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:24:12.106729 31476 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:12.109642 31477 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Network error: Client connection negotiation failed: client connection to 127.28.234.67:38729: connect: Connection refused (error 111)
I20260709 12:24:12.110198 31477 leader_election.cc:304] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:24:12.111135  2913 raft_consensus.cc:2749] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:12.111155 31477 leader_election.cc:336] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
I20260709 12:24:12.113030  2912 raft_consensus.cc:493] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:12.113703  2912 raft_consensus.cc:515] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "764ebfd36ce64b2a86e6d290ae92e276" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 33903 } attrs { replace: true } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:12.116472  2912 leader_election.cc:290] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
I20260709 12:24:12.123832 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
W20260709 12:24:12.125854 31477 leader_election.cc:336] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 764ebfd36ce64b2a86e6d290ae92e276 (127.28.234.66:33903): Network error: Client connection negotiation failed: client connection to 127.28.234.66:33903: connect: Connection refused (error 111)
W20260709 12:24:12.126772 31477 leader_election.cc:336] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Network error: Client connection negotiation failed: client connection to 127.28.234.67:38729: connect: Connection refused (error 111)
W20260709 12:24:12.127254 31476 leader_election.cc:336] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:12.127700 31476 leader_election.cc:304] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 1 yes votes; 3 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65, 764ebfd36ce64b2a86e6d290ae92e276
I20260709 12:24:12.128525  2912 raft_consensus.cc:2749] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:12.230111  2912 raft_consensus.cc:493] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:12.231024  2912 raft_consensus.cc:515] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:12.234078  2912 leader_election.cc:290] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:24:12.239737 31476 leader_election.cc:336] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:12.242318 31477 leader_election.cc:336] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Network error: Client connection negotiation failed: client connection to 127.28.234.67:38729: connect: Connection refused (error 111)
I20260709 12:24:12.243013 31477 leader_election.cc:304] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:24:12.244009  2912 raft_consensus.cc:2749] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:12.250638 29609 tablet_server.cc:179] TabletServer@127.28.234.68:0 shutting down...
I20260709 12:24:12.281064  2913 raft_consensus.cc:493] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 47c0d0bc235a443aad3c62643e91b081)
I20260709 12:24:12.282172  2913 raft_consensus.cc:515] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5e7509fe1be74f179626fb4fcb4b4e65" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 46329 } } peers { permanent_uuid: "47c0d0bc235a443aad3c62643e91b081" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 38729 } } peers { permanent_uuid: "7857bffc34ce4e1db3617488701b9810" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 38747 } attrs { promote: false } }
I20260709 12:24:12.293592  2913 leader_election.cc:290] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329), 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729)
W20260709 12:24:12.295837 31476 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:12.298454 31477 leader_election.cc:336] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 47c0d0bc235a443aad3c62643e91b081 (127.28.234.67:38729): Network error: Client connection negotiation failed: client connection to 127.28.234.67:38729: connect: Connection refused (error 111)
I20260709 12:24:12.298928 31477 leader_election.cc:304] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7857bffc34ce4e1db3617488701b9810; no voters: 47c0d0bc235a443aad3c62643e91b081, 5e7509fe1be74f179626fb4fcb4b4e65
I20260709 12:24:12.299784  2912 raft_consensus.cc:2749] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:12.306476 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:12.307392 29609 tablet_replica.cc:333] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.308465 29609 raft_consensus.cc:2243] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.309211 29609 raft_consensus.cc:2272] T 51aa6529d4b94351878a667ab81a26a8 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.312531 29609 tablet_replica.cc:333] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.313341 29609 raft_consensus.cc:2243] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.314510 29609 raft_consensus.cc:2272] T d1bb0331e5b641b99a413ba3e4475499 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.317175 29609 tablet_replica.cc:333] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.317992 29609 raft_consensus.cc:2243] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.319235 29609 raft_consensus.cc:2272] T dd65da5a34854820ae636ab77116f737 P 7857bffc34ce4e1db3617488701b9810 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.322641 29609 tablet_replica.cc:333] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.323536 29609 raft_consensus.cc:2243] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.324429 29609 raft_consensus.cc:2272] T 9a6b5782c4be491f89e3db5e94722436 P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.327433 29609 tablet_replica.cc:333] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.328203 29609 raft_consensus.cc:2243] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.329216 29609 raft_consensus.cc:2272] T 64f8ac94405742eb87e6d195387d7c6f P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.331807 29609 tablet_replica.cc:333] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.332460 29609 raft_consensus.cc:2243] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.333470 29609 raft_consensus.cc:2272] T d1459f4eb71440ae996b2745034179c9 P 7857bffc34ce4e1db3617488701b9810 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.336050 29609 tablet_replica.cc:333] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.336724 29609 raft_consensus.cc:2243] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.337828 29609 raft_consensus.cc:2272] T 2323a4fe46444265864acf0869016ef4 P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.341004 29609 tablet_replica.cc:333] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.341670 29609 raft_consensus.cc:2243] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.342799 29609 raft_consensus.cc:2272] T 3bb0278198af4c1aba82199de860057a P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.345348 29609 tablet_replica.cc:333] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.346226 29609 raft_consensus.cc:2243] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.347285 29609 raft_consensus.cc:2272] T c86ad2fde72a4917a713ec09d50d16ef P 7857bffc34ce4e1db3617488701b9810 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.349959 29609 tablet_replica.cc:333] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.350550 29609 raft_consensus.cc:2243] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.351610 29609 raft_consensus.cc:2272] T 49daeb92ae08415eb56869e7df8fc686 P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.354014 29609 tablet_replica.cc:333] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.354633 29609 raft_consensus.cc:2243] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.355494 29609 raft_consensus.cc:2272] T 3e5ec4b5b8a34d7192f60102179eb425 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.358708 29609 tablet_replica.cc:333] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.359368 29609 raft_consensus.cc:2243] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.360066 29609 raft_consensus.cc:2272] T 91c561a0b4404fcb8adb9d2002e0c15d P 7857bffc34ce4e1db3617488701b9810 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.363044 29609 tablet_replica.cc:333] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.363698 29609 raft_consensus.cc:2243] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.364974 29609 raft_consensus.cc:2272] T 84dde2d8ff054417a11a7ec410d2ffd2 P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.367285 29609 tablet_replica.cc:333] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.367908 29609 raft_consensus.cc:2243] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.368866 29609 raft_consensus.cc:2272] T ec82b6c4e54048a8a16a319c0cb38d23 P 7857bffc34ce4e1db3617488701b9810 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.370985 29609 tablet_replica.cc:333] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.371556 29609 raft_consensus.cc:2243] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.372536 29609 raft_consensus.cc:2272] T 047196043bb744a6b94cb3b634b80771 P 7857bffc34ce4e1db3617488701b9810 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.375141 29609 tablet_replica.cc:333] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.375710 29609 raft_consensus.cc:2243] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.376675 29609 raft_consensus.cc:2272] T ea1fc0f15e994691a2edf5f0c3b096eb P 7857bffc34ce4e1db3617488701b9810 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.379231 29609 tablet_replica.cc:333] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.379861 29609 raft_consensus.cc:2243] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:24:12.380964 29609 raft_consensus.cc:2272] T 9cf061659071464dadafceeb712b1c5d P 7857bffc34ce4e1db3617488701b9810 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.384064 29609 tablet_replica.cc:333] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.385025 29609 raft_consensus.cc:2243] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.385694 29609 raft_consensus.cc:2272] T 43064b77bf3a4ab5aa00dfd9ad2d31de P 7857bffc34ce4e1db3617488701b9810 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.388149 29609 tablet_replica.cc:333] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.388724 29609 raft_consensus.cc:2243] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.389269 29609 raft_consensus.cc:2272] T b23b41846a694f24a76e3aa05d9e54b2 P 7857bffc34ce4e1db3617488701b9810 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.391597 29609 tablet_replica.cc:333] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810: stopping tablet replica
I20260709 12:24:12.392067 29609 raft_consensus.cc:2243] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:12.392531 29609 raft_consensus.cc:2272] T e6c0595eb2284ea9b8da2832d8558f7e P 7857bffc34ce4e1db3617488701b9810 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:12.700021 29609 tablet_server.cc:196] TabletServer@127.28.234.68:0 shutdown complete.
I20260709 12:24:12.747394 29609 master.cc:562] Master@127.28.234.126:42357 shutting down...
W20260709 12:24:12.792626 30730 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:24:12.792982 30730 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:24:12.793157 30730 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:24:17.895745 30667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111) [suppressed 51 similar messages]
W20260709 12:24:17.899290 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3e5ec4b5b8a34d7192f60102179eb425: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:19.734963 30713 debug-util.cc:398] Leaking SignalData structure 0x7b08000917e0 after lost signal to thread 29612
W20260709 12:24:19.735426 30713 debug-util.cc:398] Leaking SignalData structure 0x7b0800367cc0 after lost signal to thread 30716
W20260709 12:24:38.366012 30667 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
W20260709 12:24:38.370209 30667 catalog_manager.cc:4755] TS 5e7509fe1be74f179626fb4fcb4b4e65 (127.28.234.65:46329): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d1bb0331e5b641b99a413ba3e4475499: Network error: Client connection negotiation failed: client connection to 127.28.234.65:46329: connect: Connection refused (error 111)
I20260709 12:24:39.364955 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:39.366248 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:39.366770 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P ed644613a0604f0ca9abeda3653f0a2f: stopping tablet replica
I20260709 12:24:39.522440 29609 master.cc:584] Master@127.28.234.126:42357 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (184711 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:24:39.638447 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:41381
I20260709 12:24:39.639654 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:39.646016  2922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:39.646109  2921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:39.646503  2924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:39.648542 29609 server_base.cc:1061] running on GCE node
I20260709 12:24:39.651016 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:39.651212 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:39.651427 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599879651390 us; error 0 us; skew 500 ppm
I20260709 12:24:39.651974 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:39.654551 29609 webserver.cc:533] Webserver started at http://127.28.234.126:35013/ using document root <none> and password file <none>
I20260709 12:24:39.655058 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:39.655247 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:39.655563 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:39.656903 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "3db579d643fa4bf58f30252950d9fff4"
format_stamp: "Formatted at 2026-07-09 12:24:39 on dist-test-slave-8c39"
I20260709 12:24:39.661521 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:24:39.665395  2929 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:39.666330 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:24:39.666661 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "3db579d643fa4bf58f30252950d9fff4"
format_stamp: "Formatted at 2026-07-09 12:24:39 on dist-test-slave-8c39"
I20260709 12:24:39.667044 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:39.693490 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:39.694952 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:39.737445 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:41381
I20260709 12:24:39.737579  2982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:41381 every 8 connection(s)
I20260709 12:24:39.741920  2983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:39.753521  2983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4: Bootstrap starting.
I20260709 12:24:39.758688  2983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.763284  2983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4: No bootstrap required, opened a new log
I20260709 12:24:39.765683  2983 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db579d643fa4bf58f30252950d9fff4" member_type: VOTER }
I20260709 12:24:39.766180  2983 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.766368  2983 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3db579d643fa4bf58f30252950d9fff4, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.767000  2983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db579d643fa4bf58f30252950d9fff4" member_type: VOTER }
I20260709 12:24:39.767477  2983 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:39.767689  2983 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:39.767907  2983 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.772851  2983 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db579d643fa4bf58f30252950d9fff4" member_type: VOTER }
I20260709 12:24:39.773382  2983 leader_election.cc:304] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3db579d643fa4bf58f30252950d9fff4; no voters: 
I20260709 12:24:39.774662  2983 leader_election.cc:290] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:39.775025  2986 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.776605  2986 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 1 LEADER]: Becoming Leader. State: Replica: 3db579d643fa4bf58f30252950d9fff4, State: Running, Role: LEADER
I20260709 12:24:39.777339  2986 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db579d643fa4bf58f30252950d9fff4" member_type: VOTER }
I20260709 12:24:39.778038  2983 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:39.786167  2988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3db579d643fa4bf58f30252950d9fff4. Latest consensus state: current_term: 1 leader_uuid: "3db579d643fa4bf58f30252950d9fff4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db579d643fa4bf58f30252950d9fff4" member_type: VOTER } }
I20260709 12:24:39.787062  2988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:39.787562  2987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3db579d643fa4bf58f30252950d9fff4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3db579d643fa4bf58f30252950d9fff4" member_type: VOTER } }
I20260709 12:24:39.788282  2987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:39.790058  2995 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:39.796005  2995 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:39.798130 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:39.806535  2995 catalog_manager.cc:1383] Generated new cluster ID: eb1b9cff709f48039edafa01179bfb69
I20260709 12:24:39.806911  2995 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:39.821025  2995 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:39.822530  2995 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:39.837446  2995 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4: Generated new TSK 0
I20260709 12:24:39.838143  2995 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:39.865445 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:39.872879  3004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:39.873999  3005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:39.875195  3007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:39.876569 29609 server_base.cc:1061] running on GCE node
I20260709 12:24:39.878739 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:39.878949 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:39.879127 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599879879109 us; error 0 us; skew 500 ppm
I20260709 12:24:39.879748 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:39.882360 29609 webserver.cc:533] Webserver started at http://127.28.234.65:43805/ using document root <none> and password file <none>
I20260709 12:24:39.882874 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:39.883062 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:39.883361 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:39.884550 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "7691286241bb4eec9fd1a29b7e102d3b"
format_stamp: "Formatted at 2026-07-09 12:24:39 on dist-test-slave-8c39"
I20260709 12:24:39.890183 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:24:39.894420  3012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:39.895352 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:24:39.895737 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "7691286241bb4eec9fd1a29b7e102d3b"
format_stamp: "Formatted at 2026-07-09 12:24:39 on dist-test-slave-8c39"
I20260709 12:24:39.896066 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:39.913111 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:39.914487 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:39.916131 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:39.918727 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:39.918993 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:39.919247 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:39.919436 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:39.965631 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:45381
I20260709 12:24:39.965744  3074 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:45381 every 8 connection(s)
I20260709 12:24:39.971450 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:39.979795  3079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:39.981369  3080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:39.984117  3082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:39.985181 29609 server_base.cc:1061] running on GCE node
I20260709 12:24:39.985428  3075 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41381
I20260709 12:24:39.985884  3075 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:39.987118  3075 heartbeater.cc:507] Master 127.28.234.126:41381 requested a full tablet report, sending...
I20260709 12:24:39.988539 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:39.988808 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:39.989018 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599879988972 us; error 0 us; skew 500 ppm
I20260709 12:24:39.989830 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:39.990056  2948 ts_manager.cc:194] Registered new tserver with Master: 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:39.992416  2948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45562
I20260709 12:24:39.992667 29609 webserver.cc:533] Webserver started at http://127.28.234.66:46595/ using document root <none> and password file <none>
I20260709 12:24:39.993284 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:39.993515 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:39.993862 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:39.995615 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "91322fbc5a384d2991766a8b76dc690e"
format_stamp: "Formatted at 2026-07-09 12:24:39 on dist-test-slave-8c39"
I20260709 12:24:40.000444 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:24:40.004705  3087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.005640 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:24:40.006047 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "91322fbc5a384d2991766a8b76dc690e"
format_stamp: "Formatted at 2026-07-09 12:24:39 on dist-test-slave-8c39"
I20260709 12:24:40.006333 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:40.020342 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:40.021665 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:40.023279 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:40.025736 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:40.026059 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.026304 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:40.026480 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.070354 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:46749
I20260709 12:24:40.070473  3150 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:46749 every 8 connection(s)
I20260709 12:24:40.075501 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:40.084364  3155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:40.086839  3156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:40.088508  3158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:40.090031 29609 server_base.cc:1061] running on GCE node
I20260709 12:24:40.090287  3151 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41381
I20260709 12:24:40.090950  3151 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:40.091274 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:40.091570 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:40.091758 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599880091721 us; error 0 us; skew 500 ppm
I20260709 12:24:40.092049  3151 heartbeater.cc:507] Master 127.28.234.126:41381 requested a full tablet report, sending...
I20260709 12:24:40.092446 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:40.094556  2948 ts_manager.cc:194] Registered new tserver with Master: 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:40.095345 29609 webserver.cc:533] Webserver started at http://127.28.234.67:35397/ using document root <none> and password file <none>
I20260709 12:24:40.095916 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:40.096113 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:40.096407 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:40.096359  2948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45578
I20260709 12:24:40.098376 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "a1c10036e0434e268ddde97a8a846b5a"
format_stamp: "Formatted at 2026-07-09 12:24:40 on dist-test-slave-8c39"
I20260709 12:24:40.103507 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:24:40.107853  3163 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.109133 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:24:40.109517 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "a1c10036e0434e268ddde97a8a846b5a"
format_stamp: "Formatted at 2026-07-09 12:24:40 on dist-test-slave-8c39"
I20260709 12:24:40.109941 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:40.128161 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:40.129618 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:40.131404 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:40.134047 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:40.134316 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.134591 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:40.134804 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.186360 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:46515
I20260709 12:24:40.186499  3225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:46515 every 8 connection(s)
I20260709 12:24:40.192914 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:40.203362  3229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:40.203409  3230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:40.208138  3232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:40.208853  3226 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41381
I20260709 12:24:40.209131 29609 server_base.cc:1061] running on GCE node
I20260709 12:24:40.209403  3226 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:40.210340 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:24:40.210460  3226 heartbeater.cc:507] Master 127.28.234.126:41381 requested a full tablet report, sending...
W20260709 12:24:40.210649 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:40.211164 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599880211134 us; error 0 us; skew 500 ppm
I20260709 12:24:40.211992 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:40.213462  2948 ts_manager.cc:194] Registered new tserver with Master: a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:40.215837 29609 webserver.cc:533] Webserver started at http://127.28.234.68:39621/ using document root <none> and password file <none>
I20260709 12:24:40.216003  2948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45582
I20260709 12:24:40.217182 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:40.217526 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:40.217890 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:40.219197 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-3-root/instance:
uuid: "10d6c936aa794194a9f8ff7e5d48950a"
format_stamp: "Formatted at 2026-07-09 12:24:40 on dist-test-slave-8c39"
I20260709 12:24:40.227195 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:24:40.231328  3238 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.232481 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:24:40.232815 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-3-root
uuid: "10d6c936aa794194a9f8ff7e5d48950a"
format_stamp: "Formatted at 2026-07-09 12:24:40 on dist-test-slave-8c39"
I20260709 12:24:40.233107 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:40.252197 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:40.253566 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:40.255326 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:40.257831 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:40.258095 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.258368 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:40.258517 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:40.304150 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.68:46779
I20260709 12:24:40.304284  3300 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.68:46779 every 8 connection(s)
I20260709 12:24:40.320784  3301 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41381
I20260709 12:24:40.321357  3301 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:40.322422  3301 heartbeater.cc:507] Master 127.28.234.126:41381 requested a full tablet report, sending...
I20260709 12:24:40.324915  2948 ts_manager.cc:194] Registered new tserver with Master: 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:40.325740 29609 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018170327s
I20260709 12:24:40.326602  2948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45598
I20260709 12:24:40.358362  2948 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45602:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:24:40.616623  3266 tablet_service.cc:1511] Processing CreateTablet for tablet cff3ec9c718045a9b97d990c642c5f1f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:40.617054  3265 tablet_service.cc:1511] Processing CreateTablet for tablet 803b9d76331940da95ae7b7083092e04 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:40.618415  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff3ec9c718045a9b97d990c642c5f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.621076  3265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803b9d76331940da95ae7b7083092e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.627306  3264 tablet_service.cc:1511] Processing CreateTablet for tablet 401c3e208635420ea50828b07a684567 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:40.629025  3264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401c3e208635420ea50828b07a684567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.629734  3040 tablet_service.cc:1511] Processing CreateTablet for tablet cff3ec9c718045a9b97d990c642c5f1f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:40.631505  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff3ec9c718045a9b97d990c642c5f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.639712  3039 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca0e56a228f47efae3b79c83b301878 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:40.641469  3039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca0e56a228f47efae3b79c83b301878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.642352  3263 tablet_service.cc:1511] Processing CreateTablet for tablet 9b9543061e96403798babacc8aa31868 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:40.644448  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9543061e96403798babacc8aa31868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.651815  3038 tablet_service.cc:1511] Processing CreateTablet for tablet 803b9d76331940da95ae7b7083092e04 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:40.655580  3037 tablet_service.cc:1511] Processing CreateTablet for tablet bda9cc4c7e654f8d94d79671bcbf148f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:40.657459  3262 tablet_service.cc:1511] Processing CreateTablet for tablet 1785d60abe3b48a2ab7a4329aec2166a (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:40.658349  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 9b9543061e96403798babacc8aa31868 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:40.659585  3262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785d60abe3b48a2ab7a4329aec2166a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.661216  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 1785d60abe3b48a2ab7a4329aec2166a (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:40.664348  3033 tablet_service.cc:1511] Processing CreateTablet for tablet 0a07fb075c4f4f7bb852d8e9a6aeeafc (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:40.658351  3034 tablet_service.cc:1511] Processing CreateTablet for tablet a3c4f3bd9c814c4bae322d5e4e11e37f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:40.653676  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803b9d76331940da95ae7b7083092e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.672490  3261 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5683a9c6a043ba9703ca5df5b58e5e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:40.674603  3261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5683a9c6a043ba9703ca5df5b58e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.674851  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9543061e96403798babacc8aa31868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.678318  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c4f3bd9c814c4bae322d5e4e11e37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.683717  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785d60abe3b48a2ab7a4329aec2166a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.686317  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a07fb075c4f4f7bb852d8e9a6aeeafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.690233  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda9cc4c7e654f8d94d79671bcbf148f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.693655  3260 tablet_service.cc:1511] Processing CreateTablet for tablet 0a07fb075c4f4f7bb852d8e9a6aeeafc (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:40.695880  3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a07fb075c4f4f7bb852d8e9a6aeeafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.700366  3320 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:40.702145  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 74198c23b23a4969b625c2245d554fb1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:40.704242  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74198c23b23a4969b625c2245d554fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.710474  3115 tablet_service.cc:1511] Processing CreateTablet for tablet cff3ec9c718045a9b97d990c642c5f1f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:24:40.711199  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 74198c23b23a4969b625c2245d554fb1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:40.712050  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff3ec9c718045a9b97d990c642c5f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.713382  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74198c23b23a4969b625c2245d554fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.714445  3114 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca0e56a228f47efae3b79c83b301878 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:40.716019  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca0e56a228f47efae3b79c83b301878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.715955  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 401c3e208635420ea50828b07a684567 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:40.717916  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401c3e208635420ea50828b07a684567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.735270  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 9b9543061e96403798babacc8aa31868 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:24:40.736938  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9543061e96403798babacc8aa31868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.738974  3320 tablet_bootstrap.cc:654] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:40.739087  3110 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5683a9c6a043ba9703ca5df5b58e5e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:40.742175  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5683a9c6a043ba9703ca5df5b58e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.743820  3109 tablet_service.cc:1511] Processing CreateTablet for tablet a3c4f3bd9c814c4bae322d5e4e11e37f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:24:40.745326  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c4f3bd9c814c4bae322d5e4e11e37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.735309  3112 tablet_service.cc:1511] Processing CreateTablet for tablet bda9cc4c7e654f8d94d79671bcbf148f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:40.746742  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda9cc4c7e654f8d94d79671bcbf148f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.747068  3108 tablet_service.cc:1511] Processing CreateTablet for tablet 0a07fb075c4f4f7bb852d8e9a6aeeafc (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:24:40.748472  3108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a07fb075c4f4f7bb852d8e9a6aeeafc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.751046  3107 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5e0281e90149f1b903270f360d0994 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:40.752445  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5e0281e90149f1b903270f360d0994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.775820  3191 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca0e56a228f47efae3b79c83b301878 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:24:40.777221  3188 tablet_service.cc:1511] Processing CreateTablet for tablet bda9cc4c7e654f8d94d79671bcbf148f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:24:40.777462  3191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca0e56a228f47efae3b79c83b301878. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.779745  3187 tablet_service.cc:1511] Processing CreateTablet for tablet 1785d60abe3b48a2ab7a4329aec2166a (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:24:40.780964  3190 tablet_service.cc:1511] Processing CreateTablet for tablet 803b9d76331940da95ae7b7083092e04 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:24:40.781024  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5683a9c6a043ba9703ca5df5b58e5e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:24:40.784329  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda9cc4c7e654f8d94d79671bcbf148f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.779337  3189 tablet_service.cc:1511] Processing CreateTablet for tablet 401c3e208635420ea50828b07a684567 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:24:40.791214  3185 tablet_service.cc:1511] Processing CreateTablet for tablet a3c4f3bd9c814c4bae322d5e4e11e37f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
W20260709 12:24:40.792717  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:40.794065  3184 tablet_service.cc:1511] Processing CreateTablet for tablet 74198c23b23a4969b625c2245d554fb1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:24:40.798599  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785d60abe3b48a2ab7a4329aec2166a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.807782  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5e0281e90149f1b903270f360d0994 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:40.831496  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5683a9c6a043ba9703ca5df5b58e5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.833452  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5e0281e90149f1b903270f360d0994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.838807  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74198c23b23a4969b625c2245d554fb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.852013  3321 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:40.854285  3189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401c3e208635420ea50828b07a684567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.856016  3190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803b9d76331940da95ae7b7083092e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.857524  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3c4f3bd9c814c4bae322d5e4e11e37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.925326  3322 tablet_bootstrap.cc:492] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
W20260709 12:24:40.938849  2932 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 76256.3us
I20260709 12:24:40.953920  3038 tablet_service.cc:1511] Processing CreateTablet for tablet 1a66c9d2932647f78f50e3fe9b152ef0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:40.958931  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a66c9d2932647f78f50e3fe9b152ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.965951  3261 tablet_service.cc:1511] Processing CreateTablet for tablet 6d5e0281e90149f1b903270f360d0994 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:24:40.967555  3261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d5e0281e90149f1b903270f360d0994. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.969691  3033 tablet_service.cc:1511] Processing CreateTablet for tablet f380d7dc4159446e89f77c1d9f91aa6e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:40.990674  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f380d7dc4159446e89f77c1d9f91aa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:40.994177  3035 tablet_service.cc:1511] Processing CreateTablet for tablet beaeb83845184eabb73c7ed4590fa307 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:40.995712  3075 heartbeater.cc:499] Master 127.28.234.126:41381 was elected leader, sending a full tablet report...
I20260709 12:24:41.000885  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beaeb83845184eabb73c7ed4590fa307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.001127  3182 tablet_service.cc:1511] Processing CreateTablet for tablet f380d7dc4159446e89f77c1d9f91aa6e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:41.003193  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f380d7dc4159446e89f77c1d9f91aa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.003974  3324 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:41.012269  3260 tablet_service.cc:1511] Processing CreateTablet for tablet 1a66c9d2932647f78f50e3fe9b152ef0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:41.013437  3324 tablet_bootstrap.cc:654] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.014120  3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a66c9d2932647f78f50e3fe9b152ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.023025  3115 tablet_service.cc:1511] Processing CreateTablet for tablet f380d7dc4159446e89f77c1d9f91aa6e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:24:41.024677  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f380d7dc4159446e89f77c1d9f91aa6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.030010  3038 tablet_service.cc:1511] Processing CreateTablet for tablet b549db2d234b4f4f8cee3dd5878d523d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:41.032052  3038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b549db2d234b4f4f8cee3dd5878d523d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.032573  3320 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:41.033175  3320 ts_tablet_manager.cc:1403] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.333s	user 0.011s	sys 0.006s
I20260709 12:24:41.037196  3321 tablet_bootstrap.cc:654] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.040657  3107 tablet_service.cc:1511] Processing CreateTablet for tablet 1a66c9d2932647f78f50e3fe9b152ef0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:24:41.044224  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a66c9d2932647f78f50e3fe9b152ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.046514  3035 tablet_service.cc:1511] Processing CreateTablet for tablet ee2205dfdff74e0da375c18cee844a6d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:41.048075  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2205dfdff74e0da375c18cee844a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.051035  3322 tablet_bootstrap.cc:654] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.050751  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba3c6335b4349149377369fd75c48fb (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:41.052136  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba3c6335b4349149377369fd75c48fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.058295  3324 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:41.057876  3320 raft_consensus.cc:359] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.058833  3320 raft_consensus.cc:385] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.058907  3324 ts_tablet_manager.cc:1403] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.008s
I20260709 12:24:41.059257  3320 raft_consensus.cc:740] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.060230  3320 consensus_queue.cc:260] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.066708  3033 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa2497fe6414fd5a9682b6fcb1eeea5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:41.066991  3324 raft_consensus.cc:359] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.067912  3324 raft_consensus.cc:385] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.067613  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba3c6335b4349149377369fd75c48fb (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:41.067987  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba3c6335b4349149377369fd75c48fb (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:24:41.068446  3033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa2497fe6414fd5a9682b6fcb1eeea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.068397  3324 raft_consensus.cc:740] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.069208  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba3c6335b4349149377369fd75c48fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.069561  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba3c6335b4349149377369fd75c48fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.069659  3324 consensus_queue.cc:260] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.096261  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 4ebfc57c93ee42b7bed740e2958f8419 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:41.096832  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 41189efb74354067997fff21cfbf01f4 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:41.097878  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ebfc57c93ee42b7bed740e2958f8419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.098450  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41189efb74354067997fff21cfbf01f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.099821  3151 heartbeater.cc:499] Master 127.28.234.126:41381 was elected leader, sending a full tablet report...
I20260709 12:24:41.100849  3037 tablet_service.cc:1511] Processing CreateTablet for tablet 68f410bf87dc479b968f4908ea4a1b31 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:41.102507  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f410bf87dc479b968f4908ea4a1b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.127674  3191 tablet_service.cc:1511] Processing CreateTablet for tablet 4ebfc57c93ee42b7bed740e2958f8419 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:41.138521  3191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ebfc57c93ee42b7bed740e2958f8419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.143239  3040 tablet_service.cc:1511] Processing CreateTablet for tablet 05a7a6e705524f76936e9871b4a350dd (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:41.146216  3263 tablet_service.cc:1511] Processing CreateTablet for tablet 4ebfc57c93ee42b7bed740e2958f8419 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:24:41.147902  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ebfc57c93ee42b7bed740e2958f8419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.150456  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a7a6e705524f76936e9871b4a350dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.163398  3320 ts_tablet_manager.cc:1434] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.130s	user 0.017s	sys 0.016s
I20260709 12:24:41.164693  3301 heartbeater.cc:499] Master 127.28.234.126:41381 was elected leader, sending a full tablet report...
I20260709 12:24:41.167703  3329 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.168244  3329 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.170702  3320 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:41.190498  3321 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:41.191213  3321 ts_tablet_manager.cc:1403] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.340s	user 0.012s	sys 0.021s
I20260709 12:24:41.195055  3321 raft_consensus.cc:359] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:41.195966  3321 raft_consensus.cc:385] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.196312  3321 raft_consensus.cc:740] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.199185  3329 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:41.208217  3320 tablet_bootstrap.cc:654] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.208967  3322 tablet_bootstrap.cc:492] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:41.209621  3322 ts_tablet_manager.cc:1403] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.285s	user 0.016s	sys 0.006s
I20260709 12:24:41.197193  3321 consensus_queue.cc:260] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:41.214537  3322 raft_consensus.cc:359] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:41.220830  3324 ts_tablet_manager.cc:1434] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.161s	user 0.022s	sys 0.010s
I20260709 12:24:41.221088  3322 raft_consensus.cc:385] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.221494  3322 raft_consensus.cc:740] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.274802  3226 heartbeater.cc:499] Master 127.28.234.126:41381 was elected leader, sending a full tablet report...
I20260709 12:24:41.280194  3184 tablet_service.cc:1511] Processing CreateTablet for tablet ee2205dfdff74e0da375c18cee844a6d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:41.292336  3107 tablet_service.cc:1511] Processing CreateTablet for tablet beaeb83845184eabb73c7ed4590fa307 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:41.295499  3108 tablet_service.cc:1511] Processing CreateTablet for tablet b549db2d234b4f4f8cee3dd5878d523d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260709 12:24:41.311525  3302 tablet.cc:2406] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:41.222442  3322 consensus_queue.cc:260] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:41.316263  3332 raft_consensus.cc:493] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.317577  3108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b549db2d234b4f4f8cee3dd5878d523d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.317495  3332 raft_consensus.cc:515] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.222230  3324 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
W20260709 12:24:41.322342  2932 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 64679.6us
W20260709 12:24:41.323829  2931 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 53356.3us
I20260709 12:24:41.324602  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 6eacdbf96bb44cfeaa489486fbbc3ddf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:41.329877  3264 tablet_service.cc:1511] Processing CreateTablet for tablet b549db2d234b4f4f8cee3dd5878d523d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:24:41.292336  3262 tablet_service.cc:1511] Processing CreateTablet for tablet ee2205dfdff74e0da375c18cee844a6d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:24:41.268594  3183 tablet_service.cc:1511] Processing CreateTablet for tablet beaeb83845184eabb73c7ed4590fa307 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:24:41.343896  3264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b549db2d234b4f4f8cee3dd5878d523d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.345058  3262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2205dfdff74e0da375c18cee844a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.336320  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beaeb83845184eabb73c7ed4590fa307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.333722  3320 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:41.376499  3040 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5ba9c7ef564ecc9bdd815ade936fb5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:41.390664  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eacdbf96bb44cfeaa489486fbbc3ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.339884  3332 leader_election.cc:290] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:41.399044  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:41.400146  3320 ts_tablet_manager.cc:1403] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.230s	user 0.016s	sys 0.008s
I20260709 12:24:41.401520  3321 ts_tablet_manager.cc:1434] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.210s	user 0.017s	sys 0.014s
W20260709 12:24:41.415061  3241 leader_election.cc:343] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.445679  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5ba9c7ef564ecc9bdd815ade936fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.458165  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beaeb83845184eabb73c7ed4590fa307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.466886  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2205dfdff74e0da375c18cee844a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.474094  3321 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:41.481130  3322 ts_tablet_manager.cc:1434] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.271s	user 0.034s	sys 0.038s
I20260709 12:24:41.482772  3322 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:41.491937  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 1499d010b3c3480d9be748a5943d0c21 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:41.493608  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1499d010b3c3480d9be748a5943d0c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.493144  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 1499d010b3c3480d9be748a5943d0c21 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:41.495237  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1499d010b3c3480d9be748a5943d0c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.495079  3109 tablet_service.cc:1511] Processing CreateTablet for tablet 41189efb74354067997fff21cfbf01f4 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:41.495446  3262 tablet_service.cc:1511] Processing CreateTablet for tablet 41189efb74354067997fff21cfbf01f4 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:24:41.496703  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41189efb74354067997fff21cfbf01f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.496840  3262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41189efb74354067997fff21cfbf01f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.453096  3320 raft_consensus.cc:359] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.498032  3320 raft_consensus.cc:385] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.498396  3320 raft_consensus.cc:740] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.499156  3115 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa2497fe6414fd5a9682b6fcb1eeea5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:41.499220  3320 consensus_queue.cc:260] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.501124  3115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa2497fe6414fd5a9682b6fcb1eeea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.504705  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3cee2b435d4ec5be91bead992f6663 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:41.506470  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3cee2b435d4ec5be91bead992f6663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.506286  3110 tablet_service.cc:1511] Processing CreateTablet for tablet d26951aa0726479b8d555809a049d925 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:41.507772  3110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26951aa0726479b8d555809a049d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.509140  3263 tablet_service.cc:1511] Processing CreateTablet for tablet 68f410bf87dc479b968f4908ea4a1b31 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:41.510694  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f410bf87dc479b968f4908ea4a1b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.513870  3324 tablet_bootstrap.cc:654] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.514847  3261 tablet_service.cc:1511] Processing CreateTablet for tablet d26951aa0726479b8d555809a049d925 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:41.515107  3112 tablet_service.cc:1511] Processing CreateTablet for tablet 05a7a6e705524f76936e9871b4a350dd (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:41.516829  3261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26951aa0726479b8d555809a049d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.517114  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a7a6e705524f76936e9871b4a350dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.524545  3321 tablet_bootstrap.cc:654] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.527473  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:41.531330  3340 raft_consensus.cc:493] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.534039  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9dba5e63804370825d907a8132c51a (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:41.538429  3320 ts_tablet_manager.cc:1434] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.138s	user 0.010s	sys 0.001s
I20260709 12:24:41.540242  3320 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:41.568439  3188 tablet_service.cc:1511] Processing CreateTablet for tablet 1499d010b3c3480d9be748a5943d0c21 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:24:41.570230  3191 tablet_service.cc:1511] Processing CreateTablet for tablet 7fa2497fe6414fd5a9682b6fcb1eeea5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:24:41.571619  3188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1499d010b3c3480d9be748a5943d0c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.570299  3185 tablet_service.cc:1511] Processing CreateTablet for tablet 68f410bf87dc479b968f4908ea4a1b31 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:24:41.572873  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68f410bf87dc479b968f4908ea4a1b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.573125  3186 tablet_service.cc:1511] Processing CreateTablet for tablet d26951aa0726479b8d555809a049d925 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:24:41.574760  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d26951aa0726479b8d555809a049d925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.577298  3191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fa2497fe6414fd5a9682b6fcb1eeea5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.579175  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9dba5e63804370825d907a8132c51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.581730  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 05a7a6e705524f76936e9871b4a350dd (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:24:41.570895  3322 tablet_bootstrap.cc:654] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.586491  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a7a6e705524f76936e9871b4a350dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.549077  3340 raft_consensus.cc:515] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:41.619155  3260 tablet_service.cc:1511] Processing CreateTablet for tablet 6eacdbf96bb44cfeaa489486fbbc3ddf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:41.620814  3260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eacdbf96bb44cfeaa489486fbbc3ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.628026  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 6eacdbf96bb44cfeaa489486fbbc3ddf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:24:41.632846  3266 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5ba9c7ef564ecc9bdd815ade936fb5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:41.633701  3114 tablet_service.cc:1511] Processing CreateTablet for tablet b4bb08278f5a45f7af3e85e7306f7605 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:41.634510  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eacdbf96bb44cfeaa489486fbbc3ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.634600  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5ba9c7ef564ecc9bdd815ade936fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.636518  3265 tablet_service.cc:1511] Processing CreateTablet for tablet b4bb08278f5a45f7af3e85e7306f7605 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:41.638561  3265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bb08278f5a45f7af3e85e7306f7605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.641225  3114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bb08278f5a45f7af3e85e7306f7605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.692076  3340 leader_election.cc:290] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:41.699090  3337 raft_consensus.cc:493] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.699895  3337 raft_consensus.cc:515] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:41.710112  3321 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:41.711031  3337 leader_election.cc:290] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:41.706579  3322 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
W20260709 12:24:41.704427  2932 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 70076.7us
I20260709 12:24:41.733512  3037 tablet_service.cc:1511] Processing CreateTablet for tablet 028dc6ae74914f00a3e8defc67d0bad2 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:41.735316  3037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028dc6ae74914f00a3e8defc67d0bad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.719086  3322 ts_tablet_manager.cc:1403] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.237s	user 0.008s	sys 0.016s
W20260709 12:24:41.738030  3240 leader_election.cc:343] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.738231  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9dba5e63804370825d907a8132c51a (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:41.738648  3240 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:41.739837  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9dba5e63804370825d907a8132c51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.744836  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 028dc6ae74914f00a3e8defc67d0bad2 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:41.746548  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028dc6ae74914f00a3e8defc67d0bad2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.748174  3331 raft_consensus.cc:2749] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:41.749281  3240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 190502us
I20260709 12:24:41.759598  3320 tablet_bootstrap.cc:654] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.741478  3322 raft_consensus.cc:359] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:41.760227  3322 raft_consensus.cc:385] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.760605  3322 raft_consensus.cc:740] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.761693  3322 consensus_queue.cc:260] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:41.764544  3322 ts_tablet_manager.cc:1434] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:24:41.722563  3321 ts_tablet_manager.cc:1403] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.263s	user 0.026s	sys 0.009s
I20260709 12:24:41.788584  3190 tablet_service.cc:1511] Processing CreateTablet for tablet 4a5ba9c7ef564ecc9bdd815ade936fb5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:24:41.794044  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb0db37449f4bdeb5c0987dd9d90865 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:41.795774  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb0db37449f4bdeb5c0987dd9d90865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.802444  3190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a5ba9c7ef564ecc9bdd815ade936fb5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:41.801441  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:41.814502  3259 tablet_service.cc:1511] Processing CreateTablet for tablet f64d9df087d445d583410b9a3cd7ed19 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:41.816133  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64d9df087d445d583410b9a3cd7ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.818459  3324 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:41.819430  3324 ts_tablet_manager.cc:1403] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.597s	user 0.028s	sys 0.007s
I20260709 12:24:41.823668  3040 tablet_service.cc:1511] Processing CreateTablet for tablet 1f10a2a7c7054d938f07a61863951def (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:41.825261  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f10a2a7c7054d938f07a61863951def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.834448  3189 tablet_service.cc:1511] Processing CreateTablet for tablet b4bb08278f5a45f7af3e85e7306f7605 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:24:41.836169  3189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bb08278f5a45f7af3e85e7306f7605. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.844738  3322 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:41.860406  3324 raft_consensus.cc:359] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:41.861321  3324 raft_consensus.cc:385] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.861675  3324 raft_consensus.cc:740] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.880435  3108 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb0db37449f4bdeb5c0987dd9d90865 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:41.880750  3112 tablet_service.cc:1511] Processing CreateTablet for tablet f64d9df087d445d583410b9a3cd7ed19 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:41.881505  3107 tablet_service.cc:1511] Processing CreateTablet for tablet 3b9dba5e63804370825d907a8132c51a (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:24:41.882627  3109 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3cee2b435d4ec5be91bead992f6663 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:41.889420  3106 tablet_service.cc:1511] Processing CreateTablet for tablet 1f10a2a7c7054d938f07a61863951def (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:41.910224  3321 raft_consensus.cc:359] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:41.893628  3264 tablet_service.cc:1511] Processing CreateTablet for tablet b6a87c57d96e4b1b9bf92f2c8f31d096 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:41.918076  3321 raft_consensus.cc:385] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:41.907279  3108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb0db37449f4bdeb5c0987dd9d90865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.891175  3263 tablet_service.cc:1511] Processing CreateTablet for tablet 1f10a2a7c7054d938f07a61863951def (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:24:41.958241  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401c3e208635420ea50828b07a684567" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:41.960541  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:41.962142  3107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9dba5e63804370825d907a8132c51a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.962510  3331 raft_consensus.cc:493] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.963147  3331 raft_consensus.cc:515] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:41.965071  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:41.955338  3321 raft_consensus.cc:740] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:41.898705  3032 tablet_service.cc:1511] Processing CreateTablet for tablet b6a87c57d96e4b1b9bf92f2c8f31d096 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:41.928212  3190 tablet_service.cc:1511] Processing CreateTablet for tablet f64d9df087d445d583410b9a3cd7ed19 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:24:41.974152  3331 leader_election.cc:290] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:41.975286  3190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64d9df087d445d583410b9a3cd7ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.929330  3187 tablet_service.cc:1511] Processing CreateTablet for tablet b6a87c57d96e4b1b9bf92f2c8f31d096 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:24:41.979239  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a87c57d96e4b1b9bf92f2c8f31d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.980870  3183 tablet_service.cc:1511] Processing CreateTablet for tablet c54168825dc646d982d2ba4557205159 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:41.930037  3185 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb0db37449f4bdeb5c0987dd9d90865 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:24:41.948312  3322 tablet_bootstrap.cc:654] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:41.965874  3276 raft_consensus.cc:2468] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:41.961704  3111 tablet_service.cc:1511] Processing CreateTablet for tablet c54168825dc646d982d2ba4557205159 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:41.919107  3264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a87c57d96e4b1b9bf92f2c8f31d096. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.968528  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:41.973460  3106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f10a2a7c7054d938f07a61863951def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:41.974059  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6a87c57d96e4b1b9bf92f2c8f31d096. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:41.989560  3090 leader_election.cc:343] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:41.997627  3201 raft_consensus.cc:2468] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:41.999079  3241 leader_election.cc:304] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:42.000057  3331 raft_consensus.cc:2804] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.000447  3331 raft_consensus.cc:493] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.000769  3331 raft_consensus.cc:3060] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.002261  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:42.007869  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54168825dc646d982d2ba4557205159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.012683  3166 leader_election.cc:304] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
W20260709 12:24:42.014250  3240 leader_election.cc:343] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:42.022241  3165 leader_election.cc:343] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.022584  3186 tablet_service.cc:1511] Processing CreateTablet for tablet 028dc6ae74914f00a3e8defc67d0bad2 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:24:42.025821  3331 raft_consensus.cc:515] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:42.027858  3266 tablet_service.cc:1511] Processing CreateTablet for tablet c54168825dc646d982d2ba4557205159 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:24:42.030230  3266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54168825dc646d982d2ba4557205159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.038442  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3cee2b435d4ec5be91bead992f6663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.031291  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:42.031903  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c54168825dc646d982d2ba4557205159. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.030329  3184 tablet_service.cc:1511] Processing CreateTablet for tablet 2f3cee2b435d4ec5be91bead992f6663 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:24:42.044922  3201 raft_consensus.cc:3060] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.049232  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401c3e208635420ea50828b07a684567" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:42.047992  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f10a2a7c7054d938f07a61863951def. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:42.050806  3090 leader_election.cc:343] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.051275  3090 leader_election.cc:304] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:42.052217  3343 raft_consensus.cc:2749] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.038689  3340 raft_consensus.cc:493] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.054023  3340 raft_consensus.cc:515] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.054774  3034 tablet_service.cc:1511] Processing CreateTablet for tablet ed34225837124e1b8ac0a237db1f0ead (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:42.056164  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed34225837124e1b8ac0a237db1f0ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.056641  3340 leader_election.cc:290] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:42.057713  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:42.060483  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:42.062960  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64d9df087d445d583410b9a3cd7ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.040978  3321 consensus_queue.cc:260] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.079257  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb0db37449f4bdeb5c0987dd9d90865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.074415  3321 ts_tablet_manager.cc:1434] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.300s	user 0.008s	sys 0.003s
I20260709 12:24:42.085892  3320 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:42.086591  3320 ts_tablet_manager.cc:1403] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.547s	user 0.021s	sys 0.018s
I20260709 12:24:42.043730  3324 consensus_queue.cc:260] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.086649  3113 tablet_service.cc:1511] Processing CreateTablet for tablet ed34225837124e1b8ac0a237db1f0ead (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:24:42.091357  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 78923.8us
I20260709 12:24:42.091667  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed34225837124e1b8ac0a237db1f0ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.094014  3200 raft_consensus.cc:2468] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:42.094144  3182 tablet_service.cc:1511] Processing CreateTablet for tablet ed34225837124e1b8ac0a237db1f0ead (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:24:42.098594  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:42.099428  3125 raft_consensus.cc:2468] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:42.099766  3090 leader_election.cc:304] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:42.100801  3340 raft_consensus.cc:2804] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.100940  3015 leader_election.cc:304] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:42.101985  3331 leader_election.cc:290] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:42.102465  3337 raft_consensus.cc:2804] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.102876  3337 raft_consensus.cc:493] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.103251  3337 raft_consensus.cc:3060] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.104785  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:42.105060  3184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f3cee2b435d4ec5be91bead992f6663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.106130  3186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 028dc6ae74914f00a3e8defc67d0bad2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:42.106416  3240 leader_election.cc:343] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.101243  3340 raft_consensus.cc:493] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.107232  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed34225837124e1b8ac0a237db1f0ead. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.107540  3340 raft_consensus.cc:3060] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.110525  3201 raft_consensus.cc:2468] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:42.114178  3241 leader_election.cc:304] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:42.116279  3331 raft_consensus.cc:2804] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.123217  3322 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:42.123807  3322 ts_tablet_manager.cc:1403] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.279s	user 0.012s	sys 0.004s
I20260709 12:24:42.127173  3322 raft_consensus.cc:359] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.127974  3322 raft_consensus.cc:385] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.128288  3322 raft_consensus.cc:740] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.128746  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 97440158a2d84b48946fe629834bfbd5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:42.130370  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97440158a2d84b48946fe629834bfbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.136617  3340 raft_consensus.cc:515] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.143342  3337 raft_consensus.cc:515] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.129081  3322 consensus_queue.cc:260] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.150377  3322 ts_tablet_manager.cc:1434] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 12:24:42.150978  3355 raft_consensus.cc:2764] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:24:42.153412  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:42.154495  3050 raft_consensus.cc:2393] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:42.158795  3322 tablet_bootstrap.cc:492] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:42.168080  3324 ts_tablet_manager.cc:1434] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.348s	user 0.012s	sys 0.002s
I20260709 12:24:42.172996  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:42.173693  3201 raft_consensus.cc:3060] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.174213  3337 leader_election.cc:290] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:42.179276  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:42.180478  3125 raft_consensus.cc:2393] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:42.172432  3320 raft_consensus.cc:359] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.182366  3320 raft_consensus.cc:385] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.182767  3320 raft_consensus.cc:740] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.184733  3324 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:42.190533  3320 consensus_queue.cc:260] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.181394  3201 raft_consensus.cc:2468] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:42.194156  3322 tablet_bootstrap.cc:654] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.171128  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 97440158a2d84b48946fe629834bfbd5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:42.203018  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 97440158a2d84b48946fe629834bfbd5 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:24:42.203801  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97440158a2d84b48946fe629834bfbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.204509  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97440158a2d84b48946fe629834bfbd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.209183  3015 leader_election.cc:304] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:42.209890  3321 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:42.210814  3337 raft_consensus.cc:2804] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.225481  3187 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3255b68cdc495c9a753494c3f2f2cf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:42.227743  3040 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3255b68cdc495c9a753494c3f2f2cf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:42.229405  3040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3255b68cdc495c9a753494c3f2f2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.230904  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 6d3255b68cdc495c9a753494c3f2f2cf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:24:42.233049  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3255b68cdc495c9a753494c3f2f2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.237953  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 02a818fbb8d34fd098340d5f6167e8d1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:42.238322  3183 tablet_service.cc:1511] Processing CreateTablet for tablet 02a818fbb8d34fd098340d5f6167e8d1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:42.239431  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a818fbb8d34fd098340d5f6167e8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.227679  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d3255b68cdc495c9a753494c3f2f2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.251888  3321 tablet_bootstrap.cc:654] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.201674  3331 raft_consensus.cc:697] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:42.287322  3331 consensus_queue.cc:237] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:42.315971  3183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a818fbb8d34fd098340d5f6167e8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.325348  3036 tablet_service.cc:1511] Processing CreateTablet for tablet ead227dd136a401db0ffb15035d0952f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:42.332702  3360 raft_consensus.cc:493] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.333333  3360 raft_consensus.cc:515] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.334908  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:42.335974  3201 raft_consensus.cc:2393] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:42.332892  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead227dd136a401db0ffb15035d0952f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.316110  3337 raft_consensus.cc:697] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:42.329080  3324 tablet_bootstrap.cc:654] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:42.317301  2932 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 49989.7us
I20260709 12:24:42.363197  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
W20260709 12:24:42.365271  3015 leader_election.cc:343] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.370421  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:42.373095  3015 leader_election.cc:343] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.373800  3015 leader_election.cc:304] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:42.378738  3340 leader_election.cc:290] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:42.378448  3185 tablet_service.cc:1511] Processing CreateTablet for tablet ead227dd136a401db0ffb15035d0952f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:42.379840  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:42.380612  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead227dd136a401db0ffb15035d0952f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.380548  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 02a818fbb8d34fd098340d5f6167e8d1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:24:42.382112  3321 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:42.381944  3089 leader_election.cc:304] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:42.382678  3321 ts_tablet_manager.cc:1403] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.173s	user 0.010s	sys 0.009s
I20260709 12:24:42.383282  3340 raft_consensus.cc:2749] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.394111  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a818fbb8d34fd098340d5f6167e8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.393633  3112 tablet_service.cc:1511] Processing CreateTablet for tablet ead227dd136a401db0ffb15035d0952f (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:24:42.395748  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead227dd136a401db0ffb15035d0952f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.369273  3360 leader_election.cc:290] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:42.398118  3361 raft_consensus.cc:2749] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.380615  3320 ts_tablet_manager.cc:1434] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.294s	user 0.040s	sys 0.050s
I20260709 12:24:42.419009  3320 tablet_bootstrap.cc:492] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:42.422952  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 06665f03bd4d4cbba62e3aa2a3ef3ec0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:42.408617  3337 consensus_queue.cc:237] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.423548  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 06665f03bd4d4cbba62e3aa2a3ef3ec0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:42.428000  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06665f03bd4d4cbba62e3aa2a3ef3ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.432454  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06665f03bd4d4cbba62e3aa2a3ef3ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.436072  3322 tablet_bootstrap.cc:492] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:42.436676  3322 ts_tablet_manager.cc:1403] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.285s	user 0.012s	sys 0.007s
I20260709 12:24:42.441118  3322 raft_consensus.cc:359] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:42.442049  3322 raft_consensus.cc:385] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.441493  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 06665f03bd4d4cbba62e3aa2a3ef3ec0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:24:42.442430  3322 raft_consensus.cc:740] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.443516  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06665f03bd4d4cbba62e3aa2a3ef3ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.443593  3322 consensus_queue.cc:260] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:42.445483  2945 catalog_manager.cc:5697] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.451141  3320 tablet_bootstrap.cc:654] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.454276  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 3c523bd710e24e8bb7476e4e69d4213d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:42.455788  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c523bd710e24e8bb7476e4e69d4213d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.459836  3322 ts_tablet_manager.cc:1434] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:24:42.455756  3187 tablet_service.cc:1511] Processing CreateTablet for tablet fc4defa68b934bc2ad3ea4eb0d16d97c (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:42.463239  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4defa68b934bc2ad3ea4eb0d16d97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.470898  3190 tablet_service.cc:1511] Processing CreateTablet for tablet 43068fdfca3b412f8dce5d7ac88d3be0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:42.472321  3190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43068fdfca3b412f8dce5d7ac88d3be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.472084  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 3c523bd710e24e8bb7476e4e69d4213d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:42.472684  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 3c523bd710e24e8bb7476e4e69d4213d (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:24:42.473662  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c523bd710e24e8bb7476e4e69d4213d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.474063  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c523bd710e24e8bb7476e4e69d4213d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.474527  3324 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:42.474694  3109 tablet_service.cc:1511] Processing CreateTablet for tablet 43068fdfca3b412f8dce5d7ac88d3be0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:42.475142  3324 ts_tablet_manager.cc:1403] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.291s	user 0.014s	sys 0.013s
I20260709 12:24:42.476118  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43068fdfca3b412f8dce5d7ac88d3be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.476580  3263 tablet_service.cc:1511] Processing CreateTablet for tablet 43068fdfca3b412f8dce5d7ac88d3be0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:24:42.474704  3340 raft_consensus.cc:493] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.478096  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43068fdfca3b412f8dce5d7ac88d3be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.478367  3340 raft_consensus.cc:515] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:42.473927  3331 raft_consensus.cc:493] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.480651  3331 raft_consensus.cc:515] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.487471  3343 raft_consensus.cc:493] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.487354  3259 tablet_service.cc:1511] Processing CreateTablet for tablet fc4defa68b934bc2ad3ea4eb0d16d97c (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:42.488987  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4defa68b934bc2ad3ea4eb0d16d97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.485486  3321 raft_consensus.cc:359] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.490761  3321 raft_consensus.cc:385] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.491187  3321 raft_consensus.cc:740] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.494470  3340 leader_election.cc:290] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:42.495318  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:42.497077  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:42.497822  3321 consensus_queue.cc:260] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.500696  3321 ts_tablet_manager.cc:1434] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.118s	user 0.008s	sys 0.000s
I20260709 12:24:42.484835  3331 leader_election.cc:290] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:42.502038  3035 tablet_service.cc:1511] Processing CreateTablet for tablet fc4defa68b934bc2ad3ea4eb0d16d97c (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:24:42.503162  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:42.488080  3343 raft_consensus.cc:515] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.512040  3343 leader_election.cc:290] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:42.512609  3324 raft_consensus.cc:359] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.513935  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4defa68b934bc2ad3ea4eb0d16d97c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.514006  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda9cc4c7e654f8d94d79671bcbf148f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:42.515682  3089 leader_election.cc:343] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.504331  3050 raft_consensus.cc:2468] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
W20260709 12:24:42.509657  3090 leader_election.cc:343] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.513516  3324 raft_consensus.cc:385] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:42.520630  3090 leader_election.cc:343] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.521090  3090 leader_election.cc:304] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:42.522985  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda9cc4c7e654f8d94d79671bcbf148f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:42.518323  3240 leader_election.cc:304] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:42.524484  3331 raft_consensus.cc:2804] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.524861  3331 raft_consensus.cc:493] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.527438  3331 raft_consensus.cc:3060] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.532864  3322 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:42.529655  3343 raft_consensus.cc:2749] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.525323  3324 raft_consensus.cc:740] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.562451  3324 consensus_queue.cc:260] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.563532  3201 raft_consensus.cc:2468] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:42.566666  3324 ts_tablet_manager.cc:1434] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.002s
I20260709 12:24:42.567600  3090 leader_election.cc:304] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:42.569075  3343 raft_consensus.cc:2804] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:42.569476  3343 raft_consensus.cc:493] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.569900  3343 raft_consensus.cc:3060] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.572605  3322 tablet_bootstrap.cc:654] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.592649  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 960c1cb2ab5940509b7b2f09e2ec3df0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:42.593293  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 960c1cb2ab5940509b7b2f09e2ec3df0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:42.594103  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960c1cb2ab5940509b7b2f09e2ec3df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.594731  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960c1cb2ab5940509b7b2f09e2ec3df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.606096  3324 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:42.610411  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 960c1cb2ab5940509b7b2f09e2ec3df0 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:24:42.612236  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 960c1cb2ab5940509b7b2f09e2ec3df0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.612288  2947 catalog_manager.cc:5697] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.581321  3331 raft_consensus.cc:515] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.627969  3331 leader_election.cc:290] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:42.628561  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:42.615531  3343 raft_consensus.cc:515] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.596031  3321 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:42.629305  3050 raft_consensus.cc:3060] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.641321  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda9cc4c7e654f8d94d79671bcbf148f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
W20260709 12:24:42.643983  3089 leader_election.cc:343] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.657123  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda9cc4c7e654f8d94d79671bcbf148f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:42.657903  3201 raft_consensus.cc:3060] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:42.658390  3050 raft_consensus.cc:2468] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:42.662578  3240 leader_election.cc:304] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:42.663673  3331 raft_consensus.cc:2804] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.664242  3331 raft_consensus.cc:697] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:42.665151  3331 consensus_queue.cc:237] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.668295  3320 tablet_bootstrap.cc:492] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:42.669023  3320 ts_tablet_manager.cc:1403] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.250s	user 0.017s	sys 0.009s
I20260709 12:24:42.651856  3343 leader_election.cc:290] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:42.678570  3320 raft_consensus.cc:359] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:42.670822  3201 raft_consensus.cc:2468] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:42.687615  3090 leader_election.cc:304] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:42.689427  3343 raft_consensus.cc:2804] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:42.690460  3343 raft_consensus.cc:697] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:42.690598  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:42.691660  3343 consensus_queue.cc:237] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.692306  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:42.692981  3187 tablet_service.cc:1511] Processing CreateTablet for tablet b03446eaea8f426dae5a2b32c67bb9cf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:24:42.693661  3241 leader_election.cc:343] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.694612  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03446eaea8f426dae5a2b32c67bb9cf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:42.695379  3241 leader_election.cc:343] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.681080  3320 raft_consensus.cc:385] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.696547  3320 raft_consensus.cc:740] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.698216  3320 consensus_queue.cc:260] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:42.699455  3263 tablet_service.cc:1511] Processing CreateTablet for tablet b03446eaea8f426dae5a2b32c67bb9cf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:42.701082  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03446eaea8f426dae5a2b32c67bb9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.703226  3032 tablet_service.cc:1511] Processing CreateTablet for tablet b03446eaea8f426dae5a2b32c67bb9cf (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:24:42.704794  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03446eaea8f426dae5a2b32c67bb9cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.705662  3324 tablet_bootstrap.cc:654] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.719602  3322 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:42.715406  3321 tablet_bootstrap.cc:654] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.720230  3322 ts_tablet_manager.cc:1403] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.190s	user 0.025s	sys 0.031s
I20260709 12:24:42.723835  3322 raft_consensus.cc:359] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.724611  3322 raft_consensus.cc:385] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.724960  3322 raft_consensus.cc:740] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.715052  3320 ts_tablet_manager.cc:1434] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.006s
I20260709 12:24:42.732194  3320 tablet_bootstrap.cc:492] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:42.744486  2948 catalog_manager.cc:5697] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.759292  3320 tablet_bootstrap.cc:654] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.729688  3322 consensus_queue.cc:260] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.770396  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 290114d0aee44b25b8178f30491c27e2 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:42.770887  3185 tablet_service.cc:1511] Processing CreateTablet for tablet 290114d0aee44b25b8178f30491c27e2 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:42.771904  3324 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:42.772233  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290114d0aee44b25b8178f30491c27e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.772465  3324 ts_tablet_manager.cc:1403] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.004s
I20260709 12:24:42.775683  3322 ts_tablet_manager.cc:1434] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 12:24:42.777097  3324 raft_consensus.cc:359] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.771947  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290114d0aee44b25b8178f30491c27e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.787727  3258 tablet_service.cc:1511] Processing CreateTablet for tablet 290114d0aee44b25b8178f30491c27e2 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:24:42.777930  3324 raft_consensus.cc:385] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.789866  3258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290114d0aee44b25b8178f30491c27e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.789686  3324 raft_consensus.cc:740] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.791277  3324 consensus_queue.cc:260] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.777136  3322 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:42.796258  3321 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:42.799170  3321 ts_tablet_manager.cc:1403] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.217s	user 0.012s	sys 0.025s
I20260709 12:24:42.798799  3034 tablet_service.cc:1511] Processing CreateTablet for tablet b773e38b369a4da2ba1e065e6565c5c1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:42.800750  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b773e38b369a4da2ba1e065e6565c5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.802981  3182 tablet_service.cc:1511] Processing CreateTablet for tablet b773e38b369a4da2ba1e065e6565c5c1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:42.803002  3321 raft_consensus.cc:359] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:42.804603  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b773e38b369a4da2ba1e065e6565c5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.804701  3321 raft_consensus.cc:385] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.804527  3111 tablet_service.cc:1511] Processing CreateTablet for tablet b773e38b369a4da2ba1e065e6565c5c1 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:24:42.805305  3321 raft_consensus.cc:740] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.806033  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b773e38b369a4da2ba1e065e6565c5c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.806190  3321 consensus_queue.cc:260] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:42.808941  3321 ts_tablet_manager.cc:1434] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:42.810168  3321 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:42.817731  3263 tablet_service.cc:1511] Processing CreateTablet for tablet d127a8af49cf4394a1db83d4dcb4cf20 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:24:42.819386  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d127a8af49cf4394a1db83d4dcb4cf20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.822791  3322 tablet_bootstrap.cc:654] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.842128  3343 raft_consensus.cc:493] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.842760  3343 raft_consensus.cc:515] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:42.846550  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:42.847308  3343 leader_election.cc:290] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:42.847534  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:42.848328  3032 tablet_service.cc:1511] Processing CreateTablet for tablet d127a8af49cf4394a1db83d4dcb4cf20 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:24:42.849287  3090 leader_election.cc:343] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.849983  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d127a8af49cf4394a1db83d4dcb4cf20. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:42.850474  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:42.852728  3324 ts_tablet_manager.cc:1434] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 12:24:42.853189  3112 tablet_service.cc:1511] Processing CreateTablet for tablet d127a8af49cf4394a1db83d4dcb4cf20 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:24:42.854565  3089 leader_election.cc:343] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:42.866506  3089 leader_election.cc:304] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:42.859017  3321 tablet_bootstrap.cc:654] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.861363  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d127a8af49cf4394a1db83d4dcb4cf20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.861503  3324 tablet_bootstrap.cc:492] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:42.862731  3187 tablet_service.cc:1511] Processing CreateTablet for tablet 37fe20097de44ae683647a127a68de29 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:42.869001  3331 consensus_queue.cc:1048] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:42.873407  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 37fe20097de44ae683647a127a68de29 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:42.873771  3343 raft_consensus.cc:2749] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:42.876595  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fe20097de44ae683647a127a68de29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.884994  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fe20097de44ae683647a127a68de29. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:42.890568  3240 consensus_peers.cc:597] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:42.894299  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 37fe20097de44ae683647a127a68de29 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:24:42.896011  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fe20097de44ae683647a127a68de29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.896517  3109 tablet_service.cc:1511] Processing CreateTablet for tablet bbedacd971d04ba59a5f8bbcbf37126e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:42.898116  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbedacd971d04ba59a5f8bbcbf37126e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.908246  3320 tablet_bootstrap.cc:492] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:42.909091  3320 ts_tablet_manager.cc:1403] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.177s	user 0.008s	sys 0.018s
I20260709 12:24:42.916747  3185 tablet_service.cc:1511] Processing CreateTablet for tablet bbedacd971d04ba59a5f8bbcbf37126e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:42.919610  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbedacd971d04ba59a5f8bbcbf37126e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.925014  3324 tablet_bootstrap.cc:654] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:42.933805  3320 raft_consensus.cc:359] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:42.934830  3257 tablet_service.cc:1511] Processing CreateTablet for tablet bbedacd971d04ba59a5f8bbcbf37126e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:24:42.943679  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 52738b922b3c4c1cbbe2390f6b879c49 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:42.938102  3320 raft_consensus.cc:385] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:42.951946  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbedacd971d04ba59a5f8bbcbf37126e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.957973  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52738b922b3c4c1cbbe2390f6b879c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:42.965601  2946 catalog_manager.cc:5697] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.950125  3320 raft_consensus.cc:740] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:42.970094  3320 consensus_queue.cc:260] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:42.972962  3320 ts_tablet_manager.cc:1434] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:24:42.976637  3322 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:42.977312  3322 ts_tablet_manager.cc:1403] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.200s	user 0.016s	sys 0.007s
I20260709 12:24:42.996027  3320 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:42.998147  3359 raft_consensus.cc:493] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.998776  3359 raft_consensus.cc:515] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.001183  3359 leader_election.cc:290] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:43.002400  3337 consensus_queue.cc:1048] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:24:43.012883  3112 tablet_service.cc:1511] Processing CreateTablet for tablet 52738b922b3c4c1cbbe2390f6b879c49 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:43.014461  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52738b922b3c4c1cbbe2390f6b879c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.015282  3182 tablet_service.cc:1511] Processing CreateTablet for tablet 52738b922b3c4c1cbbe2390f6b879c49 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:24:43.016698  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52738b922b3c4c1cbbe2390f6b879c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.018227  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.018966  3124 raft_consensus.cc:2468] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.019697  3259 tablet_service.cc:1511] Processing CreateTablet for tablet 764ad628906949f2ae30282799496feb (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:43.020581  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:43.020768  3241 leader_election.cc:304] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:43.021971  3359 raft_consensus.cc:2804] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:43.022305  3241 leader_election.cc:343] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.022408  3359 raft_consensus.cc:493] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.022917  3359 raft_consensus.cc:3060] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.024884  3321 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:43.025455  3321 ts_tablet_manager.cc:1403] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.216s	user 0.017s	sys 0.026s
I20260709 12:24:43.027580  3324 tablet_bootstrap.cc:492] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:43.028188  3324 ts_tablet_manager.cc:1403] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.004s
I20260709 12:24:43.028872  3321 raft_consensus.cc:359] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:42.996106  3322 raft_consensus.cc:359] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.031602  3322 raft_consensus.cc:385] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.031921  3322 raft_consensus.cc:740] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.032699  3322 consensus_queue.cc:260] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.036814  3337 consensus_queue.cc:1048] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:43.038698  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764ad628906949f2ae30282799496feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.039858  3032 tablet_service.cc:1511] Processing CreateTablet for tablet 764ad628906949f2ae30282799496feb (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:43.041234  3032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764ad628906949f2ae30282799496feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.043076  3322 ts_tablet_manager.cc:1434] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.001s
I20260709 12:24:43.044238  3322 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:43.044518  3324 raft_consensus.cc:359] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.045403  3324 raft_consensus.cc:385] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.029615  3321 raft_consensus.cc:385] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.051365  3321 raft_consensus.cc:740] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.052202  3321 consensus_queue.cc:260] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.050288  3324 raft_consensus.cc:740] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.053854  3324 consensus_queue.cc:260] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.056186  3320 tablet_bootstrap.cc:654] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.056187  3324 ts_tablet_manager.cc:1434] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:24:43.057440  3263 tablet_service.cc:1511] Processing CreateTablet for tablet 1437a4a42b8748fc85fd7a3af43a519b (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:43.066473  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1437a4a42b8748fc85fd7a3af43a519b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.066955  3034 tablet_service.cc:1511] Processing CreateTablet for tablet 1437a4a42b8748fc85fd7a3af43a519b (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:43.067631  3324 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:43.068562  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1437a4a42b8748fc85fd7a3af43a519b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.057317  3185 tablet_service.cc:1511] Processing CreateTablet for tablet 1437a4a42b8748fc85fd7a3af43a519b (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:24:43.076035  3322 tablet_bootstrap.cc:654] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.076184  3185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1437a4a42b8748fc85fd7a3af43a519b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.079384  3321 ts_tablet_manager.cc:1434] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:24:43.083036  3109 tablet_service.cc:1511] Processing CreateTablet for tablet 764ad628906949f2ae30282799496feb (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:24:43.086251  3321 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:43.087213  3343 raft_consensus.cc:493] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.093513  3343 raft_consensus.cc:515] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.094312  3111 tablet_service.cc:1511] Processing CreateTablet for tablet 352d5275a7ca43abb1b933b90dcb2960 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:43.095927  3343 leader_election.cc:290] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:43.097697  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a07fb075c4f4f7bb852d8e9a6aeeafc" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:43.097735  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a07fb075c4f4f7bb852d8e9a6aeeafc" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:43.099805  3050 raft_consensus.cc:2468] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
W20260709 12:24:43.101215  3090 leader_election.cc:343] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.092132  3187 tablet_service.cc:1511] Processing CreateTablet for tablet 352d5275a7ca43abb1b933b90dcb2960 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:43.101886  3359 raft_consensus.cc:515] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.103026  3089 leader_election.cc:304] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a
I20260709 12:24:43.103029  3187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352d5275a7ca43abb1b933b90dcb2960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.104516  3343 raft_consensus.cc:2804] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.104975  3343 raft_consensus.cc:493] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.105410  3343 raft_consensus.cc:3060] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.109372  3321 tablet_bootstrap.cc:654] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.084594  3109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 764ad628906949f2ae30282799496feb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.123548  3387 raft_consensus.cc:493] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.124168  3387 raft_consensus.cc:515] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.130447  3387 leader_election.cc:290] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:43.159785  3113 tablet_service.cc:1511] Processing CreateTablet for tablet 31b29d7654294465b09126471663431e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:43.162516  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:43.163233  3125 raft_consensus.cc:3060] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.163046  3035 tablet_service.cc:1511] Processing CreateTablet for tablet 31b29d7654294465b09126471663431e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:43.164577  3035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b29d7654294465b09126471663431e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.166654  3257 tablet_service.cc:1511] Processing CreateTablet for tablet 352d5275a7ca43abb1b933b90dcb2960 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:24:43.168119  3257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352d5275a7ca43abb1b933b90dcb2960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.171978  3359 leader_election.cc:290] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:43.174046  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:43.176071  3324 tablet_bootstrap.cc:654] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:43.176559  3089 consensus_peers.cc:597] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:43.151023  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401c3e208635420ea50828b07a684567" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.151396  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401c3e208635420ea50828b07a684567" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:43.178251  3241 leader_election.cc:343] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.178488  3201 raft_consensus.cc:2468] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.156263  3111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352d5275a7ca43abb1b933b90dcb2960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.177567  3124 raft_consensus.cc:2468] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.183343  3241 leader_election.cc:304] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:43.161386  3190 tablet_service.cc:1511] Processing CreateTablet for tablet 31b29d7654294465b09126471663431e (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:24:43.190131  3190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b29d7654294465b09126471663431e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.195799  3320 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:43.196425  3320 ts_tablet_manager.cc:1403] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.201s	user 0.020s	sys 0.023s
I20260709 12:24:43.203558  3113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b29d7654294465b09126471663431e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.212244  3359 consensus_queue.cc:1048] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:43.213445  3390 raft_consensus.cc:2804] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.214004  3390 raft_consensus.cc:493] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.214360  3390 raft_consensus.cc:3060] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.220840  3343 raft_consensus.cc:515] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.229902  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a07fb075c4f4f7bb852d8e9a6aeeafc" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:43.230412  3343 leader_election.cc:290] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:43.230688  3049 raft_consensus.cc:3060] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.231737  3036 tablet_service.cc:1511] Processing CreateTablet for tablet 618abe6b52674e39aa10b2e2f7a95977 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:43.233343  3036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618abe6b52674e39aa10b2e2f7a95977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.230544  3112 tablet_service.cc:1511] Processing CreateTablet for tablet 618abe6b52674e39aa10b2e2f7a95977 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:43.234937  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a07fb075c4f4f7bb852d8e9a6aeeafc" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
W20260709 12:24:43.236837  3090 leader_election.cc:343] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.241055  3182 tablet_service.cc:1511] Processing CreateTablet for tablet c38cbb84ab714516acb50aa88c24fab8 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:43.242872  3182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38cbb84ab714516acb50aa88c24fab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.236783  3112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618abe6b52674e39aa10b2e2f7a95977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.255290  3263 tablet_service.cc:1511] Processing CreateTablet for tablet 618abe6b52674e39aa10b2e2f7a95977 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:24:43.257647  3263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 618abe6b52674e39aa10b2e2f7a95977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.264698  3322 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:43.265463  3322 ts_tablet_manager.cc:1403] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.221s	user 0.023s	sys 0.001s
I20260709 12:24:43.267246  3049 raft_consensus.cc:2468] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:43.268083  3259 tablet_service.cc:1511] Processing CreateTablet for tablet c38cbb84ab714516acb50aa88c24fab8 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:43.268967  3089 leader_election.cc:304] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a
I20260709 12:24:43.270073  3343 raft_consensus.cc:2804] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.270820  3343 raft_consensus.cc:697] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:43.271660  3343 consensus_queue.cc:237] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.272413  3322 raft_consensus.cc:359] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.273222  3322 raft_consensus.cc:385] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.273523  3259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38cbb84ab714516acb50aa88c24fab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.274272  3322 raft_consensus.cc:740] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.282652  3322 consensus_queue.cc:260] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.290822  3356 raft_consensus.cc:493] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.291752  3356 raft_consensus.cc:515] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
W20260709 12:24:43.291028  3241 consensus_peers.cc:597] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:43.248172  3125 raft_consensus.cc:2468] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:43.245697  3390 raft_consensus.cc:515] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.307698  3356 leader_election.cc:290] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:43.308682  3321 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:43.309113  3034 tablet_service.cc:1511] Processing CreateTablet for tablet c38cbb84ab714516acb50aa88c24fab8 (DEFAULT_TABLE table=test-workload [id=2f7ac39ec97744fc94859465db9ccfa9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:24:43.310515  3034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38cbb84ab714516acb50aa88c24fab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:43.309401  3321 ts_tablet_manager.cc:1403] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.229s	user 0.018s	sys 0.006s
W20260709 12:24:43.311859  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 77083.3us
I20260709 12:24:43.333885  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:43.342700  3165 leader_election.cc:343] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.365237  3324 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:43.366158  3324 ts_tablet_manager.cc:1403] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.299s	user 0.015s	sys 0.016s
I20260709 12:24:43.366838  3390 leader_election.cc:290] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:43.336848  3241 leader_election.cc:304] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:43.330943  3340 consensus_queue.cc:1048] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:24:43.368402  3391 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.368992  3391 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.371232  3391 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:43.384433  3322 ts_tablet_manager.cc:1434] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.012s
W20260709 12:24:43.388324  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 55154us
I20260709 12:24:43.392091  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401c3e208635420ea50828b07a684567" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:43.392958  3124 raft_consensus.cc:3060] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.398370  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401c3e208635420ea50828b07a684567" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:43.399405  3201 raft_consensus.cc:3060] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.406941  3320 raft_consensus.cc:359] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.408456  3320 raft_consensus.cc:385] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.408985  3320 raft_consensus.cc:740] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.413064  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:43.416110  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:43.417037  3276 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:43.418520  3320 consensus_queue.cc:260] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.382855  3390 raft_consensus.cc:2804] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.423626  3390 raft_consensus.cc:697] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:43.424531  3390 consensus_queue.cc:237] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.427922  3320 ts_tablet_manager.cc:1434] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.231s	user 0.008s	sys 0.003s
I20260709 12:24:43.422807  3015 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:43.435367  3324 raft_consensus.cc:359] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.447764  3391 raft_consensus.cc:2804] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.451895  3391 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.452266  3391 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.456806  3124 raft_consensus.cc:2468] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:43.458710  3322 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:43.458628  3241 leader_election.cc:304] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:43.459806  3359 raft_consensus.cc:2804] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.459714  2948 catalog_manager.cc:5697] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.460446  3359 raft_consensus.cc:697] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:43.460659  3391 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:43.450397  3015 leader_election.cc:343] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.461970  3359 consensus_queue.cc:237] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.466359  3320 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:43.469264  3321 raft_consensus.cc:359] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.471246  3321 raft_consensus.cc:385] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.471611  3321 raft_consensus.cc:740] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.472458  3321 consensus_queue.cc:260] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.446334  3324 raft_consensus.cc:385] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.479038  3201 raft_consensus.cc:2468] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:43.506896  3322 tablet_bootstrap.cc:654] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.511412  3321 ts_tablet_manager.cc:1434] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.181s	user 0.006s	sys 0.002s
I20260709 12:24:43.476882  3324 raft_consensus.cc:740] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.513511  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:43.518641  3391 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:43.520011  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:43.522044  3276 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.526021  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:43.527801  3166 leader_election.cc:343] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:43.528286  3166 leader_election.cc:304] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:43.529107  3356 raft_consensus.cc:2749] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.533722  2948 catalog_manager.cc:5697] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.537039  3321 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:43.536399  2948 catalog_manager.cc:5697] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.541630  3276 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:43.543169  3015 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:43.544014  3391 raft_consensus.cc:2804] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.544473  3391 raft_consensus.cc:697] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:43.544612  3320 tablet_bootstrap.cc:654] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.545368  3391 consensus_queue.cc:237] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.524382  3324 consensus_queue.cc:260] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.548892  3201 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.553371  3322 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:43.554031  3322 ts_tablet_manager.cc:1403] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.000s
I20260709 12:24:43.557487  3322 raft_consensus.cc:359] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.558326  3322 raft_consensus.cc:385] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.558629  3322 raft_consensus.cc:740] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.559268  3324 ts_tablet_manager.cc:1434] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.003s
I20260709 12:24:43.560617  3324 tablet_bootstrap.cc:492] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:43.561334  3320 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:43.562136  3320 ts_tablet_manager.cc:1403] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.003s
I20260709 12:24:43.563956  3201 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:43.565929  3320 raft_consensus.cc:359] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.566819  3320 raft_consensus.cc:385] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.567165  3320 raft_consensus.cc:740] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.568221  3322 consensus_queue.cc:260] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.571506  3322 ts_tablet_manager.cc:1434] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:24:43.573381  3322 tablet_bootstrap.cc:492] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:43.572230  3320 consensus_queue.cc:260] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.571590  3321 tablet_bootstrap.cc:654] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.588363  3324 tablet_bootstrap.cc:654] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.581625  3320 ts_tablet_manager.cc:1434] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:24:43.591954  3322 tablet_bootstrap.cc:654] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.593904  3340 raft_consensus.cc:493] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.594439  3340 raft_consensus.cc:515] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.597564  3320 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:43.598088  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:43.600425  3340 leader_election.cc:290] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:43.602993  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:43.604758  3089 leader_election.cc:304] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:43.606178  3340 raft_consensus.cc:2749] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.612059  2945 catalog_manager.cc:5697] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:43.615451  3320 tablet_bootstrap.cc:654] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.616707  3324 tablet_bootstrap.cc:492] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:43.617242  3321 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:43.617422  3324 ts_tablet_manager.cc:1403] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.005s
I20260709 12:24:43.617998  3321 ts_tablet_manager.cc:1403] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.000s
I20260709 12:24:43.618188  3322 tablet_bootstrap.cc:492] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:43.619138  3322 ts_tablet_manager.cc:1403] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.000s
I20260709 12:24:43.622216  3322 raft_consensus.cc:359] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.622990  3322 raft_consensus.cc:385] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.623304  3322 raft_consensus.cc:740] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.624112  3322 consensus_queue.cc:260] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.625917  3324 raft_consensus.cc:359] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.628970  3324 raft_consensus.cc:385] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.626605  3322 ts_tablet_manager.cc:1434] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:43.629433  3324 raft_consensus.cc:740] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.630319  3322 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:43.622095  3321 raft_consensus.cc:359] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.631721  3321 raft_consensus.cc:385] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.630491  3324 consensus_queue.cc:260] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.632151  3321 raft_consensus.cc:740] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.640748  3324 ts_tablet_manager.cc:1434] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.003s
I20260709 12:24:43.641168  3320 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:43.642146  3324 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:43.638796  3321 consensus_queue.cc:260] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.649811  3321 ts_tablet_manager.cc:1434] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.031s	user 0.013s	sys 0.001s
I20260709 12:24:43.642570  3322 tablet_bootstrap.cc:654] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.655042  3324 tablet_bootstrap.cc:654] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.641805  3320 ts_tablet_manager.cc:1403] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.002s
I20260709 12:24:43.656764  3321 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:43.663390  3320 raft_consensus.cc:359] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.664111  3320 raft_consensus.cc:385] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.664395  3320 raft_consensus.cc:740] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.665226  3320 consensus_queue.cc:260] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.667747  3320 ts_tablet_manager.cc:1434] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:43.669198  3320 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:43.669302  3322 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:43.669966  3322 ts_tablet_manager.cc:1403] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.004s
I20260709 12:24:43.673015  3322 raft_consensus.cc:359] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.673713  3322 raft_consensus.cc:385] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.674049  3322 raft_consensus.cc:740] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.674783  3322 consensus_queue.cc:260] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.677026  3322 ts_tablet_manager.cc:1434] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:24:43.678263  3322 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:43.679342  3320 tablet_bootstrap.cc:654] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.684803  3322 tablet_bootstrap.cc:654] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.685889  3321 tablet_bootstrap.cc:654] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.691453  3324 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:43.692005  3324 ts_tablet_manager.cc:1403] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 12:24:43.692731  3320 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:43.693351  3320 ts_tablet_manager.cc:1403] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 12:24:43.695053  3324 raft_consensus.cc:359] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.695849  3324 raft_consensus.cc:385] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.696142  3324 raft_consensus.cc:740] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.696543  3320 raft_consensus.cc:359] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.696911  3324 consensus_queue.cc:260] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.700130  3324 ts_tablet_manager.cc:1434] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:24:43.702052  3324 tablet_bootstrap.cc:492] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:43.702687  3321 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:43.702893  3322 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:43.703356  3321 ts_tablet_manager.cc:1403] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.009s
I20260709 12:24:43.703480  3320 raft_consensus.cc:385] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.703850  3320 raft_consensus.cc:740] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.704617  3320 consensus_queue.cc:260] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.705253  3050 raft_consensus.cc:3060] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.703356  3322 ts_tablet_manager.cc:1403] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.004s
I20260709 12:24:43.707203  3320 ts_tablet_manager.cc:1434] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:24:43.708612  3320 tablet_bootstrap.cc:492] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:43.710259  3322 raft_consensus.cc:359] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.714399  3322 raft_consensus.cc:385] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.714815  3322 raft_consensus.cc:740] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.708374  3321 raft_consensus.cc:359] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.712920  3356 raft_consensus.cc:493] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.716058  3356 raft_consensus.cc:515] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.715657  3322 consensus_queue.cc:260] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.718231  3356 leader_election.cc:290] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:43.718679  3322 ts_tablet_manager.cc:1434] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:24:43.720175  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.720921  3321 raft_consensus.cc:385] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.711210  3324 tablet_bootstrap.cc:654] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.720578  3322 tablet_bootstrap.cc:492] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:43.720161  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5683a9c6a043ba9703ca5df5b58e5e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:43.721185  3125 raft_consensus.cc:2393] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:43.724534  3166 leader_election.cc:304] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:43.725634  3356 raft_consensus.cc:3060] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.715654  3320 tablet_bootstrap.cc:654] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.721210  3321 raft_consensus.cc:740] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.729435  3321 consensus_queue.cc:260] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.731721  3321 ts_tablet_manager.cc:1434] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:24:43.734493  3356 raft_consensus.cc:2749] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.740213  3321 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:43.742990  3322 tablet_bootstrap.cc:654] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.747509  3321 tablet_bootstrap.cc:654] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.757949  3276 raft_consensus.cc:3060] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.762037  3324 tablet_bootstrap.cc:492] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:43.762604  3324 ts_tablet_manager.cc:1403] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.012s
I20260709 12:24:43.765291  3324 raft_consensus.cc:359] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.766078  3324 raft_consensus.cc:385] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.766412  3324 raft_consensus.cc:740] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.767122  3340 consensus_queue.cc:1048] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:43.767220  3324 consensus_queue.cc:260] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.769707  3320 tablet_bootstrap.cc:492] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:43.770342  3320 ts_tablet_manager.cc:1403] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.007s
I20260709 12:24:43.770799  3324 ts_tablet_manager.cc:1434] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:43.772249  3324 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:43.773314  3320 raft_consensus.cc:359] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.774093  3320 raft_consensus.cc:385] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.774252  3390 raft_consensus.cc:493] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.774400  3320 raft_consensus.cc:740] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.774857  3390 raft_consensus.cc:515] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.775254  3320 consensus_queue.cc:260] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.778446  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.779084  3324 tablet_bootstrap.cc:654] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.779124  3125 raft_consensus.cc:2468] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.780771  3241 leader_election.cc:304] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:43.779583  3320 ts_tablet_manager.cc:1434] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:24:43.781669  3331 raft_consensus.cc:2804] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.782231  3320 tablet_bootstrap.cc:492] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:43.782147  3331 raft_consensus.cc:493] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.782792  3331 raft_consensus.cc:3060] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.783124  3322 tablet_bootstrap.cc:492] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:43.783632  3322 ts_tablet_manager.cc:1403] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.002s
I20260709 12:24:43.784053  3391 raft_consensus.cc:493] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.784713  3391 raft_consensus.cc:515] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.794724  3390 leader_election.cc:290] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:43.806143  3390 raft_consensus.cc:493] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.807022  3390 raft_consensus.cc:515] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.820894  3125 raft_consensus.cc:3060] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.832821  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.833616  3124 raft_consensus.cc:2468] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.834555  3356 raft_consensus.cc:493] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.833226  3320 tablet_bootstrap.cc:654] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.835098  3356 raft_consensus.cc:515] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.835587  3241 leader_election.cc:304] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:43.836649  3359 raft_consensus.cc:2804] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.837108  3359 raft_consensus.cc:493] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.837321  3356 leader_election.cc:290] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:43.839350  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.839710  3390 leader_election.cc:290] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:43.840056  3124 raft_consensus.cc:2468] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:43.841202  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:43.842029  3201 raft_consensus.cc:2468] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.841239  3166 leader_election.cc:304] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:43.844130  3356 raft_consensus.cc:2804] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.844514  3356 raft_consensus.cc:493] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.844877  3356 raft_consensus.cc:3060] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.845013  3320 tablet_bootstrap.cc:492] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:43.845516  3320 ts_tablet_manager.cc:1403] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 12:24:43.845434  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:43.846269  3050 raft_consensus.cc:2468] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.848634  3320 raft_consensus.cc:359] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.849357  3320 raft_consensus.cc:385] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.849611  3320 raft_consensus.cc:740] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.850313  3320 consensus_queue.cc:260] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.844146  3331 raft_consensus.cc:515] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:43.859794  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:43.859549  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:43.860374  3331 leader_election.cc:290] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:43.860522  3124 raft_consensus.cc:3060] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.862309  3321 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:43.862879  3321 ts_tablet_manager.cc:1403] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.123s	user 0.021s	sys 0.009s
I20260709 12:24:43.864449  3324 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:43.865026  3324 ts_tablet_manager.cc:1403] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.093s	user 0.036s	sys 0.044s
I20260709 12:24:43.865020  3356 raft_consensus.cc:515] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.865897  3321 raft_consensus.cc:359] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.866631  3321 raft_consensus.cc:385] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.866919  3321 raft_consensus.cc:740] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.868947  3324 raft_consensus.cc:359] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.870046  3324 raft_consensus.cc:385] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.870321  3324 raft_consensus.cc:740] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.870599  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:43.868738  3331 raft_consensus.cc:493] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.871208  3050 raft_consensus.cc:3060] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.871107  3324 consensus_queue.cc:260] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.871693  3331 raft_consensus.cc:515] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.872846  3390 consensus_queue.cc:1048] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:43.873862  3331 leader_election.cc:290] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:43.868794  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:43.875895  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:43.878899  3320 ts_tablet_manager.cc:1434] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:24:43.879405  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a66c9d2932647f78f50e3fe9b152ef0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.880105  3122 raft_consensus.cc:2468] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.880172  3124 raft_consensus.cc:2468] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:43.881178  3321 consensus_queue.cc:260] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.882274  3320 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:43.883733  3391 leader_election.cc:290] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:43.885390  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785d60abe3b48a2ab7a4329aec2166a" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:43.885462  3340 consensus_queue.cc:1048] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:43.887531  3015 leader_election.cc:304] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:43.889575  3241 leader_election.cc:304] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:43.890116  3395 raft_consensus.cc:2749] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:43.892488  3321 ts_tablet_manager.cc:1434] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:24:43.891985  3387 consensus_queue.cc:1048] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:43.892588  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a66c9d2932647f78f50e3fe9b152ef0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:43.890758  3241 leader_election.cc:304] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:43.837574  3359 raft_consensus.cc:3060] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.893868  3387 raft_consensus.cc:2804] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:43.896600  3321 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:43.895328  3387 raft_consensus.cc:493] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.900192  3387 raft_consensus.cc:3060] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.910656  3331 raft_consensus.cc:2804] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:43.912909  3390 raft_consensus.cc:493] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.913656  3390 raft_consensus.cc:515] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.916561  3390 leader_election.cc:290] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:43.917253  3322 raft_consensus.cc:359] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.926882  3391 raft_consensus.cc:493] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.930154  3356 leader_election.cc:290] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:43.890599  3050 raft_consensus.cc:2468] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:43.955660  3320 tablet_bootstrap.cc:654] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.948966  3321 tablet_bootstrap.cc:654] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.969892  3322 raft_consensus.cc:385] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:43.970306  3322 raft_consensus.cc:740] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:43.971153  3322 consensus_queue.cc:260] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:43.972966  3322 ts_tablet_manager.cc:1434] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.189s	user 0.008s	sys 0.000s
I20260709 12:24:43.974928  3391 raft_consensus.cc:515] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:43.980288  3391 leader_election.cc:290] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:43.944164  3387 raft_consensus.cc:515] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.950029  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:43.948992  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:43.981736  3122 raft_consensus.cc:3060] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.983283  3387 leader_election.cc:290] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:43.984746  3321 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:43.985328  3321 ts_tablet_manager.cc:1403] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.000s
I20260709 12:24:43.985747  3322 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:43.988404  3321 raft_consensus.cc:359] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:43.949518  3427 raft_consensus.cc:493] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.960779  3324 ts_tablet_manager.cc:1434] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.095s	user 0.041s	sys 0.016s
I20260709 12:24:43.990134  3427 raft_consensus.cc:515] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:43.991050  3324 tablet_bootstrap.cc:492] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:43.991448  3200 raft_consensus.cc:2468] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:43.997205  3427 leader_election.cc:290] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:43.998160  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:43.998970  3050 raft_consensus.cc:2468] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:43.999099  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:43.999428  3324 tablet_bootstrap.cc:654] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:43.999969  3125 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:43.953029  3359 raft_consensus.cc:515] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.000365  3165 leader_election.cc:304] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:44.001473  3276 raft_consensus.cc:2393] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:44.002050  3427 raft_consensus.cc:2804] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.002559  3427 raft_consensus.cc:493] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.002969  3427 raft_consensus.cc:3060] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:43.989238  3321 raft_consensus.cc:385] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.008522  3321 raft_consensus.cc:740] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.010264  3359 leader_election.cc:290] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.009392  3321 consensus_queue.cc:260] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.014745  3321 ts_tablet_manager.cc:1434] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 12:24:44.014905  3015 leader_election.cc:304] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:44.018899  3321 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:44.015877  3391 raft_consensus.cc:2804] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.029839  3391 raft_consensus.cc:493] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.033628  3322 tablet_bootstrap.cc:654] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.030354  3391 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.021672  3331 raft_consensus.cc:697] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:44.032864  3122 raft_consensus.cc:2468] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
W20260709 12:24:44.043198  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 68041.8us
I20260709 12:24:44.044970  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:44.049088  3199 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:44.049165  3166 leader_election.cc:304] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:44.049664  3050 raft_consensus.cc:3060] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.052299  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a66c9d2932647f78f50e3fe9b152ef0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:44.053517  3122 raft_consensus.cc:3060] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.055317  3331 consensus_queue.cc:237] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.048214  3395 consensus_queue.cc:1048] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:24:44.058105  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:44.058800  3049 raft_consensus.cc:2468] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:44.062129  3321 tablet_bootstrap.cc:654] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.066917  3324 tablet_bootstrap.cc:492] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:44.069229  3324 ts_tablet_manager.cc:1403] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.004s
I20260709 12:24:44.067001  3430 raft_consensus.cc:2804] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.070554  3430 raft_consensus.cc:697] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:44.070827  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a66c9d2932647f78f50e3fe9b152ef0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:44.071497  3049 raft_consensus.cc:3060] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.071532  3430 consensus_queue.cc:237] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.081030  3320 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:44.081743  3320 ts_tablet_manager.cc:1403] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.202s	user 0.015s	sys 0.016s
I20260709 12:24:44.097843  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:44.088739  3391 raft_consensus.cc:515] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.102907  3391 leader_election.cc:290] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.103892  3122 raft_consensus.cc:2468] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:44.104255  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:44.105118  3125 raft_consensus.cc:2393] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:44.107519  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:44.108208  3200 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.108145  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
W20260709 12:24:44.108945  3240 leader_election.cc:343] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.109203  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:44.108969  3125 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.109953  3275 raft_consensus.cc:2468] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:44.111219  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:44.112088  3274 raft_consensus.cc:2393] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:44.110659  3240 leader_election.cc:304] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:44.115571  3387 raft_consensus.cc:2804] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.116007  3387 raft_consensus.cc:493] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.116353  3387 raft_consensus.cc:3060] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.116654  3428 raft_consensus.cc:493] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.107708  3427 raft_consensus.cc:515] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.116361  3049 raft_consensus.cc:2468] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:44.124841  3428 raft_consensus.cc:515] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.144799  3322 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:44.146790  3322 ts_tablet_manager.cc:1403] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.005s
I20260709 12:24:44.149121  3399 raft_consensus.cc:493] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.152099  3399 raft_consensus.cc:515] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.154793  3399 leader_election.cc:290] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.155704  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:44.157322  3089 leader_election.cc:343] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.158849  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:44.159590  3201 raft_consensus.cc:2468] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:44.161018  3090 leader_election.cc:304] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:44.166952  3428 leader_election.cc:290] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.166172  3387 raft_consensus.cc:515] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.169261  3387 leader_election.cc:290] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:44.170573  3324 raft_consensus.cc:359] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.171383  3324 raft_consensus.cc:385] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.171657  3324 raft_consensus.cc:740] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.172377  3324 consensus_queue.cc:260] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.173928  3395 consensus_queue.cc:1048] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.176085  3321 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:44.176779  3321 ts_tablet_manager.cc:1403] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.161s	user 0.013s	sys 0.008s
I20260709 12:24:44.177403  3320 raft_consensus.cc:359] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.179867  3320 raft_consensus.cc:385] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.180267  3320 raft_consensus.cc:740] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.135048  3241 leader_election.cc:304] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:44.181494  3320 consensus_queue.cc:260] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.177165  3399 raft_consensus.cc:2804] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.186419  3399 raft_consensus.cc:493] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.186815  3399 raft_consensus.cc:3060] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:44.187139  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 57929.5us
I20260709 12:24:44.188174  3428 raft_consensus.cc:2804] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.188088  3241 leader_election.cc:304] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.189455  3359 raft_consensus.cc:2749] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.190538  3428 raft_consensus.cc:697] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:44.191773  3428 consensus_queue.cc:237] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:44.190637  3240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 46638.8us
I20260709 12:24:44.196494  3321 raft_consensus.cc:359] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.197304  3321 raft_consensus.cc:385] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.197446  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:44.198460  3048 raft_consensus.cc:3060] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.200376  3427 leader_election.cc:290] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:44.201130  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:44.201903  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:44.202701  3274 raft_consensus.cc:2393] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:44.202775  3322 raft_consensus.cc:359] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.203521  3322 raft_consensus.cc:385] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.203794  3322 raft_consensus.cc:740] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.204524  3322 consensus_queue.cc:260] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.205267  3125 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:44.206283  3166 leader_election.cc:304] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:44.211054  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:44.211382  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:44.211867  3122 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:44.212165  3201 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:44.212702  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:44.211371  3427 raft_consensus.cc:2749] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.197611  3321 raft_consensus.cc:740] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.214279  3331 consensus_queue.cc:1048] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.214563  3321 consensus_queue.cc:260] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.210259  3200 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:44.215852  3198 raft_consensus.cc:2393] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:44.216750  3015 leader_election.cc:304] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:44.218091  3395 raft_consensus.cc:2804] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.218590  3395 raft_consensus.cc:697] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:44.186730  3320 ts_tablet_manager.cc:1434] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.105s	user 0.008s	sys 0.000s
I20260709 12:24:44.219689  3395 consensus_queue.cc:237] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.220495  3320 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:44.226276  3048 raft_consensus.cc:2468] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:44.227825  3240 leader_election.cc:304] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:44.228932  3387 raft_consensus.cc:2804] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.227435  3399 raft_consensus.cc:515] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.230530  3241 leader_election.cc:304] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:44.229900  3359 consensus_queue.cc:1048] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.232359  3359 raft_consensus.cc:2804] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.232867  3359 raft_consensus.cc:493] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.233273  3359 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.232447  3321 ts_tablet_manager.cc:1434] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.002s
I20260709 12:24:44.234577  3321 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:44.229734  3387 raft_consensus.cc:697] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:44.235740  3387 consensus_queue.cc:237] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.230214  3324 ts_tablet_manager.cc:1434] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.160s	user 0.008s	sys 0.000s
I20260709 12:24:44.233372  3322 ts_tablet_manager.cc:1434] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 12:24:44.241421  3322 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:44.246738  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:44.247601  3049 raft_consensus.cc:3060] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.250212  3320 tablet_bootstrap.cc:654] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.260089  3324 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:44.270110  3321 tablet_bootstrap.cc:654] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.278057  3399 leader_election.cc:290] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.280196  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:44.280928  3201 raft_consensus.cc:3060] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.346354  3322 tablet_bootstrap.cc:654] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.348790  3049 raft_consensus.cc:2468] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:44.356261  3089 leader_election.cc:304] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:44.357646  3399 raft_consensus.cc:2804] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.358371  3399 raft_consensus.cc:697] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:44.359664  3399 consensus_queue.cc:237] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.368427  2948 catalog_manager.cc:5697] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.375502  3324 tablet_bootstrap.cc:654] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.381733  3320 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:44.382985  3320 ts_tablet_manager.cc:1403] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.163s	user 0.018s	sys 0.014s
I20260709 12:24:44.365684  3359 raft_consensus.cc:515] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.388585  3359 leader_election.cc:290] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.380816  3201 raft_consensus.cc:2468] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:44.404711  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:44.405547  3124 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.406780  3321 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:44.407446  3321 ts_tablet_manager.cc:1403] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.173s	user 0.019s	sys 0.041s
I20260709 12:24:44.418697  3321 raft_consensus.cc:359] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.419867  3321 raft_consensus.cc:385] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.420281  3321 raft_consensus.cc:740] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.417387  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:44.422197  3200 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.427170  3320 raft_consensus.cc:359] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.427999  3320 raft_consensus.cc:385] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.428470  3320 raft_consensus.cc:740] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.429253  3320 consensus_queue.cc:260] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.432081  3320 ts_tablet_manager.cc:1434] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:24:44.431833  2946 catalog_manager.cc:5697] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.433241  3320 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:44.433940  3322 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:44.438004  3322 ts_tablet_manager.cc:1403] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.197s	user 0.031s	sys 0.013s
I20260709 12:24:44.438675  3124 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:44.440326  3241 leader_election.cc:304] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:44.441155  3324 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:44.441286  3359 raft_consensus.cc:2804] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.441845  3324 ts_tablet_manager.cc:1403] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.187s	user 0.017s	sys 0.004s
I20260709 12:24:44.442086  3359 raft_consensus.cc:697] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:44.434598  3321 consensus_queue.cc:260] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.443434  3359 consensus_queue.cc:237] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.445606  3321 ts_tablet_manager.cc:1434] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 12:24:44.446777  3321 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:44.446333  3322 raft_consensus.cc:359] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.440932  3320 tablet_bootstrap.cc:654] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.447443  3322 raft_consensus.cc:385] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.454833  3321 tablet_bootstrap.cc:654] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.455039  3324 raft_consensus.cc:359] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.455884  3324 raft_consensus.cc:385] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.456223  3324 raft_consensus.cc:740] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.457033  3324 consensus_queue.cc:260] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.437013  3200 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:44.447929  3322 raft_consensus.cc:740] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.461174  3322 consensus_queue.cc:260] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.463948  3320 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:44.464537  3324 ts_tablet_manager.cc:1434] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:24:44.464840  3320 ts_tablet_manager.cc:1403] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.002s
I20260709 12:24:44.465890  3324 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:44.470661  3322 ts_tablet_manager.cc:1434] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:24:44.472210  3322 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:44.479087  3321 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:44.479696  3321 ts_tablet_manager.cc:1403] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.009s
I20260709 12:24:44.472239  3320 raft_consensus.cc:359] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.482450  3321 raft_consensus.cc:359] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.483179  3321 raft_consensus.cc:385] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.483448  3321 raft_consensus.cc:740] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.483613  3324 tablet_bootstrap.cc:654] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.482502  3320 raft_consensus.cc:385] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.484182  3320 raft_consensus.cc:740] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.484984  3320 consensus_queue.cc:260] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.485790  3399 raft_consensus.cc:493] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.486330  3399 raft_consensus.cc:515] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.487097  3320 ts_tablet_manager.cc:1434] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:24:44.487800  3322 tablet_bootstrap.cc:654] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.488124  3320 tablet_bootstrap.cc:492] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:44.488648  3399 leader_election.cc:290] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:44.489545  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
W20260709 12:24:44.491328  3090 leader_election.cc:343] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.494189  3321 consensus_queue.cc:260] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.495962  3321 ts_tablet_manager.cc:1434] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.003s
I20260709 12:24:44.495728  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:44.496946  3321 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
W20260709 12:24:44.498257  3089 leader_election.cc:343] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.509632  3320 tablet_bootstrap.cc:654] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.509720  3089 leader_election.cc:304] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:44.512658  3321 tablet_bootstrap.cc:654] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.516389  3428 consensus_queue.cc:1048] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.499203  2945 catalog_manager.cc:5697] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.521441  3320 tablet_bootstrap.cc:492] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:44.522006  3320 ts_tablet_manager.cc:1403] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.010s
I20260709 12:24:44.522554  3321 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:44.523453  3321 ts_tablet_manager.cc:1403] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.011s
I20260709 12:24:44.526414  3321 raft_consensus.cc:359] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.526800  3430 consensus_queue.cc:1048] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.529358  3320 raft_consensus.cc:359] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.529855  3399 raft_consensus.cc:2749] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.534061  3399 raft_consensus.cc:493] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.534771  3399 raft_consensus.cc:515] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.539361  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:44.540074  3399 leader_election.cc:290] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.530167  3320 raft_consensus.cc:385] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.527117  3321 raft_consensus.cc:385] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.540768  3321 raft_consensus.cc:740] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.540683  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:44.541831  3321 consensus_queue.cc:260] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:44.542471  3090 leader_election.cc:343] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.541469  3050 raft_consensus.cc:2468] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:44.544131  3320 raft_consensus.cc:740] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.545230  3320 consensus_queue.cc:260] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.544142  3321 ts_tablet_manager.cc:1434] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:24:44.547186  3089 leader_election.cc:304] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.547693  3321 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:44.548339  3399 raft_consensus.cc:2804] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.548784  3399 raft_consensus.cc:493] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.549139  3399 raft_consensus.cc:3060] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.552253  3322 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:44.552853  3322 ts_tablet_manager.cc:1403] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.081s	user 0.027s	sys 0.011s
I20260709 12:24:44.554752  3321 tablet_bootstrap.cc:654] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.555176  3331 consensus_queue.cc:1048] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.559258  3320 ts_tablet_manager.cc:1434] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:24:44.560005  3429 consensus_queue.cc:1048] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.560956  3320 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:44.555946  3322 raft_consensus.cc:359] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.562146  3322 raft_consensus.cc:385] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.562548  3322 raft_consensus.cc:740] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.563531  3322 consensus_queue.cc:260] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.566474  3322 ts_tablet_manager.cc:1434] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:24:44.567956  3322 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:44.568943  3324 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:44.570051  3324 ts_tablet_manager.cc:1403] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.104s	user 0.021s	sys 0.019s
I20260709 12:24:44.574741  3324 raft_consensus.cc:359] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.575407  3429 raft_consensus.cc:493] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.580017  3324 raft_consensus.cc:385] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.580422  3324 raft_consensus.cc:740] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.580245  3429 raft_consensus.cc:515] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.581988  3320 tablet_bootstrap.cc:654] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.582932  3429 leader_election.cc:290] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:44.585431  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba3c6335b4349149377369fd75c48fb" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:44.586480  3276 raft_consensus.cc:2468] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:44.585431  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba3c6335b4349149377369fd75c48fb" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:44.587456  3322 tablet_bootstrap.cc:654] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.587858  3050 raft_consensus.cc:2468] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:44.587987  3166 leader_election.cc:304] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:44.589387  3427 raft_consensus.cc:2804] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.589870  3427 raft_consensus.cc:493] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.590238  3427 raft_consensus.cc:3060] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.593989  3428 raft_consensus.cc:493] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.594581  3428 raft_consensus.cc:515] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.597829  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:44.597858  3320 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:44.598979  3320 ts_tablet_manager.cc:1403] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.005s
I20260709 12:24:44.593989  3343 raft_consensus.cc:493] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:44.599483  3241 leader_election.cc:343] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.599766  3343 raft_consensus.cc:515] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.600631  3428 leader_election.cc:290] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:44.601608  3395 raft_consensus.cc:493] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.602171  3395 raft_consensus.cc:515] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.602806  3320 raft_consensus.cc:359] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.603474  3343 leader_election.cc:290] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.603827  3320 raft_consensus.cc:385] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.604257  3320 raft_consensus.cc:740] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.605109  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:44.605252  3320 consensus_queue.cc:260] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.605918  3122 raft_consensus.cc:2468] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:44.606132  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:44.607537  3395 leader_election.cc:290] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.599124  3427 raft_consensus.cc:515] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:44.608232  3015 leader_election.cc:343] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.609167  3015 leader_election.cc:304] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.609220  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:44.610914  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:44.611557  3090 leader_election.cc:343] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:44.612416  3240 leader_election.cc:343] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.611595  3320 ts_tablet_manager.cc:1434] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:24:44.612938  3240 leader_election.cc:304] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.613212  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:44.613884  3050 raft_consensus.cc:2468] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:44.614285  3320 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:44.614387  3428 raft_consensus.cc:2749] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.615568  3428 raft_consensus.cc:493] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.616032  3428 raft_consensus.cc:515] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.618430  3395 raft_consensus.cc:2804] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.618992  3395 raft_consensus.cc:493] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.619480  3395 raft_consensus.cc:3060] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.621196  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:44.626879  3240 leader_election.cc:343] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.622231  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba3c6335b4349149377369fd75c48fb" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:44.627612  3276 raft_consensus.cc:3060] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.628401  3320 tablet_bootstrap.cc:654] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.628687  3427 leader_election.cc:290] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:44.621940  3089 leader_election.cc:304] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.622614  3428 leader_election.cc:290] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:44.629729  3343 raft_consensus.cc:2804] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.630162  3343 raft_consensus.cc:493] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.630508  3343 raft_consensus.cc:3060] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.633008  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba3c6335b4349149377369fd75c48fb" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:44.624367  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:44.633652  3050 raft_consensus.cc:3060] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:44.638150  3241 leader_election.cc:343] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.638729  3276 raft_consensus.cc:2468] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:44.638756  3241 leader_election.cc:304] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:44.640503  3428 raft_consensus.cc:2749] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.640689  3166 leader_election.cc:304] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:44.608258  3324 consensus_queue.cc:260] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.643592  3324 ts_tablet_manager.cc:1434] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 12:24:44.642019  3427 raft_consensus.cc:2804] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.644701  3324 tablet_bootstrap.cc:492] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:44.646139  2947 catalog_manager.cc:5697] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.648428  3427 raft_consensus.cc:697] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:44.662900  2947 catalog_manager.cc:5697] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.665038  3427 consensus_queue.cc:237] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.669258  3322 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:44.670063  3322 ts_tablet_manager.cc:1403] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.102s	user 0.028s	sys 0.020s
I20260709 12:24:44.657567  3399 raft_consensus.cc:515] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.673861  3322 raft_consensus.cc:359] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.676342  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
W20260709 12:24:44.678032  3090 leader_election.cc:343] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.679440  3399 leader_election.cc:290] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.678990  3395 raft_consensus.cc:515] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.680001  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:44.680943  3049 raft_consensus.cc:3060] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.684900  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:44.687628  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
W20260709 12:24:44.689276  3015 leader_election.cc:343] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.674872  3322 raft_consensus.cc:385] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.690768  3322 raft_consensus.cc:740] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.693600  3049 raft_consensus.cc:2468] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:44.660207  3457 consensus_queue.cc:1048] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.649255  3343 raft_consensus.cc:515] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.699214  3124 raft_consensus.cc:2393] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:44.702489  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:44.703446  3048 raft_consensus.cc:2393] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:44.704491  3331 raft_consensus.cc:493] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.650099  3428 consensus_queue.cc:1048] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.693193  3322 consensus_queue.cc:260] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.654635  3050 raft_consensus.cc:2468] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:44.706378  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:44.728947  3331 raft_consensus.cc:515] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.728104  3395 leader_election.cc:290] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.733927  3429 raft_consensus.cc:493] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.741073  3322 ts_tablet_manager.cc:1434] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
W20260709 12:24:44.742062  3090 leader_election.cc:343] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.741835  3429 raft_consensus.cc:515] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.742528  3090 leader_election.cc:304] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.743103  3322 tablet_bootstrap.cc:492] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:44.744272  3429 leader_election.cc:290] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:44.744477  3340 raft_consensus.cc:2749] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.747150  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:44.749259  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
W20260709 12:24:44.749533  3165 leader_election.cc:343] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.706521  3015 leader_election.cc:304] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
W20260709 12:24:44.750864  3166 leader_election.cc:343] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:44.751114  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 44736.4us
I20260709 12:24:44.740988  3089 leader_election.cc:304] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.751456  3166 leader_election.cc:304] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:44.752295  3340 raft_consensus.cc:2804] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:44.752277  3395 raft_consensus.cc:2749] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.752974  3431 consensus_queue.cc:1048] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.754693  3429 raft_consensus.cc:2749] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.756982  3359 consensus_queue.cc:1048] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.760622  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:44.761972  3125 raft_consensus.cc:2468] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:44.704744  3343 leader_election.cc:290] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.760825  3331 leader_election.cc:290] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:44.758157  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:44.776262  3241 leader_election.cc:304] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:44.783622  3324 tablet_bootstrap.cc:654] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.785621  3331 raft_consensus.cc:2804] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:44.786119  3331 raft_consensus.cc:493] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.788537  3395 consensus_queue.cc:1048] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.791051  3320 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:44.791779  3320 ts_tablet_manager.cc:1403] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.178s	user 0.025s	sys 0.021s
I20260709 12:24:44.801836  3322 tablet_bootstrap.cc:654] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.786499  3331 raft_consensus.cc:3060] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:44.804811  3387 raft_consensus.cc:493] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.805692  3387 raft_consensus.cc:515] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.808115  3387 leader_election.cc:290] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:44.811473  3321 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:44.812222  3321 ts_tablet_manager.cc:1403] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.265s	user 0.075s	sys 0.067s
I20260709 12:24:44.814296  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:44.815287  3320 raft_consensus.cc:359] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:44.816421  3320 raft_consensus.cc:385] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.816885  3320 raft_consensus.cc:740] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.819021  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:44.825450  3241 leader_election.cc:343] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:44.826216  3241 leader_election.cc:343] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.826640  3241 leader_election.cc:304] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:44.828778  3320 consensus_queue.cc:260] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:44.830530  3240 leader_election.cc:343] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.834411  3428 raft_consensus.cc:2749] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:44.844242  3340 raft_consensus.cc:697] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:44.863328  3340 consensus_queue.cc:237] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.865878  3343 consensus_queue.cc:1048] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.860864  3321 raft_consensus.cc:359] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.867513  3321 raft_consensus.cc:385] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.868216  3321 raft_consensus.cc:740] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.868762  3320 ts_tablet_manager.cc:1434] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.000s
I20260709 12:24:44.869831  3320 tablet_bootstrap.cc:492] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:44.870697  3431 consensus_queue.cc:1048] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:44.869282  3321 consensus_queue.cc:260] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:44.876922  3321 ts_tablet_manager.cc:1434] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.064s	user 0.017s	sys 0.000s
I20260709 12:24:44.878077  3321 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:44.885943  3321 tablet_bootstrap.cc:654] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.891362  3324 tablet_bootstrap.cc:492] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:44.891950  3324 ts_tablet_manager.cc:1403] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.247s	user 0.012s	sys 0.006s
I20260709 12:24:44.907918  3324 raft_consensus.cc:359] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.908926  3324 raft_consensus.cc:385] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:44.909286  3324 raft_consensus.cc:740] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:44.913064  3331 raft_consensus.cc:515] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:44.924881  3324 consensus_queue.cc:260] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:44.903204  2946 catalog_manager.cc:5697] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:44.931156  2946 catalog_manager.cc:5697] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:44.933023  3486 consensus_queue.cc:1048] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:44.942340  3324 ts_tablet_manager.cc:1434] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 12:24:44.956640  3324 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
W20260709 12:24:44.965502  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:44.966419  3320 tablet_bootstrap.cc:654] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:44.977047  2948 catalog_manager.cc:5697] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:44.985920  3494 log.cc:927] Time spent T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:24:44.998018  3321 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:44.998785  3321 ts_tablet_manager.cc:1403] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.013s
I20260709 12:24:45.011078  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:45.014762  3331 leader_election.cc:290] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:45.017298  3429 raft_consensus.cc:493] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.017935  3429 raft_consensus.cc:515] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.020052  3429 leader_election.cc:290] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.021390  3321 raft_consensus.cc:359] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.023512  3321 raft_consensus.cc:385] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.024005  3321 raft_consensus.cc:740] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.026554  3322 tablet_bootstrap.cc:492] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:45.027227  3322 ts_tablet_manager.cc:1403] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.284s	user 0.024s	sys 0.009s
I20260709 12:24:45.027343  3321 consensus_queue.cc:260] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.032855  3321 ts_tablet_manager.cc:1434] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.005s
I20260709 12:24:45.030660  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:45.033092  3240 leader_election.cc:343] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.037881  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:45.040676  3499 consensus_queue.cc:1048] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:24:45.045924  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:45.046810  3122 raft_consensus.cc:3060] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:45.050282  3166 leader_election.cc:343] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:44.999065  2945 catalog_manager.cc:5697] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:45.052069  3166 leader_election.cc:343] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.052582  3166 leader_election.cc:304] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:45.053395  3320 tablet_bootstrap.cc:492] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:45.053987  3320 ts_tablet_manager.cc:1403] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.025s
I20260709 12:24:45.054837  3430 raft_consensus.cc:2749] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.056845  3320 raft_consensus.cc:359] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.057643  3320 raft_consensus.cc:385] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.057964  3320 raft_consensus.cc:740] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
W20260709 12:24:45.051743  3089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 50177.7us
I20260709 12:24:45.059068  3322 raft_consensus.cc:359] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.058876  3320 consensus_queue.cc:260] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.059875  3322 raft_consensus.cc:385] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.060177  3322 raft_consensus.cc:740] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.060822  3322 consensus_queue.cc:260] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.061386  3320 ts_tablet_manager.cc:1434] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:45.062420  3320 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:45.063529  3322 ts_tablet_manager.cc:1434] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 12:24:45.064512  3322 tablet_bootstrap.cc:492] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:45.066309  3321 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:45.077840  3320 tablet_bootstrap.cc:654] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.078114  3387 raft_consensus.cc:493] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.078624  3387 raft_consensus.cc:515] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.082893  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:45.087523  3240 leader_election.cc:343] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.088338  3387 leader_election.cc:290] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.091177  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.092008  3198 raft_consensus.cc:2468] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:45.094498  3387 consensus_queue.cc:1048] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.098201  3502 raft_consensus.cc:493] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.098848  3502 raft_consensus.cc:515] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.101397  3502 leader_election.cc:290] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.103680  3324 tablet_bootstrap.cc:654] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.105221  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:45.107987  3276 raft_consensus.cc:2468] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:45.109591  3090 leader_election.cc:304] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:45.106328  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.110512  3502 raft_consensus.cc:2804] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.110893  3198 raft_consensus.cc:2468] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:45.110976  3502 raft_consensus.cc:493] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.113744  3502 raft_consensus.cc:3060] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.118148  3322 tablet_bootstrap.cc:654] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.124866  3241 leader_election.cc:304] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:45.125528  3122 raft_consensus.cc:2468] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:45.126037  3428 raft_consensus.cc:2804] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.130724  3321 tablet_bootstrap.cc:654] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.132272  3428 raft_consensus.cc:493] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.142709  3428 raft_consensus.cc:3060] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.144068  3320 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:45.144672  3320 ts_tablet_manager.cc:1403] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.082s	user 0.025s	sys 0.033s
I20260709 12:24:45.148727  3241 leader_election.cc:304] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:45.149638  3387 raft_consensus.cc:2804] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.150211  3387 raft_consensus.cc:697] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:45.151156  3387 consensus_queue.cc:237] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.152843  3320 raft_consensus.cc:359] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.153596  3320 raft_consensus.cc:385] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.153900  3320 raft_consensus.cc:740] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.154596  3320 consensus_queue.cc:260] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.162055  3320 ts_tablet_manager.cc:1434] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:24:45.163309  3320 tablet_bootstrap.cc:492] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:45.147171  3502 raft_consensus.cc:515] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.170535  3324 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:45.171120  3324 ts_tablet_manager.cc:1403] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.216s	user 0.010s	sys 0.004s
I20260709 12:24:45.174230  3324 raft_consensus.cc:359] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.174947  3324 raft_consensus.cc:385] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.175211  3324 raft_consensus.cc:740] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.175791  3320 tablet_bootstrap.cc:654] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.176492  3324 consensus_queue.cc:260] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.178324  3321 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:45.178840  3321 ts_tablet_manager.cc:1403] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.006s
I20260709 12:24:45.180615  3324 ts_tablet_manager.cc:1434] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:45.186956  3502 leader_election.cc:290] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.188347  3321 raft_consensus.cc:359] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.189170  3321 raft_consensus.cc:385] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.189486  3321 raft_consensus.cc:740] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.198365  3502 raft_consensus.cc:493] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.189971  3324 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:45.189173  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:45.201653  3276 raft_consensus.cc:3060] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.204488  3322 tablet_bootstrap.cc:492] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:45.205291  3322 ts_tablet_manager.cc:1403] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.141s	user 0.008s	sys 0.005s
I20260709 12:24:45.194113  3430 consensus_queue.cc:1048] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.195149  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:45.206137  3198 raft_consensus.cc:3060] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.218910  3428 raft_consensus.cc:515] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.199800  3502 raft_consensus.cc:515] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.223481  3502 leader_election.cc:290] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.224380  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:45.225196  3275 raft_consensus.cc:2468] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:45.226063  3324 tablet_bootstrap.cc:654] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.227021  3090 leader_election.cc:304] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:45.229339  3276 raft_consensus.cc:2468] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:45.229434  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:45.242334  3322 raft_consensus.cc:359] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.250560  3321 consensus_queue.cc:260] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:45.251057  3089 leader_election.cc:343] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.241304  3428 leader_election.cc:290] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.252954  3321 ts_tablet_manager.cc:1434] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.000s
I20260709 12:24:45.253199  3322 raft_consensus.cc:385] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.249713  3090 leader_election.cc:304] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:45.253691  3322 raft_consensus.cc:740] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.240068  2946 catalog_manager.cc:5697] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.234589  3430 consensus_queue.cc:1048] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:24:45.254645  3322 consensus_queue.cc:260] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.255332  3399 raft_consensus.cc:2804] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.256135  3399 raft_consensus.cc:697] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:45.256837  3322 ts_tablet_manager.cc:1434] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 12:24:45.257274  3320 tablet_bootstrap.cc:492] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:45.257046  3399 consensus_queue.cc:237] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.235069  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:45.257902  3322 tablet_bootstrap.cc:492] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:45.238866  3501 raft_consensus.cc:2804] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.260121  3501 raft_consensus.cc:493] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.260571  3501 raft_consensus.cc:3060] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.235234  3391 raft_consensus.cc:493] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.261307  3240 leader_election.cc:343] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.261744  3391 raft_consensus.cc:515] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.264106  3391 leader_election.cc:290] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:45.232043  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:45.265268  3201 raft_consensus.cc:3060] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.257797  3320 ts_tablet_manager.cc:1403] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.095s	user 0.031s	sys 0.044s
I20260709 12:24:45.266948  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.268895  3321 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:45.268520  3320 raft_consensus.cc:359] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.269326  3320 raft_consensus.cc:385] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.269621  3320 raft_consensus.cc:740] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.272707  3198 raft_consensus.cc:2468] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
W20260709 12:24:45.274108  3015 leader_election.cc:343] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.285805  3391 raft_consensus.cc:493] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.291705  3391 raft_consensus.cc:515] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.273460  3320 consensus_queue.cc:260] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.277258  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:45.281284  3324 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:45.285679  3321 tablet_bootstrap.cc:654] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.295177  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:45.295919  3015 leader_election.cc:343] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.296451  3015 leader_election.cc:304] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:45.297643  3458 raft_consensus.cc:2749] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.295190  3324 ts_tablet_manager.cc:1403] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.110s	user 0.009s	sys 0.004s
W20260709 12:24:45.299281  3015 leader_election.cc:343] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.302001  3324 raft_consensus.cc:359] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.302706  3320 ts_tablet_manager.cc:1434] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:24:45.302894  3324 raft_consensus.cc:385] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.303280  3324 raft_consensus.cc:740] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.303807  3320 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:45.304132  3324 consensus_queue.cc:260] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.307037  3324 ts_tablet_manager.cc:1434] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:24:45.309085  3324 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:45.310801  3391 leader_election.cc:290] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.313407  2947 catalog_manager.cc:5697] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.316886  3320 tablet_bootstrap.cc:654] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.317509  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:45.318539  3274 raft_consensus.cc:2468] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:45.320056  3015 leader_election.cc:304] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:45.321058  3391 raft_consensus.cc:2804] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.321466  3391 raft_consensus.cc:493] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.321856  3391 raft_consensus.cc:3060] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.324184  3321 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:45.324795  3321 ts_tablet_manager.cc:1403] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.004s
I20260709 12:24:45.327726  3321 raft_consensus.cc:359] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.328487  3321 raft_consensus.cc:385] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.328758  3321 raft_consensus.cc:740] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.329586  3321 consensus_queue.cc:260] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.330948  3391 raft_consensus.cc:515] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.334597  3324 tablet_bootstrap.cc:654] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.331916  3321 ts_tablet_manager.cc:1434] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:24:45.337263  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:45.338001  3198 raft_consensus.cc:3060] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.338999  3321 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:45.337527  3501 raft_consensus.cc:515] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.342263  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:45.343129  3274 raft_consensus.cc:3060] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.344344  3428 raft_consensus.cc:493] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.344923  3428 raft_consensus.cc:515] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.346328  3321 tablet_bootstrap.cc:654] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.347273  3428 leader_election.cc:290] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.347296  3391 leader_election.cc:290] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.347544  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:45.348353  3276 raft_consensus.cc:3060] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.349133  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.349880  3199 raft_consensus.cc:2468] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:45.351387  3241 leader_election.cc:304] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:45.353268  3428 raft_consensus.cc:2804] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.354264  3322 tablet_bootstrap.cc:654] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.355331  3428 raft_consensus.cc:493] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.355866  3428 raft_consensus.cc:3060] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:45.357569  3090 consensus_peers.cc:597] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:45.367089  3276 raft_consensus.cc:2468] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:45.368551  3015 leader_election.cc:304] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:45.369621  3391 raft_consensus.cc:2804] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.370193  3391 raft_consensus.cc:697] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:45.368496  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:45.371063  3391 consensus_queue.cc:237] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:45.375195  3240 leader_election.cc:343] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.376853  3198 raft_consensus.cc:2468] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:45.377161  3322 tablet_bootstrap.cc:492] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:45.377652  3322 ts_tablet_manager.cc:1403] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.000s
I20260709 12:24:45.381203  3322 raft_consensus.cc:359] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.381970  3322 raft_consensus.cc:385] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.382290  3322 raft_consensus.cc:740] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.382109  3201 raft_consensus.cc:2468] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:45.384482  3322 consensus_queue.cc:260] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.385680  3241 leader_election.cc:304] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:45.385607  3501 leader_election.cc:290] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.386773  3322 ts_tablet_manager.cc:1434] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:24:45.388000  3387 raft_consensus.cc:2804] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.387440  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:45.395426  3322 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:45.397593  3320 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:45.398337  3320 ts_tablet_manager.cc:1403] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.021s
W20260709 12:24:45.399490  3089 leader_election.cc:343] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.396021  3387 raft_consensus.cc:697] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:45.397749  3431 raft_consensus.cc:493] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.400559  3387 consensus_queue.cc:237] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.400878  3431 raft_consensus.cc:515] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.402987  3431 leader_election.cc:290] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:45.404222  2945 catalog_manager.cc:5697] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.405041  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:45.405715  3124 raft_consensus.cc:2468] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:45.406816  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.407145  3241 leader_election.cc:304] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:45.402837  3274 raft_consensus.cc:2468] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
W20260709 12:24:45.408227  3241 leader_election.cc:343] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.409847  3431 raft_consensus.cc:2804] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.410279  3431 raft_consensus.cc:493] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.410650  3431 raft_consensus.cc:3060] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.423082  3321 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:45.422892  3501 consensus_queue.cc:1048] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.423715  3321 ts_tablet_manager.cc:1403] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.008s
I20260709 12:24:45.419893  3428 raft_consensus.cc:515] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.426609  3321 raft_consensus.cc:359] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.427350  3321 raft_consensus.cc:385] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.427626  3321 raft_consensus.cc:740] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.430485  3324 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:45.430572  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:45.431115  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:45.431597  3201 raft_consensus.cc:3060] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:45.432504  3240 leader_election.cc:343] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.433175  3321 consensus_queue.cc:260] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.435689  3428 leader_election.cc:290] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.435925  3321 ts_tablet_manager.cc:1434] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:45.437090  3321 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:45.406453  3320 raft_consensus.cc:359] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.439939  3320 raft_consensus.cc:385] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.441440  3322 tablet_bootstrap.cc:654] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.443099  3321 tablet_bootstrap.cc:654] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.431274  3324 ts_tablet_manager.cc:1403] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.021s
I20260709 12:24:45.445483  3431 raft_consensus.cc:515] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.446278  3090 leader_election.cc:304] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:45.447590  3501 raft_consensus.cc:2804] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.448300  3501 raft_consensus.cc:697] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:45.448671  3324 raft_consensus.cc:359] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.448951  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:45.449465  3324 raft_consensus.cc:385] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.449185  3501 consensus_queue.cc:237] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.449743  3124 raft_consensus.cc:3060] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.449882  3324 raft_consensus.cc:740] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.450914  3324 consensus_queue.cc:260] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.453384  3324 ts_tablet_manager.cc:1434] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:45.440315  3320 raft_consensus.cc:740] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.454764  3320 consensus_queue.cc:260] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.457175  3320 ts_tablet_manager.cc:1434] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 12:24:45.457221  3324 tablet_bootstrap.cc:492] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:45.458276  3320 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:45.458488  3431 leader_election.cc:290] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:45.458802  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
W20260709 12:24:45.460222  3241 leader_election.cc:343] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.468618  3124 raft_consensus.cc:2468] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:45.473338  3324 tablet_bootstrap.cc:654] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.474247  3241 leader_election.cc:304] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:45.475564  3431 raft_consensus.cc:2804] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.476097  3431 raft_consensus.cc:697] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:45.477892  3431 consensus_queue.cc:237] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.484006  2946 catalog_manager.cc:5697] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.491065  3322 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:45.491645  3322 ts_tablet_manager.cc:1403] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.011s
I20260709 12:24:45.497366  3321 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:45.497974  3321 ts_tablet_manager.cc:1403] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.008s
I20260709 12:24:45.500835  3321 raft_consensus.cc:359] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.501575  3321 raft_consensus.cc:385] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.501888  3321 raft_consensus.cc:740] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.503728  3201 raft_consensus.cc:2468] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:45.506158  3241 leader_election.cc:304] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:45.506927  3320 tablet_bootstrap.cc:654] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.507025  3321 consensus_queue.cc:260] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.509443  3321 ts_tablet_manager.cc:1434] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:24:45.510057  3322 raft_consensus.cc:359] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.511294  3428 raft_consensus.cc:2804] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.511933  3428 raft_consensus.cc:697] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:45.512297  3321 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:45.512800  3428 consensus_queue.cc:237] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.518044  3322 raft_consensus.cc:385] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.525401  3321 tablet_bootstrap.cc:654] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.520061  3322 raft_consensus.cc:740] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.528004  3322 consensus_queue.cc:260] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.530880  3322 ts_tablet_manager.cc:1434] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:24:45.536746  3324 tablet_bootstrap.cc:492] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:45.537380  3324 ts_tablet_manager.cc:1403] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.080s	user 0.021s	sys 0.003s
I20260709 12:24:45.544354  3391 raft_consensus.cc:493] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.544975  3391 raft_consensus.cc:515] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.545176  3324 raft_consensus.cc:359] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.545934  3324 raft_consensus.cc:385] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.546293  3324 raft_consensus.cc:740] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.547338  3391 leader_election.cc:290] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:45.549968  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:45.550441  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:45.550714  3274 raft_consensus.cc:2468] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:45.552448  3320 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:45.552974  3320 ts_tablet_manager.cc:1403] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.005s
I20260709 12:24:45.547047  3324 consensus_queue.cc:260] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.555588  3015 leader_election.cc:304] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
W20260709 12:24:45.556608  3015 leader_election.cc:343] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.557154  3324 ts_tablet_manager.cc:1434] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:24:45.557548  3391 raft_consensus.cc:2804] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.557984  3391 raft_consensus.cc:493] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.558230  3324 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:45.558315  3391 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.565475  3322 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:45.567888  3324 tablet_bootstrap.cc:654] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.565866  3321 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:45.568603  3321 ts_tablet_manager.cc:1403] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.007s
I20260709 12:24:45.568470  3391 raft_consensus.cc:515] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.570544  2945 catalog_manager.cc:5697] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.574281  2945 catalog_manager.cc:5697] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.576787  3321 raft_consensus.cc:359] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.577945  3321 raft_consensus.cc:385] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.578346  3321 raft_consensus.cc:740] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.579432  3321 consensus_queue.cc:260] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.581688  3322 tablet_bootstrap.cc:654] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.580874  3324 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:45.582973  3324 ts_tablet_manager.cc:1403] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 12:24:45.584064  3320 raft_consensus.cc:359] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.584781  3320 raft_consensus.cc:385] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.585067  3320 raft_consensus.cc:740] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.589740  3391 leader_election.cc:290] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:45.585668  3324 raft_consensus.cc:359] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.590694  3324 raft_consensus.cc:385] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.591037  3324 raft_consensus.cc:740] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.590823  3320 consensus_queue.cc:260] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.591692  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:45.591945  3321 ts_tablet_manager.cc:1434] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:24:45.592406  3274 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.593354  3321 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:45.592423  3324 consensus_queue.cc:260] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.600919  3324 ts_tablet_manager.cc:1434] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:24:45.605720  3047 raft_consensus.cc:3060] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.610162  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
W20260709 12:24:45.611665  3015 leader_election.cc:343] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.617688  3320 ts_tablet_manager.cc:1434] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.001s
I20260709 12:24:45.618944  3320 tablet_bootstrap.cc:492] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:45.621565  3324 tablet_bootstrap.cc:492] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:45.625489  3320 tablet_bootstrap.cc:654] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.628203  3428 consensus_queue.cc:1048] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.629411  3321 tablet_bootstrap.cc:654] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.629781  3274 raft_consensus.cc:2468] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:45.637966  3015 leader_election.cc:304] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:45.640393  3391 raft_consensus.cc:2804] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.636893  3324 tablet_bootstrap.cc:654] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.641222  3391 raft_consensus.cc:697] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:45.642554  3391 consensus_queue.cc:237] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.638947  3322 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:45.646181  3322 ts_tablet_manager.cc:1403] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.081s	user 0.030s	sys 0.018s
I20260709 12:24:45.647571  2946 catalog_manager.cc:5697] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.654896  3322 raft_consensus.cc:359] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.655737  3322 raft_consensus.cc:385] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.656020  3322 raft_consensus.cc:740] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.656728  3322 consensus_queue.cc:260] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:45.667912  3428 consensus_queue.cc:1048] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.669972  3501 raft_consensus.cc:493] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.670280  3427 raft_consensus.cc:493] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.670684  3501 raft_consensus.cc:515] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.670921  3427 raft_consensus.cc:515] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.676723  3324 tablet_bootstrap.cc:492] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:45.678182  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:45.679306  3322 ts_tablet_manager.cc:1434] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:24:45.679654  3324 ts_tablet_manager.cc:1403] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.058s	user 0.005s	sys 0.012s
I20260709 12:24:45.680083  3427 leader_election.cc:290] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:45.677439  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:45.680404  3322 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:45.681313  3501 leader_election.cc:290] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.684775  3165 leader_election.cc:304] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:45.685701  3324 raft_consensus.cc:359] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.686481  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:45.687103  3324 raft_consensus.cc:385] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.687330  3274 raft_consensus.cc:2468] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:45.687516  3324 raft_consensus.cc:740] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.688544  3324 consensus_queue.cc:260] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.689361  3090 leader_election.cc:304] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:45.689604  3430 raft_consensus.cc:2749] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.679450  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.691113  3324 ts_tablet_manager.cc:1434] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:24:45.678946  3321 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:45.691983  3321 ts_tablet_manager.cc:1403] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.099s	user 0.020s	sys 0.004s
I20260709 12:24:45.692555  3324 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:45.695598  3321 raft_consensus.cc:359] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.696296  3321 raft_consensus.cc:385] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.696718  3321 raft_consensus.cc:740] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.691068  3201 raft_consensus.cc:2468] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:45.699585  3321 consensus_queue.cc:260] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.700065  3320 tablet_bootstrap.cc:492] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:45.700778  3320 ts_tablet_manager.cc:1403] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.014s
I20260709 12:24:45.701082  3324 tablet_bootstrap.cc:654] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.700887  3501 raft_consensus.cc:2804] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.703166  3322 tablet_bootstrap.cc:654] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.707374  3320 raft_consensus.cc:359] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.708266  3320 raft_consensus.cc:385] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.708566  3320 raft_consensus.cc:740] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.709342  3320 consensus_queue.cc:260] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.711860  3320 ts_tablet_manager.cc:1434] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:24:45.712927  3320 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:45.718616  3321 ts_tablet_manager.cc:1434] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:24:45.719041  3320 tablet_bootstrap.cc:654] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.720505  3458 raft_consensus.cc:493] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.720655  3321 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:45.721091  3458 raft_consensus.cc:515] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.724148  3387 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.728680  3458 leader_election.cc:290] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.728839  3387 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.731202  3387 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.730897  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.732370  3198 raft_consensus.cc:2393] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:45.735255  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:45.735810  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:45.737425  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.737565  3015 leader_election.cc:304] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
W20260709 12:24:45.738011  3240 leader_election.cc:343] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:45.739173  3241 leader_election.cc:343] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.739662  3241 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:45.740063  3439 raft_consensus.cc:493] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.740869  3439 raft_consensus.cc:515] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.741638  3431 raft_consensus.cc:2749] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.744472  3439 leader_election.cc:290] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:45.747929  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:45.745399  3439 raft_consensus.cc:3060] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.750057  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.733456  2945 catalog_manager.cc:5697] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.701962  3501 raft_consensus.cc:493] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.761729  3501 raft_consensus.cc:3060] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:45.767115  3015 leader_election.cc:343] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:45.768402  3015 leader_election.cc:343] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.769018  3015 leader_election.cc:304] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:45.775416  3458 raft_consensus.cc:2749] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:45.777660  3340 raft_consensus.cc:493] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.778252  3340 raft_consensus.cc:515] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.780437  3340 leader_election.cc:290] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:45.785248  3324 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:45.785930  3324 ts_tablet_manager.cc:1403] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.000s
I20260709 12:24:45.790654  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:45.791266  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:45.791621  3047 raft_consensus.cc:2468] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:45.793087  3089 leader_election.cc:304] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:45.794118  3340 raft_consensus.cc:2804] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:45.794567  3340 raft_consensus.cc:493] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.794934  3340 raft_consensus.cc:3060] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.809482  3458 consensus_queue.cc:1048] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.817078  3391 consensus_queue.cc:1048] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:24:45.823248  3439 raft_consensus.cc:2749] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:45.823508  3090 leader_election.cc:343] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.827507  3320 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:45.828073  3320 ts_tablet_manager.cc:1403] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.014s
I20260709 12:24:45.829169  3322 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:45.829838  3322 ts_tablet_manager.cc:1403] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.150s	user 0.009s	sys 0.011s
I20260709 12:24:45.833386  3324 raft_consensus.cc:359] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.834141  3324 raft_consensus.cc:385] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.831610  3501 raft_consensus.cc:515] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.834460  3324 raft_consensus.cc:740] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.835319  3324 consensus_queue.cc:260] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.838502  3324 ts_tablet_manager.cc:1434] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:24:45.839563  3324 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:45.841403  3321 tablet_bootstrap.cc:654] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.843727  3343 consensus_queue.cc:1048] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.813719  3340 raft_consensus.cc:515] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.841459  3047 raft_consensus.cc:3060] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.847424  3320 raft_consensus.cc:359] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.850102  3427 raft_consensus.cc:493] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.851804  3501 leader_election.cc:290] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:45.853770  3320 raft_consensus.cc:385] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.853374  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:45.858489  3275 raft_consensus.cc:3060] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.858791  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:45.859797  3049 raft_consensus.cc:3060] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.860457  3322 raft_consensus.cc:359] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.861409  3322 raft_consensus.cc:385] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:45.854856  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:45.855145  3427 raft_consensus.cc:515] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.863147  3320 raft_consensus.cc:740] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.874992  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:45.876045  3050 raft_consensus.cc:2393] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:45.876112  3320 consensus_queue.cc:260] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.861730  3322 raft_consensus.cc:740] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:45.873194  3324 tablet_bootstrap.cc:654] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.896291  3322 consensus_queue.cc:260] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:45.897439  3320 ts_tablet_manager.cc:1434] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.002s
I20260709 12:24:45.863920  3340 leader_election.cc:290] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:45.863874  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:45.864256  3201 raft_consensus.cc:3060] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.870080  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:45.869138  3427 leader_election.cc:290] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:45.917374  3320 tablet_bootstrap.cc:492] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:45.904673  3387 raft_consensus.cc:493] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.920271  3322 ts_tablet_manager.cc:1434] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.002s
I20260709 12:24:45.922632  3322 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:45.910835  3198 raft_consensus.cc:3060] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.927824  3275 raft_consensus.cc:2468] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:45.931455  3122 raft_consensus.cc:2393] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:45.924309  3387 raft_consensus.cc:515] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:45.941661  3090 leader_election.cc:304] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:45.946662  3428 raft_consensus.cc:493] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.947252  3428 raft_consensus.cc:515] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.949328  3428 leader_election.cc:290] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:45.950973  3200 raft_consensus.cc:3060] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.953955  3501 raft_consensus.cc:2804] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:45.954532  3501 raft_consensus.cc:697] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:45.954746  3343 consensus_queue.cc:1048] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.955410  3501 consensus_queue.cc:237] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:45.960835  3201 raft_consensus.cc:2468] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:45.963202  3322 tablet_bootstrap.cc:654] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:45.964376  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:45.968158  3166 leader_election.cc:304] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
W20260709 12:24:45.968520  3241 leader_election.cc:343] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:45.969077  3387 leader_election.cc:290] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:45.969810  3427 raft_consensus.cc:3060] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:45.969730  3387 consensus_queue.cc:1048] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:45.990931  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.005728  3321 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:46.015395  3321 ts_tablet_manager.cc:1403] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.295s	user 0.042s	sys 0.034s
I20260709 12:24:46.014693  3320 tablet_bootstrap.cc:654] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.002717  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.013018  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:46.030045  3430 raft_consensus.cc:493] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.031940  3322 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:46.037724  3322 ts_tablet_manager.cc:1403] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.019s
I20260709 12:24:46.032140  3428 consensus_queue.cc:1048] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:24:46.055863  3198 raft_consensus.cc:2468] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
W20260709 12:24:46.038106  3241 leader_election.cc:343] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.059059  3241 leader_election.cc:304] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.039309  3430 raft_consensus.cc:515] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.061373  3431 raft_consensus.cc:2749] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.062299  3090 leader_election.cc:304] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:46.063122  3430 leader_election.cc:290] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.063679  3343 raft_consensus.cc:2804] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:46.064278  3343 raft_consensus.cc:697] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:46.065258  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:46.065160  3343 consensus_queue.cc:237] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.090335  3324 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:46.091419  3324 ts_tablet_manager.cc:1403] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.252s	user 0.020s	sys 0.014s
W20260709 12:24:46.072019  3241 leader_election.cc:343] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.072459  3439 raft_consensus.cc:493] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.099020  3391 raft_consensus.cc:493] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.105602  3427 raft_consensus.cc:2749] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.110678  3198 raft_consensus.cc:3060] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.103662  3340 consensus_queue.cc:1048] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:24:46.109921  3439 raft_consensus.cc:515] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.111169  3391 raft_consensus.cc:515] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.155509  3499 consensus_queue.cc:1048] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:46.156307  3343 raft_consensus.cc:493] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.156895  3343 raft_consensus.cc:515] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.157426  3399 raft_consensus.cc:493] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.157742  3322 raft_consensus.cc:359] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.162369  3322 raft_consensus.cc:385] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.162740  3322 raft_consensus.cc:740] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.157991  3399 raft_consensus.cc:515] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.160734  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:46.167917  3090 leader_election.cc:343] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:46.159679  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:46.168712  3321 raft_consensus.cc:359] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.169471  3322 consensus_queue.cc:260] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.169603  3321 raft_consensus.cc:385] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.173413  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:46.190310  3321 raft_consensus.cc:740] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.171871  3320 tablet_bootstrap.cc:492] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:46.161878  3343 leader_election.cc:290] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:46.192126  3320 ts_tablet_manager.cc:1403] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.275s	user 0.021s	sys 0.053s
I20260709 12:24:46.192829  3399 leader_election.cc:290] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:46.176942  3125 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.185259  3324 raft_consensus.cc:359] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.195168  3320 raft_consensus.cc:359] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.195704  3324 raft_consensus.cc:385] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.195971  3320 raft_consensus.cc:385] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.154181  3049 raft_consensus.cc:2468] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:46.196352  3320 raft_consensus.cc:740] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.197482  3324 raft_consensus.cc:740] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.198612  3324 consensus_queue.cc:260] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:46.199659  3089 leader_election.cc:343] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.201035  3320 consensus_queue.cc:260] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.201956  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:46.178777  3391 leader_election.cc:290] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.191470  3321 consensus_queue.cc:260] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.189103  3428 consensus_queue.cc:1048] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:24:46.205687  3320 ts_tablet_manager.cc:1434] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:24:46.205821  3321 ts_tablet_manager.cc:1434] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.190s	user 0.005s	sys 0.004s
I20260709 12:24:46.206552  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.206897  3320 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:46.207463  3195 raft_consensus.cc:2393] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:46.200344  3089 leader_election.cc:304] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.197314  3439 leader_election.cc:290] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:46.212365  3321 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:46.201229  3324 ts_tablet_manager.cc:1434] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.001s
I20260709 12:24:46.210829  3340 raft_consensus.cc:2749] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.219080  3324 tablet_bootstrap.cc:492] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:46.225070  3322 ts_tablet_manager.cc:1434] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.187s	user 0.014s	sys 0.009s
W20260709 12:24:46.238632  3240 leader_election.cc:343] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.239221  3240 leader_election.cc:304] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.239760  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:46.240760  3387 raft_consensus.cc:2749] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.241504  3560 consensus_queue.cc:1048] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:24:46.247314  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.241683  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.241788  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.271135  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.272118  3271 raft_consensus.cc:2393] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:46.273358  3015 leader_election.cc:304] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.274785  3547 raft_consensus.cc:3060] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.276641  3321 tablet_bootstrap.cc:654] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.264248  3439 consensus_queue.cc:1048] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:24:46.279153  3322 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:46.282716  3015 leader_election.cc:304] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:46.285740  3324 tablet_bootstrap.cc:654] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.284356  2945 catalog_manager.cc:5697] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.287005  3439 raft_consensus.cc:2749] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:46.293713  3166 leader_election.cc:304] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:46.294255  3320 tablet_bootstrap.cc:654] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.294842  3090 leader_election.cc:304] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:46.296030  3399 consensus_queue.cc:1048] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.312479  3554 raft_consensus.cc:2749] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:46.322633  3565 log.cc:927] Time spent T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a: Append to log took a long time: real 0.102s	user 0.005s	sys 0.000s
I20260709 12:24:46.331367  3340 raft_consensus.cc:2749] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.336258  3391 consensus_queue.cc:1048] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.350219  3547 raft_consensus.cc:2749] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.352629  3322 tablet_bootstrap.cc:654] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.379837  3387 consensus_queue.cc:1048] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.384817  3320 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:46.385470  3320 ts_tablet_manager.cc:1403] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.006s
I20260709 12:24:46.386268  3322 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:46.387002  3322 ts_tablet_manager.cc:1403] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.009s
I20260709 12:24:46.396088  3322 raft_consensus.cc:359] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.396988  3322 raft_consensus.cc:385] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.397293  3322 raft_consensus.cc:740] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.398131  3322 consensus_queue.cc:260] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.400202  3322 ts_tablet_manager.cc:1434] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:24:46.401022  3322 tablet_bootstrap.cc:492] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:46.406862  3321 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:46.415009  3321 ts_tablet_manager.cc:1403] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.005s
I20260709 12:24:46.418000  3340 raft_consensus.cc:493] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.425956  3340 raft_consensus.cc:515] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.428485  3340 leader_election.cc:290] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:46.433486  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:46.431988  3320 raft_consensus.cc:359] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.436154  3320 raft_consensus.cc:385] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.436748  3320 raft_consensus.cc:740] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
W20260709 12:24:46.435501  3089 leader_election.cc:343] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.437736  3320 consensus_queue.cc:260] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.441527  3320 ts_tablet_manager.cc:1434] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.001s
I20260709 12:24:46.443101  3320 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:46.453073  3320 tablet_bootstrap.cc:654] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.457232  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.459663  3324 tablet_bootstrap.cc:492] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:46.460561  3324 ts_tablet_manager.cc:1403] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.242s	user 0.027s	sys 0.025s
I20260709 12:24:46.464699  3324 raft_consensus.cc:359] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.468889  3324 raft_consensus.cc:385] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:46.468618  3090 leader_election.cc:343] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.469537  3324 raft_consensus.cc:740] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.470649  3090 leader_election.cc:304] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:46.473165  3324 consensus_queue.cc:260] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.472386  3501 raft_consensus.cc:2749] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.475767  3324 ts_tablet_manager.cc:1434] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:24:46.480856  3321 raft_consensus.cc:359] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.481647  3321 raft_consensus.cc:385] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.481958  3321 raft_consensus.cc:740] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.482659  3321 consensus_queue.cc:260] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.484843  3321 ts_tablet_manager.cc:1434] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.001s
I20260709 12:24:46.480855  3324 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:46.489951  3321 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:46.495828  3322 tablet_bootstrap.cc:654] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.497241  3321 tablet_bootstrap.cc:654] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.523893  3324 tablet_bootstrap.cc:654] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.526750  3320 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:46.527612  3320 ts_tablet_manager.cc:1403] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.008s
I20260709 12:24:46.531980  3320 raft_consensus.cc:359] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.532941  3320 raft_consensus.cc:385] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.533365  3320 raft_consensus.cc:740] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.536069  3557 raft_consensus.cc:493] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.541184  3340 consensus_queue.cc:1048] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.543846  3557 raft_consensus.cc:515] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.545976  3399 consensus_queue.cc:1048] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:46.548928  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.549983  3276 raft_consensus.cc:2468] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:46.552016  3166 leader_election.cc:304] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:46.553476  3554 raft_consensus.cc:2804] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:46.553893  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:46.554751  3557 leader_election.cc:290] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.554136  3554 raft_consensus.cc:493] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.558825  3320 consensus_queue.cc:260] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:46.559747  3166 leader_election.cc:343] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.561950  3320 ts_tablet_manager.cc:1434] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:24:46.562891  3322 tablet_bootstrap.cc:492] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:46.562932  3340 raft_consensus.cc:493] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.563687  3322 ts_tablet_manager.cc:1403] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.163s	user 0.039s	sys 0.006s
I20260709 12:24:46.563820  3340 raft_consensus.cc:515] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.558111  3554 raft_consensus.cc:3060] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.566972  3322 raft_consensus.cc:359] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.567797  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:46.573297  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.574129  3049 raft_consensus.cc:2468] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:46.576210  3089 leader_election.cc:304] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:46.569470  3340 leader_election.cc:290] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:46.574307  3200 raft_consensus.cc:2468] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:46.570725  3320 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:46.577483  3502 raft_consensus.cc:2804] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:46.577874  3322 raft_consensus.cc:385] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.578070  3502 raft_consensus.cc:493] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.578269  3322 raft_consensus.cc:740] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.578570  3502 raft_consensus.cc:3060] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.584852  3322 consensus_queue.cc:260] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.587077  3501 consensus_queue.cc:1048] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:46.577215  3399 consensus_queue.cc:1048] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:24:46.601107  3322 ts_tablet_manager.cc:1434] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:24:46.592450  2948 catalog_manager.cc:5697] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.603036  3322 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:46.602687  3340 raft_consensus.cc:493] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.594808  3557 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.608692  3557 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.611306  3557 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:46.614204  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.615093  3271 raft_consensus.cc:2468] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:46.616986  3439 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.617856  3439 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.627828  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:46.647507  3321 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:46.639483  3166 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:46.648200  3321 ts_tablet_manager.cc:1403] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.000s
I20260709 12:24:46.648260  3502 raft_consensus.cc:515] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.621800  3340 raft_consensus.cc:515] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.653328  3324 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:46.653983  3324 ts_tablet_manager.cc:1403] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.011s
I20260709 12:24:46.649189  3049 raft_consensus.cc:2468] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:46.661332  3320 tablet_bootstrap.cc:654] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.663168  3439 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.648890  3557 raft_consensus.cc:2804] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:46.664184  3557 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.664330  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.664783  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.664630  3557 raft_consensus.cc:3060] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.667924  3321 raft_consensus.cc:359] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.669442  3321 raft_consensus.cc:385] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.669787  3321 raft_consensus.cc:740] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.670375  3271 raft_consensus.cc:2468] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:46.672043  3015 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:46.673549  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.674345  3271 raft_consensus.cc:2468] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:46.674387  3439 raft_consensus.cc:2804] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:46.675129  3439 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.675984  3090 leader_election.cc:304] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:46.679330  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.680195  3399 raft_consensus.cc:2804] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:46.680682  3399 raft_consensus.cc:493] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.681068  3399 raft_consensus.cc:3060] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.625946  3554 raft_consensus.cc:515] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.672331  3340 leader_election.cc:290] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.683789  3321 consensus_queue.cc:260] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.686499  3324 raft_consensus.cc:359] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.687456  3324 raft_consensus.cc:385] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.687738  3324 raft_consensus.cc:740] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.688715  3324 consensus_queue.cc:260] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.691752  3321 ts_tablet_manager.cc:1434] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:24:46.697012  3324 ts_tablet_manager.cc:1434] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:24:46.685089  3439 raft_consensus.cc:3060] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.688823  3343 raft_consensus.cc:493] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.703606  3198 raft_consensus.cc:2393] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:46.709295  3554 leader_election.cc:290] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.712518  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:46.737238  3271 raft_consensus.cc:3060] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.736897  3343 raft_consensus.cc:515] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.739281  3343 leader_election.cc:290] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:46.713373  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:46.718324  3561 raft_consensus.cc:493] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.741820  3561 raft_consensus.cc:515] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.744158  3561 leader_election.cc:290] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:46.727072  3322 tablet_bootstrap.cc:654] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.746485  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed34225837124e1b8ac0a237db1f0ead" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:46.748153  3089 leader_election.cc:343] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.749853  3399 raft_consensus.cc:515] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.750892  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:46.751549  3049 raft_consensus.cc:3060] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.751140  3125 raft_consensus.cc:2393] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:46.740597  3324 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:46.745800  3502 leader_election.cc:290] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:46.772037  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:46.773233  3320 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:46.773809  3320 ts_tablet_manager.cc:1403] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.203s	user 0.039s	sys 0.031s
W20260709 12:24:46.776530  3240 leader_election.cc:343] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.776669  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:46.776875  3320 raft_consensus.cc:359] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.777544  3320 raft_consensus.cc:385] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.777892  3320 raft_consensus.cc:740] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.778678  3320 consensus_queue.cc:260] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:46.780489  3241 leader_election.cc:343] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.781011  3241 leader_election.cc:304] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:46.782675  3387 raft_consensus.cc:2749] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.783847  3049 raft_consensus.cc:2468] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:24:46.784605  3321 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:46.791190  3089 leader_election.cc:304] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:46.792204  3340 raft_consensus.cc:2804] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:46.792953  3340 raft_consensus.cc:697] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:46.793510  3391 raft_consensus.cc:493] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.793912  3340 consensus_queue.cc:237] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.794130  3391 raft_consensus.cc:515] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.795789  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed34225837124e1b8ac0a237db1f0ead" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.796386  3391 leader_election.cc:290] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.796559  3196 raft_consensus.cc:2468] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:46.753598  3271 raft_consensus.cc:2468] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:46.797927  3321 tablet_bootstrap.cc:654] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.798695  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaeb83845184eabb73c7ed4590fa307" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:46.799345  3197 raft_consensus.cc:3060] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.805490  3320 ts_tablet_manager.cc:1434] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:24:46.807133  3320 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:46.811458  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.806864  3391 raft_consensus.cc:493] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.812891  3561 raft_consensus.cc:493] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.813352  3391 raft_consensus.cc:515] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.813476  3561 raft_consensus.cc:515] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:46.815245  3015 leader_election.cc:343] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.815541  3391 leader_election.cc:290] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:46.815783  3561 leader_election.cc:290] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:46.828483  3320 tablet_bootstrap.cc:654] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.828764  3166 leader_election.cc:304] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:46.829718  3554 raft_consensus.cc:2804] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:46.830248  3554 raft_consensus.cc:697] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:46.831012  3554 consensus_queue.cc:237] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:46.841259  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.846648  3399 leader_election.cc:290] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.847687  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:46.848711  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:46.849524  3125 raft_consensus.cc:2468] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
W20260709 12:24:46.855244  3241 leader_election.cc:343] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.855486  3015 leader_election.cc:304] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:46.856597  3391 raft_consensus.cc:2804] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:46.857115  3391 raft_consensus.cc:493] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.857601  3391 raft_consensus.cc:3060] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.858296  3324 tablet_bootstrap.cc:654] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.865181  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:46.867460  3240 leader_election.cc:343] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.868014  3240 leader_election.cc:304] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.869626  3439 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:46.870157  3015 leader_election.cc:343] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.872807  3561 raft_consensus.cc:2749] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.873507  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:46.882601  2946 catalog_manager.cc:5697] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 2, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 2 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.891222  3439 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.893116  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:46.894105  3276 raft_consensus.cc:3060] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.889568  3090 leader_election.cc:304] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:46.898087  3589 raft_consensus.cc:2804] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:46.898514  3589 raft_consensus.cc:493] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.887588  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:46.898928  3589 raft_consensus.cc:3060] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.899326  3271 raft_consensus.cc:2468] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:46.900660  3015 leader_election.cc:304] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.902374  3322 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:46.902968  3322 ts_tablet_manager.cc:1403] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.300s	user 0.020s	sys 0.027s
I20260709 12:24:46.904256  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:46.909258  2948 catalog_manager.cc:5697] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.915339  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c54168825dc646d982d2ba4557205159" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:46.916244  3271 raft_consensus.cc:2393] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:46.922355  3324 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:46.922930  3324 ts_tablet_manager.cc:1403] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.183s	user 0.018s	sys 0.010s
I20260709 12:24:46.918239  3322 raft_consensus.cc:359] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.924376  3322 raft_consensus.cc:385] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.924635  3322 raft_consensus.cc:740] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.927052  3322 consensus_queue.cc:260] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.905220  3391 raft_consensus.cc:515] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.906721  3547 raft_consensus.cc:2804] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:46.925671  3197 raft_consensus.cc:2468] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:24:46.902316  3557 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.931905  3547 raft_consensus.cc:493] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.940459  3547 raft_consensus.cc:3060] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.940656  3090 leader_election.cc:304] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.941982  3399 raft_consensus.cc:2749] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:46.945523  3322 ts_tablet_manager.cc:1434] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 12:24:46.946447  3322 tablet_bootstrap.cc:492] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:46.952633  3322 tablet_bootstrap.cc:654] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:46.958770  3589 raft_consensus.cc:515] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.965791  3200 raft_consensus.cc:2393] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:46.965226  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed34225837124e1b8ac0a237db1f0ead" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:46.969702  3589 leader_election.cc:290] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:46.970899  3276 raft_consensus.cc:2468] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:46.971632  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed34225837124e1b8ac0a237db1f0ead" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:46.972393  3015 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:46.972435  3200 raft_consensus.cc:3060] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.973503  3321 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
W20260709 12:24:46.973731  3089 leader_election.cc:343] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:46.973920  3439 raft_consensus.cc:2804] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:46.974089  3321 ts_tablet_manager.cc:1403] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.190s	user 0.027s	sys 0.014s
I20260709 12:24:46.974514  3439 raft_consensus.cc:697] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:46.975706  3391 leader_election.cc:290] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:46.975973  3439 consensus_queue.cc:237] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.977062  3321 raft_consensus.cc:359] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.977789  3321 raft_consensus.cc:385] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.978066  3321 raft_consensus.cc:740] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.978204  3557 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:46.978732  3321 consensus_queue.cc:260] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.979372  3320 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:46.979874  3320 ts_tablet_manager.cc:1403] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.173s	user 0.025s	sys 0.041s
I20260709 12:24:46.980611  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:46.980963  3321 ts_tablet_manager.cc:1434] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:46.974493  3324 raft_consensus.cc:359] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.981788  3324 raft_consensus.cc:385] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.982087  3324 raft_consensus.cc:740] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.982189  3321 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:46.983711  3547 raft_consensus.cc:515] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:46.985898  3547 leader_election.cc:290] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:46.991787  3320 raft_consensus.cc:359] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.992627  3320 raft_consensus.cc:385] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:46.992247  3324 consensus_queue.cc:260] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:46.992950  3320 raft_consensus.cc:740] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:46.993656  3320 consensus_queue.cc:260] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:46.995484  3320 ts_tablet_manager.cc:1434] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:24:46.996424  3320 tablet_bootstrap.cc:492] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:46.997079  3324 ts_tablet_manager.cc:1434] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:24:46.998006  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:46.998869  3125 raft_consensus.cc:3060] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:46.999631  3324 tablet_bootstrap.cc:492] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:46.991770  3321 tablet_bootstrap.cc:654] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.011613  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:47.016703  3320 tablet_bootstrap.cc:654] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.017041  3271 raft_consensus.cc:3060] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.011962  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:47.022710  3197 raft_consensus.cc:3060] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.027100  3324 tablet_bootstrap.cc:654] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.029001  3320 tablet_bootstrap.cc:492] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:47.029798  3320 ts_tablet_manager.cc:1403] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.010s
I20260709 12:24:47.033869  3320 raft_consensus.cc:359] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.034785  3320 raft_consensus.cc:385] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.035166  3320 raft_consensus.cc:740] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.036525  3320 consensus_queue.cc:260] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.039115  3320 ts_tablet_manager.cc:1434] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:24:47.042596  3320 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:47.051155  3320 tablet_bootstrap.cc:654] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.057024  3547 raft_consensus.cc:493] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.992264  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:47.057916  3547 raft_consensus.cc:515] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.058880  3276 raft_consensus.cc:2393] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:47.060465  3166 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:47.062206  3557 raft_consensus.cc:2749] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.063015  3320 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:47.063582  3320 ts_tablet_manager.cc:1403] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 12:24:47.065657  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.066404  3124 raft_consensus.cc:2468] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:47.066612  3320 raft_consensus.cc:359] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.067340  3320 raft_consensus.cc:385] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.067618  3320 raft_consensus.cc:740] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.067801  3015 leader_election.cc:304] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:47.068354  3320 consensus_queue.cc:260] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.068847  3391 raft_consensus.cc:2804] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.069269  3391 raft_consensus.cc:493] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.069301  3271 raft_consensus.cc:2468] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:47.070528  3320 ts_tablet_manager.cc:1434] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:47.069715  3391 raft_consensus.cc:3060] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.071120  3015 leader_election.cc:304] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:47.072110  3320 tablet_bootstrap.cc:492] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:47.072436  3548 raft_consensus.cc:2804] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.078102  3547 leader_election.cc:290] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:47.015631  3321 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:47.080577  3321 ts_tablet_manager.cc:1403] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.000s
I20260709 12:24:47.080936  3125 raft_consensus.cc:2468] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:47.011613  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:47.083818  3197 raft_consensus.cc:2468] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:47.083523  3321 raft_consensus.cc:359] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.085311  3321 raft_consensus.cc:385] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.085582  3321 raft_consensus.cc:740] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.086601  3321 consensus_queue.cc:260] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.088100  3320 tablet_bootstrap.cc:654] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.088670  3321 ts_tablet_manager.cc:1434] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:24:47.088595  3200 raft_consensus.cc:2468] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:47.089989  3090 leader_election.cc:304] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:47.091367  3589 raft_consensus.cc:2804] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.092044  3589 raft_consensus.cc:697] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:47.083523  3015 leader_election.cc:304] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:47.094544  3391 raft_consensus.cc:515] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.092970  3589 consensus_queue.cc:237] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.095434  3547 raft_consensus.cc:2804] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:24:47.095925  3015 leader_election.cc:343] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.096797  3391 leader_election.cc:290] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:47.096716  3547 raft_consensus.cc:697] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:47.100369  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:47.101297  3547 consensus_queue.cc:237] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.101305  3271 raft_consensus.cc:3060] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.101861  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:47.106153  3125 raft_consensus.cc:3060] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.106276  3321 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:47.110306  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:47.014189  3322 tablet_bootstrap.cc:492] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:47.127159  3320 tablet_bootstrap.cc:492] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:47.127341  3548 raft_consensus.cc:697] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:47.127749  3320 ts_tablet_manager.cc:1403] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.007s
I20260709 12:24:47.129092  3321 tablet_bootstrap.cc:654] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.129959  3322 ts_tablet_manager.cc:1403] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.184s	user 0.002s	sys 0.019s
I20260709 12:24:47.130834  3320 raft_consensus.cc:359] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.131490  3559 raft_consensus.cc:493] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.132045  3559 raft_consensus.cc:515] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.135478  3559 leader_election.cc:290] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:47.131029  3548 consensus_queue.cc:237] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.131633  3320 raft_consensus.cc:385] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.135972  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:47.136246  3320 raft_consensus.cc:740] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.136574  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.136754  3559 raft_consensus.cc:493] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.137177  3320 consensus_queue.cc:260] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
W20260709 12:24:47.137508  3240 leader_election.cc:343] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.137416  3559 raft_consensus.cc:515] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:47.138258  3241 leader_election.cc:343] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.138742  3241 leader_election.cc:304] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:47.139266  3320 ts_tablet_manager.cc:1434] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:24:47.139950  3561 raft_consensus.cc:2749] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.141000  3320 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:47.141448  3559 leader_election.cc:290] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:47.142270  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:47.143115  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.143466  3047 raft_consensus.cc:2468] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:47.143817  3124 raft_consensus.cc:2468] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:47.144713  3240 leader_election.cc:304] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:47.145745  3559 raft_consensus.cc:2804] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.146205  3559 raft_consensus.cc:493] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.146564  3559 raft_consensus.cc:3060] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.147655  3320 tablet_bootstrap.cc:654] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.145367  3322 raft_consensus.cc:359] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.148802  3322 raft_consensus.cc:385] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.149138  3322 raft_consensus.cc:740] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.149923  3322 consensus_queue.cc:260] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.157305  3322 ts_tablet_manager.cc:1434] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:24:47.159257  3322 tablet_bootstrap.cc:492] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:47.192023  3322 tablet_bootstrap.cc:654] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.193114  2945 catalog_manager.cc:5697] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.208554  3561 raft_consensus.cc:493] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.209190  3561 raft_consensus.cc:515] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.211458  3561 leader_election.cc:290] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:47.213925  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.215711  3125 raft_consensus.cc:2468] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:47.175942  3271 raft_consensus.cc:2468] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:47.219379  3015 leader_election.cc:304] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:47.220257  3439 raft_consensus.cc:2804] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.220944  3439 raft_consensus.cc:697] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
W20260709 12:24:47.221575  3241 leader_election.cc:343] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.222121  3439 consensus_queue.cc:237] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.228709  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:47.230976  3324 tablet_bootstrap.cc:492] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:47.231483  3324 ts_tablet_manager.cc:1403] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.232s	user 0.030s	sys 0.046s
I20260709 12:24:47.236632  3324 raft_consensus.cc:359] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
W20260709 12:24:47.237931  3241 leader_election.cc:343] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.237377  3324 raft_consensus.cc:385] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.238433  3241 leader_election.cc:304] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:47.237198  3559 raft_consensus.cc:515] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.240108  3560 raft_consensus.cc:2749] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.244028  3321 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:47.244693  3321 ts_tablet_manager.cc:1403] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.034s
I20260709 12:24:47.245502  2945 catalog_manager.cc:5697] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.247699  3554 consensus_queue.cc:1048] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.248638  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:47.249307  3123 raft_consensus.cc:3060] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.239166  3324 raft_consensus.cc:740] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.257335  3320 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:47.257998  3320 ts_tablet_manager.cc:1403] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.016s
I20260709 12:24:47.250001  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:47.260502  3047 raft_consensus.cc:3060] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.261641  3320 raft_consensus.cc:359] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.262578  3320 raft_consensus.cc:385] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.262849  3320 raft_consensus.cc:740] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.248363  3559 leader_election.cc:290] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:47.261111  3324 consensus_queue.cc:260] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.263633  3320 consensus_queue.cc:260] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.266316  3324 ts_tablet_manager.cc:1434] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 12:24:47.268090  3324 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:47.247574  3321 raft_consensus.cc:359] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.268710  3321 raft_consensus.cc:385] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.269001  3321 raft_consensus.cc:740] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.269637  3321 consensus_queue.cc:260] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.272264  3321 ts_tablet_manager.cc:1434] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:24:47.275871  3123 raft_consensus.cc:2468] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:47.279009  3320 ts_tablet_manager.cc:1434] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:24:47.280680  3320 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:47.287267  3554 consensus_queue.cc:1048] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.273648  3321 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:47.291229  3548 raft_consensus.cc:493] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.291900  3548 raft_consensus.cc:515] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.292661  3559 raft_consensus.cc:493] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.293290  3559 raft_consensus.cc:515] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:47.294508  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:47.295707  3559 leader_election.cc:290] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:47.297542  3548 leader_election.cc:290] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:47.299222  3241 leader_election.cc:304] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:47.299388  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.299615  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:47.300738  3015 leader_election.cc:343] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.301302  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:47.302428  3015 leader_election.cc:343] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.302666  3560 raft_consensus.cc:2804] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:47.303113  3321 tablet_bootstrap.cc:654] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.302942  3015 leader_election.cc:304] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:47.304764  3320 tablet_bootstrap.cc:654] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:47.305531  3240 leader_election.cc:343] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.307772  3548 raft_consensus.cc:2749] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.310299  3560 raft_consensus.cc:697] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:47.311389  3560 consensus_queue.cc:237] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.339175  3049 raft_consensus.cc:1275] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:47.343118  3399 consensus_queue.cc:1048] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.347600  3548 raft_consensus.cc:493] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.348416  3548 raft_consensus.cc:515] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.350602  3324 tablet_bootstrap.cc:654] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.351611  3322 tablet_bootstrap.cc:492] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:47.351696  3554 raft_consensus.cc:493] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.352288  3322 ts_tablet_manager.cc:1403] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.194s	user 0.016s	sys 0.003s
I20260709 12:24:47.352440  3554 raft_consensus.cc:515] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.355314  3322 raft_consensus.cc:359] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.356014  3322 raft_consensus.cc:385] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.356338  3322 raft_consensus.cc:740] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.357823  3322 consensus_queue.cc:260] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.354837  3554 leader_election.cc:290] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:47.357537  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed34225837124e1b8ac0a237db1f0ead" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.374637  3322 ts_tablet_manager.cc:1434] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:24:47.357597  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:47.379083  3322 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:47.364316  3548 leader_election.cc:290] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:47.392649  3324 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:47.393347  3324 ts_tablet_manager.cc:1403] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.000s
I20260709 12:24:47.377884  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.386116  3276 raft_consensus.cc:2468] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:47.396613  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed34225837124e1b8ac0a237db1f0ead" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:47.410792  3197 raft_consensus.cc:2393] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:47.400727  3125 raft_consensus.cc:2468] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:47.415961  3166 leader_election.cc:304] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:47.417390  3554 raft_consensus.cc:2804] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.417852  3554 raft_consensus.cc:493] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.418213  3554 raft_consensus.cc:3060] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.410015  3321 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:47.423913  3321 ts_tablet_manager.cc:1403] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.151s	user 0.023s	sys 0.016s
I20260709 12:24:47.427178  3324 raft_consensus.cc:359] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.428308  3324 raft_consensus.cc:385] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.432705  3320 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:47.433390  3320 ts_tablet_manager.cc:1403] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.006s
I20260709 12:24:47.443135  3197 raft_consensus.cc:1275] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:47.432758  3015 leader_election.cc:304] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:47.444521  3047 raft_consensus.cc:2468] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:47.445176  3602 raft_consensus.cc:3060] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.448805  3502 consensus_queue.cc:1048] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.454473  3322 tablet_bootstrap.cc:654] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.408064  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.428601  3324 raft_consensus.cc:740] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.456903  3324 consensus_queue.cc:260] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.472980  3324 ts_tablet_manager.cc:1434] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 12:24:47.474431  3324 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:47.490978  3391 consensus_queue.cc:1048] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.488569  3320 raft_consensus.cc:359] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.493441  3320 raft_consensus.cc:385] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.493724  3320 raft_consensus.cc:740] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.495685  3321 raft_consensus.cc:359] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.496868  3321 raft_consensus.cc:385] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.497354  3321 raft_consensus.cc:740] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.496524  3320 consensus_queue.cc:260] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.506574  3321 consensus_queue.cc:260] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.508112  3614 raft_consensus.cc:493] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.506132  2945 catalog_manager.cc:5697] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.515823  2945 catalog_manager.cc:5697] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.520612  3320 ts_tablet_manager.cc:1434] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.001s
I20260709 12:24:47.519465  2945 catalog_manager.cc:5697] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:47.525362  3321 ts_tablet_manager.cc:1434] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.002s
I20260709 12:24:47.528469  3321 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:47.526084  3340 raft_consensus.cc:493] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.528537  3241 leader_election.cc:343] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.529445  3612 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.522207  3614 raft_consensus.cc:515] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.546311  3614 leader_election.cc:290] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:47.547191  3241 leader_election.cc:304] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:47.550273  3560 raft_consensus.cc:2749] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.550977  3612 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.552277  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.553386  3612 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:47.556131  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:47.559201  3324 tablet_bootstrap.cc:654] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.540640  3340 raft_consensus.cc:515] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.567739  3320 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:47.575340  3322 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:47.577390  3322 ts_tablet_manager.cc:1403] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.199s	user 0.019s	sys 0.001s
I20260709 12:24:47.584370  3627 consensus_queue.cc:1048] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:47.596093  3322 raft_consensus.cc:359] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.597021  3322 raft_consensus.cc:385] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.597312  3322 raft_consensus.cc:740] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.557224  3554 raft_consensus.cc:515] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.600797  3320 tablet_bootstrap.cc:654] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.598713  3322 consensus_queue.cc:260] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
W20260709 12:24:47.606155  3241 leader_election.cc:343] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.610387  3125 raft_consensus.cc:2468] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:47.614729  3602 raft_consensus.cc:2749] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.620095  2947 catalog_manager.cc:5697] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.669988  3554 leader_election.cc:290] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:47.671546  3340 leader_election.cc:290] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:47.675060  3322 ts_tablet_manager.cc:1434] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.001s
I20260709 12:24:47.675984  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:47.680564  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:47.684003  3321 tablet_bootstrap.cc:654] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.687342  3241 leader_election.cc:304] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:47.693157  3626 raft_consensus.cc:2804] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.696808  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:47.697376  3626 raft_consensus.cc:493] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.697867  3626 raft_consensus.cc:3060] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.694778  3125 raft_consensus.cc:3060] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.706171  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:47.708407  3275 raft_consensus.cc:3060] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.723186  3324 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:47.711189  3502 raft_consensus.cc:493] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.723816  3324 ts_tablet_manager.cc:1403] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.250s	user 0.016s	sys 0.008s
I20260709 12:24:47.723969  3502 raft_consensus.cc:515] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:47.726215  3627 consensus_queue.cc:1048] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:47.730957  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:47.731594  3241 leader_election.cc:343] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.726593  3502 leader_election.cc:290] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:47.740734  3502 consensus_queue.cc:1048] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:47.742926  3320 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:47.743546  3320 ts_tablet_manager.cc:1403] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.177s	user 0.020s	sys 0.009s
I20260709 12:24:47.745450  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:47.746142  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:47.748114  3612 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.748648  3612 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.749648  3322 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:47.751196  3627 consensus_queue.cc:1048] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:47.751441  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:47.746210  3047 raft_consensus.cc:2468] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:47.752853  3612 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:47.756315  3275 raft_consensus.cc:2468] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
W20260709 12:24:47.756721  3240 leader_election.cc:343] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.757510  3320 raft_consensus.cc:359] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.765785  3320 raft_consensus.cc:385] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.766120  3320 raft_consensus.cc:740] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.762077  3322 tablet_bootstrap.cc:654] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.767495  3240 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:47.773746  3324 raft_consensus.cc:359] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.776036  3324 raft_consensus.cc:385] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.776439  3324 raft_consensus.cc:740] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.780382  3324 consensus_queue.cc:260] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.771854  3626 raft_consensus.cc:515] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.783776  3273 raft_consensus.cc:2393] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:47.778424  3614 consensus_queue.cc:1048] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:24:47.785192  3626 leader_election.cc:290] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:47.778921  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:47.788271  3320 consensus_queue.cc:260] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.772265  3612 raft_consensus.cc:2749] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.790586  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:47.796772  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:47.797817  3166 leader_election.cc:304] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:47.801134  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:47.807626  3320 ts_tablet_manager.cc:1434] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.001s
I20260709 12:24:47.811398  3320 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:47.814327  3324 ts_tablet_manager.cc:1434] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 12:24:47.768464  3125 raft_consensus.cc:2468] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:47.816514  3324 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:47.820748  3321 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:47.821488  3321 ts_tablet_manager.cc:1403] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.293s	user 0.018s	sys 0.016s
I20260709 12:24:47.816926  3123 raft_consensus.cc:3060] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:47.824954  3241 leader_election.cc:343] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.826418  3557 raft_consensus.cc:2804] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:24:47.834643  3241 leader_election.cc:343] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.830515  3557 raft_consensus.cc:697] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:47.842572  3321 raft_consensus.cc:359] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.842999  3089 leader_election.cc:304] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:47.843360  3321 raft_consensus.cc:385] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.843932  3321 raft_consensus.cc:740] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.845628  3399 raft_consensus.cc:2804] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:47.846115  3399 raft_consensus.cc:493] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.844674  3321 consensus_queue.cc:260] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:47.846453  3399 raft_consensus.cc:3060] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.847868  3321 ts_tablet_manager.cc:1434] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:24:47.848872  3321 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:47.842900  3557 consensus_queue.cc:237] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:47.856952  3322 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:47.857808  3322 ts_tablet_manager.cc:1403] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.006s
W20260709 12:24:47.860268  3090 leader_election.cc:343] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.865115  3430 raft_consensus.cc:493] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.869813  3430 raft_consensus.cc:515] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:47.870039  3090 leader_election.cc:343] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.872237  3090 leader_election.cc:304] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:47.849843  3589 consensus_queue.cc:1048] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:24:47.879364  3240 leader_election.cc:343] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:47.879031  3322 raft_consensus.cc:359] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.880313  3322 raft_consensus.cc:385] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:47.882697  3322 raft_consensus.cc:740] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:47.883489  3322 consensus_queue.cc:260] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.879835  3240 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:47.891084  3626 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.929955  3198 raft_consensus.cc:3060] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:47.942138  3123 raft_consensus.cc:2468] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:47.952183  3628 raft_consensus.cc:2749] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:47.953382  3320 tablet_bootstrap.cc:654] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:47.944754  3627 raft_consensus.cc:493] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.967528  3627 raft_consensus.cc:515] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:47.973239  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:47.973667  3626 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.974300  3626 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:48.021010  3324 tablet_bootstrap.cc:654] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.036386  3321 tablet_bootstrap.cc:654] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.027307  3272 raft_consensus.cc:2468] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
W20260709 12:24:48.027376  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 113143us
W20260709 12:24:48.027308  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 62397.7us
I20260709 12:24:48.075495  3322 ts_tablet_manager.cc:1434] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.217s	user 0.021s	sys 0.030s
I20260709 12:24:48.077080  3322 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:48.085203  3627 leader_election.cc:290] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:48.085500  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:48.086330  3270 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:48.081365  3391 consensus_queue.cc:1048] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:24:48.097093  3241 leader_election.cc:304] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:48.107977  3559 raft_consensus.cc:2804] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:48.111304  3626 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:48.092020  3399 raft_consensus.cc:515] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.123449  3391 raft_consensus.cc:493] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.124255  3391 raft_consensus.cc:515] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:48.124939  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:48.127384  3399 leader_election.cc:290] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:48.130918  3391 leader_election.cc:290] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
W20260709 12:24:48.095053  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 49972.9us
I20260709 12:24:48.143980  3015 leader_election.cc:304] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:48.144868  3166 leader_election.cc:304] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:48.145744  3548 raft_consensus.cc:2804] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:48.146318  3548 raft_consensus.cc:493] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.146409  3391 consensus_queue.cc:1048] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:48.146895  3548 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.147487  3320 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:48.148047  3320 ts_tablet_manager.cc:1403] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.337s	user 0.016s	sys 0.021s
I20260709 12:24:48.135842  3559 raft_consensus.cc:697] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:48.156385  3559 consensus_queue.cc:237] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.145876  3557 raft_consensus.cc:2804] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:24:48.160600  3241 leader_election.cc:343] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.163478  3560 consensus_queue.cc:1048] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.161856  3557 raft_consensus.cc:493] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.169162  3557 raft_consensus.cc:3060] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.172132  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:48.178349  3557 raft_consensus.cc:515] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:48.178663  3430 leader_election.cc:290] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:48.178988  3320 raft_consensus.cc:359] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.180449  3320 raft_consensus.cc:385] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.180817  3320 raft_consensus.cc:740] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.181558  3320 consensus_queue.cc:260] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.182299  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:48.183280  3049 raft_consensus.cc:2468] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:48.184051  3320 ts_tablet_manager.cc:1434] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:24:48.185111  3320 tablet_bootstrap.cc:492] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:48.194458  3547 consensus_queue.cc:1048] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:24:48.204348  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:48.217437  3197 raft_consensus.cc:2393] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:48.211817  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:48.232514  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:48.238315  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:48.239264  3047 raft_consensus.cc:3060] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.241030  2948 catalog_manager.cc:5697] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.229374  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:48.252780  3121 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:48.253358  3321 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:48.253934  3321 ts_tablet_manager.cc:1403] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.405s	user 0.012s	sys 0.009s
I20260709 12:24:48.256748  3322 tablet_bootstrap.cc:654] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.229067  3276 raft_consensus.cc:2468] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:48.280165  3557 leader_election.cc:290] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:48.287513  3324 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:48.288054  3324 ts_tablet_manager.cc:1403] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.472s	user 0.028s	sys 0.041s
I20260709 12:24:48.290916  3324 raft_consensus.cc:359] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.290786  3321 raft_consensus.cc:359] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.291858  3324 raft_consensus.cc:385] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.292004  3321 raft_consensus.cc:385] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.292219  3324 raft_consensus.cc:740] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.292486  3321 raft_consensus.cc:740] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.295439  3554 consensus_queue.cc:1048] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.299381  3324 consensus_queue.cc:260] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.302098  3324 ts_tablet_manager.cc:1434] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 12:24:48.303222  3324 tablet_bootstrap.cc:492] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:48.293210  3321 consensus_queue.cc:260] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.306102  3602 raft_consensus.cc:493] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.306596  3602 raft_consensus.cc:515] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.308552  3602 leader_election.cc:290] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:48.310245  3321 ts_tablet_manager.cc:1434] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 12:24:48.314817  3321 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:48.318811  3324 tablet_bootstrap.cc:654] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.320221  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:48.328122  3048 raft_consensus.cc:3060] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.328634  3548 raft_consensus.cc:515] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.324754  3630 consensus_queue.cc:1048] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:48.330312  3240 leader_election.cc:343] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.331065  3240 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:48.324357  3015 leader_election.cc:304] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
W20260709 12:24:48.334031  3240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 55999us
I20260709 12:24:48.355829  3548 leader_election.cc:290] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:48.359001  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:48.361578  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d3255b68cdc495c9a753494c3f2f2cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:48.362326  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:48.362460  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 45114.1us
W20260709 12:24:48.363260  3090 leader_election.cc:343] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.362346  3272 raft_consensus.cc:3060] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.370543  3321 tablet_bootstrap.cc:654] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.376554  3320 tablet_bootstrap.cc:654] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.380275  3642 raft_consensus.cc:2749] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:48.388772  3048 raft_consensus.cc:2468] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:48.399930  3165 leader_election.cc:304] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:48.353312  2945 catalog_manager.cc:5697] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:48.396384  3630 raft_consensus.cc:2764] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:24:48.402842  3557 raft_consensus.cc:2804] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:48.403467  3557 raft_consensus.cc:697] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:48.404453  3557 consensus_queue.cc:237] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:48.412828  3430 raft_consensus.cc:493] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.413539  3430 raft_consensus.cc:515] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.418025  3430 leader_election.cc:290] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:48.418455  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:48.419414  3123 raft_consensus.cc:2393] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
W20260709 12:24:48.422510  3015 leader_election.cc:343] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.423134  3047 raft_consensus.cc:2468] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:48.431167  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:48.432039  3276 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.432747  3322 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:48.433291  3322 ts_tablet_manager.cc:1403] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.356s	user 0.017s	sys 0.001s
I20260709 12:24:48.436450  3322 raft_consensus.cc:359] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.437193  3322 raft_consensus.cc:385] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.439157  3322 raft_consensus.cc:740] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
W20260709 12:24:48.440948  3015 leader_election.cc:343] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.443256  3015 leader_election.cc:304] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:48.445142  3391 raft_consensus.cc:2749] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:48.446146  3089 leader_election.cc:304] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:48.429232  3561 raft_consensus.cc:493] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.449040  3561 raft_consensus.cc:515] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.452149  3561 leader_election.cc:290] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:48.452966  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:48.454026  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f3cee2b435d4ec5be91bead992f6663" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:48.454679  3240 leader_election.cc:343] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.454944  3049 raft_consensus.cc:2393] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:48.456578  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:48.457863  3554 consensus_queue.cc:1048] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:48.463472  3165 leader_election.cc:304] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:48.464468  3430 raft_consensus.cc:3060] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:48.465530  3241 leader_election.cc:343] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.466164  3241 leader_election.cc:304] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:48.469532  3559 raft_consensus.cc:2749] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:48.474843  3322 consensus_queue.cc:260] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.484597  3650 raft_consensus.cc:2804] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:48.485349  3650 raft_consensus.cc:697] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:48.486400  3650 consensus_queue.cc:237] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.491071  3322 ts_tablet_manager.cc:1434] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.002s
I20260709 12:24:48.491561  3324 tablet_bootstrap.cc:492] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:48.492100  3324 ts_tablet_manager.cc:1403] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.189s	user 0.030s	sys 0.014s
I20260709 12:24:48.492239  3322 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:48.493615  3272 raft_consensus.cc:2468] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:48.509509  3324 raft_consensus.cc:359] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.510726  3324 raft_consensus.cc:385] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.511226  3324 raft_consensus.cc:740] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.514026  3276 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:48.512506  3324 consensus_queue.cc:260] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.520670  3324 ts_tablet_manager.cc:1434] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
W20260709 12:24:48.502398  3089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 56380.2us
I20260709 12:24:48.526367  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:48.527211  3123 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.533473  3324 tablet_bootstrap.cc:492] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:48.534968  3322 tablet_bootstrap.cc:654] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.537083  3015 leader_election.cc:304] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:48.530326  3430 raft_consensus.cc:2749] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:48.538584  3547 raft_consensus.cc:2804] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:48.539180  3547 raft_consensus.cc:697] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:48.540112  3547 consensus_queue.cc:237] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.544092  3321 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:48.544781  3321 ts_tablet_manager.cc:1403] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.230s	user 0.011s	sys 0.008s
I20260709 12:24:48.550318  3321 raft_consensus.cc:359] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.551335  3321 raft_consensus.cc:385] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.551681  3321 raft_consensus.cc:740] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.553599  3321 consensus_queue.cc:260] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:48.549646  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:48.558812  3320 tablet_bootstrap.cc:492] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:48.559517  3320 ts_tablet_manager.cc:1403] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.375s	user 0.020s	sys 0.009s
I20260709 12:24:48.568830  3324 tablet_bootstrap.cc:654] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.575496  3321 ts_tablet_manager.cc:1434] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.000s
I20260709 12:24:48.576143  3320 raft_consensus.cc:359] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.576959  3321 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:48.577179  3320 raft_consensus.cc:385] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.577621  3320 raft_consensus.cc:740] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.572701  3123 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:48.589251  3320 consensus_queue.cc:260] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.597292  3320 ts_tablet_manager.cc:1434] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:24:48.610862  3321 tablet_bootstrap.cc:654] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.619987  3322 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:48.620050  3324 tablet_bootstrap.cc:492] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:48.620597  3322 ts_tablet_manager.cc:1403] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.129s	user 0.011s	sys 0.009s
I20260709 12:24:48.620877  3324 ts_tablet_manager.cc:1403] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.007s
I20260709 12:24:48.624739  3322 raft_consensus.cc:359] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.625728  3322 raft_consensus.cc:385] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.625401  3324 raft_consensus.cc:359] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.626281  3322 raft_consensus.cc:740] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.626726  3324 raft_consensus.cc:385] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.627241  3324 raft_consensus.cc:740] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.627135  3322 consensus_queue.cc:260] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.628764  3324 consensus_queue.cc:260] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.630352  3322 ts_tablet_manager.cc:1434] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.004s
I20260709 12:24:48.631510  3322 tablet_bootstrap.cc:492] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:48.632880  3324 ts_tablet_manager.cc:1434] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:24:48.636401  3324 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:48.638772  3322 tablet_bootstrap.cc:654] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.640522  3320 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:48.652127  3561 consensus_queue.cc:1048] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:48.657254  3322 tablet_bootstrap.cc:492] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:48.657580  3321 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:48.657999  3322 ts_tablet_manager.cc:1403] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 12:24:48.658140  3321 ts_tablet_manager.cc:1403] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.005s
I20260709 12:24:48.652529  3320 tablet_bootstrap.cc:654] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.665745  3324 tablet_bootstrap.cc:654] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.661486  3321 raft_consensus.cc:359] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.669903  3321 raft_consensus.cc:385] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.670315  3321 raft_consensus.cc:740] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.671576  3321 consensus_queue.cc:260] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.674906  3321 ts_tablet_manager.cc:1434] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:24:48.676060  3321 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:48.677425  3322 raft_consensus.cc:359] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.695609  3322 raft_consensus.cc:385] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.696115  3322 raft_consensus.cc:740] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.678311  3650 raft_consensus.cc:493] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.680661  3627 raft_consensus.cc:493] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.686928  2946 catalog_manager.cc:5697] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.699029  3650 raft_consensus.cc:515] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.699055  3627 raft_consensus.cc:515] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.706601  3340 raft_consensus.cc:493] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.707261  3340 raft_consensus.cc:515] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.709580  3340 leader_election.cc:290] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:48.713397  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:48.715358  3090 leader_election.cc:343] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.716967  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:48.719043  3015 leader_election.cc:343] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.719144  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:48.705500  3627 leader_election.cc:290] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:48.721747  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:48.724650  3324 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:48.692092  3321 tablet_bootstrap.cc:654] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.725360  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:48.727200  3276 raft_consensus.cc:2468] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:48.727741  3050 raft_consensus.cc:2468] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:48.728883  3090 leader_election.cc:304] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
W20260709 12:24:48.729972  3015 leader_election.cc:343] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:48.730471  3089 leader_election.cc:304] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:48.731205  3645 raft_consensus.cc:2804] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:48.730970  3324 ts_tablet_manager.cc:1403] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.009s
I20260709 12:24:48.731654  3645 raft_consensus.cc:493] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.732412  3647 raft_consensus.cc:2804] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:48.732570  3645 raft_consensus.cc:3060] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.733011  3647 raft_consensus.cc:493] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.730612  3015 leader_election.cc:304] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:48.734851  3602 raft_consensus.cc:2749] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:48.721865  3650 leader_election.cc:290] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:48.733565  3647 raft_consensus.cc:3060] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.725972  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:48.739688  3047 raft_consensus.cc:2468] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:48.740458  3324 raft_consensus.cc:359] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.742094  3324 raft_consensus.cc:385] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.743010  3324 raft_consensus.cc:740] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.744567  3645 raft_consensus.cc:515] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:48.749032  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:48.749851  3276 raft_consensus.cc:3060] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.744858  3324 consensus_queue.cc:260] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.755842  3324 ts_tablet_manager.cc:1434] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 12:24:48.756433  3645 leader_election.cc:290] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:48.756508  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:48.757936  3324 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:48.797703  3047 raft_consensus.cc:3060] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.698385  3322 consensus_queue.cc:260] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.812660  3653 raft_consensus.cc:493] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.822882  3324 tablet_bootstrap.cc:654] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.823086  3653 raft_consensus.cc:515] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.819818  3557 raft_consensus.cc:493] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.826700  3557 raft_consensus.cc:515] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.821926  3628 raft_consensus.cc:493] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.830485  3628 raft_consensus.cc:515] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.833196  3324 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:48.833802  3324 ts_tablet_manager.cc:1403] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.016s
I20260709 12:24:48.836761  3324 raft_consensus.cc:359] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.837500  3324 raft_consensus.cc:385] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:48.842352  3324 raft_consensus.cc:740] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:48.843535  3557 leader_election.cc:290] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:48.844053  3324 consensus_queue.cc:260] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.847759  3653 leader_election.cc:290] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:48.848145  3324 ts_tablet_manager.cc:1434] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:24:48.849519  3324 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:48.850538  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:48.851365  3197 raft_consensus.cc:2468] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:48.852919  3090 leader_election.cc:304] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:48.854466  3645 raft_consensus.cc:2804] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:48.855149  3645 raft_consensus.cc:493] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.855731  3645 raft_consensus.cc:3060] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.866928  3324 tablet_bootstrap.cc:654] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:48.866710  3628 leader_election.cc:290] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:48.869576  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:48.762856  3430 raft_consensus.cc:493] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.873489  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:48.874408  3430 raft_consensus.cc:515] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.876187  3201 raft_consensus.cc:3060] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.877750  3430 leader_election.cc:290] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:48.881687  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:48.921535  3271 raft_consensus.cc:2468] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:48.798563  2948 catalog_manager.cc:5697] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:48.884567  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:48.923225  3273 raft_consensus.cc:2468] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:48.902591  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:48.932395  3050 raft_consensus.cc:2468] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:48.942600  3165 leader_election.cc:304] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:48.946208  3653 raft_consensus.cc:2804] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:48.946723  3653 raft_consensus.cc:493] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.947108  3653 raft_consensus.cc:3060] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.948469  3645 raft_consensus.cc:515] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.954922  3121 raft_consensus.cc:2393] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:48.950723  3047 raft_consensus.cc:2468] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:48.969669  3089 leader_election.cc:304] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:48.974649  3645 leader_election.cc:290] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:48.974503  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:48.975329  3273 raft_consensus.cc:3060] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:48.975478  3645 raft_consensus.cc:2804] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:48.976051  3645 raft_consensus.cc:697] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:48.981550  3560 raft_consensus.cc:493] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.982492  3560 raft_consensus.cc:515] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:48.805662  3647 raft_consensus.cc:515] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:48.992960  3560 leader_election.cc:290] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:49.011157  3322 ts_tablet_manager.cc:1434] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.353s	user 0.012s	sys 0.000s
I20260709 12:24:49.016988  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43068fdfca3b412f8dce5d7ac88d3be0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:49.018116  3196 raft_consensus.cc:3060] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.019218  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290114d0aee44b25b8178f30491c27e2" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:49.021987  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290114d0aee44b25b8178f30491c27e2" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:49.036823  3241 leader_election.cc:343] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:49.042541  3602 consensus_queue.cc:1048] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:49.051509  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:48.976996  3645 consensus_queue.cc:237] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:49.039242  3273 raft_consensus.cc:2468] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
W20260709 12:24:49.092376  3241 leader_election.cc:343] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:49.093125  3241 leader_election.cc:304] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:49.107287  3559 raft_consensus.cc:2749] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:49.118451  3692 raft_consensus.cc:493] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.131909  3692 raft_consensus.cc:515] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:49.187826  3321 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:49.188599  3321 ts_tablet_manager.cc:1403] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.513s	user 0.104s	sys 0.103s
I20260709 12:24:49.189836  3324 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:49.190434  3324 ts_tablet_manager.cc:1403] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.341s	user 0.039s	sys 0.099s
I20260709 12:24:49.199923  3276 raft_consensus.cc:2468] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
W20260709 12:24:49.186106  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 58526.4us
I20260709 12:24:49.209045  3650 consensus_queue.cc:1048] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:49.211869  3692 leader_election.cc:290] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:49.217734  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:49.218473  3046 raft_consensus.cc:3060] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.216717  3196 raft_consensus.cc:2468] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:49.217797  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:49.183149  3653 raft_consensus.cc:515] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:49.222837  3559 consensus_queue.cc:1048] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:49.223551  3653 leader_election.cc:290] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:24:49.247527  3320 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.122s	sys 0.191s
W20260709 12:24:49.247970  3320 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.123s	sys 0.192s
I20260709 12:24:49.249281  3322 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:49.251385  3653 consensus_queue.cc:1048] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:49.254098  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:49.254769  3194 raft_consensus.cc:3060] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.266878  3048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:49.267606  3048 raft_consensus.cc:3060] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.244503  3166 leader_election.cc:304] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:49.242630  3647 leader_election.cc:290] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:49.277315  3321 raft_consensus.cc:359] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.278280  3321 raft_consensus.cc:385] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.278709  3321 raft_consensus.cc:740] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.279834  3321 consensus_queue.cc:260] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.295783  3324 raft_consensus.cc:359] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.296617  3324 raft_consensus.cc:385] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.297113  3324 raft_consensus.cc:740] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.298007  3324 consensus_queue.cc:260] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.287698  3430 raft_consensus.cc:2764] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:24:49.316213  3324 ts_tablet_manager.cc:1434] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
I20260709 12:24:49.317332  3324 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:49.319286  3321 ts_tablet_manager.cc:1434] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.130s	user 0.007s	sys 0.001s
I20260709 12:24:49.299165  3046 raft_consensus.cc:2468] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
W20260709 12:24:49.285843  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 46598.6us
I20260709 12:24:49.323068  3321 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:49.323096  3320 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:49.324605  3320 ts_tablet_manager.cc:1403] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.684s	user 0.134s	sys 0.194s
W20260709 12:24:49.330286  3166 leader_election.cc:343] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:49.349598  3322 tablet_bootstrap.cc:654] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.321010  3090 leader_election.cc:304] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:49.327428  3627 consensus_queue.cc:1048] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:24:49.364471  3194 raft_consensus.cc:2468] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:49.369855  3048 raft_consensus.cc:2468] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
W20260709 12:24:49.389262  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 77856.4us
I20260709 12:24:49.390892  3090 leader_election.cc:304] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:49.391129  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:49.401742  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead227dd136a401db0ffb15035d0952f" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:49.402783  3124 raft_consensus.cc:2393] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:49.403348  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a818fbb8d34fd098340d5f6167e8d1" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:49.408030  3321 tablet_bootstrap.cc:654] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.409737  3340 raft_consensus.cc:2804] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:49.410636  3340 raft_consensus.cc:697] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:49.411994  3340 consensus_queue.cc:237] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
W20260709 12:24:49.414505  3166 leader_election.cc:343] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:49.414810  3399 raft_consensus.cc:2804] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:49.415655  3399 raft_consensus.cc:697] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:49.418305  3324 tablet_bootstrap.cc:654] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.422084  3166 leader_election.cc:304] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:49.438086  3645 consensus_queue.cc:1048] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:49.443943  3165 leader_election.cc:304] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:49.444957  3653 raft_consensus.cc:2804] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:49.445482  3653 raft_consensus.cc:697] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:49.446417  3653 consensus_queue.cc:237] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:49.452432  3697 raft_consensus.cc:2749] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:49.457609  2945 catalog_manager.cc:5697] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:49.460654  2945 catalog_manager.cc:5697] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:49.416878  3399 consensus_queue.cc:237] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:49.486285  3320 raft_consensus.cc:359] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.487025  3320 raft_consensus.cc:385] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.487298  3320 raft_consensus.cc:740] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
W20260709 12:24:49.472926  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 56188.9us
I20260709 12:24:49.509948  3320 consensus_queue.cc:260] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:49.532459  3089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 95291.7us
I20260709 12:24:49.568888  3320 ts_tablet_manager.cc:1434] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.244s	user 0.010s	sys 0.002s
I20260709 12:24:49.570192  3320 tablet_bootstrap.cc:492] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:49.582744  3324 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:49.583374  3324 ts_tablet_manager.cc:1403] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.266s	user 0.012s	sys 0.012s
I20260709 12:24:49.588193  3166 leader_election.cc:304] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
W20260709 12:24:49.629635  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:49.646469  3322 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:49.647166  3322 ts_tablet_manager.cc:1403] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.398s	user 0.027s	sys 0.013s
W20260709 12:24:49.635047  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 63206.1us
I20260709 12:24:49.677088  3561 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.696874  3430 raft_consensus.cc:2749] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:49.724200  3320 tablet_bootstrap.cc:654] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.700723  3561 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:49.760823  3708 log.cc:927] Time spent T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a: Append to log took a long time: real 0.186s	user 0.000s	sys 0.002s
I20260709 12:24:49.763341  3324 raft_consensus.cc:359] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.764901  3324 raft_consensus.cc:385] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.765268  3324 raft_consensus.cc:740] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.736809  3554 consensus_queue.cc:1048] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:24:49.768889  3324 consensus_queue.cc:260] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.779126  3321 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:49.779870  3321 ts_tablet_manager.cc:1403] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.457s	user 0.018s	sys 0.004s
I20260709 12:24:49.772083  3560 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.792140  3724 log.cc:927] Time spent T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:24:49.793830  3324 ts_tablet_manager.cc:1434] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.210s	user 0.011s	sys 0.000s
I20260709 12:24:49.811273  3561 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:49.795835  3560 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:49.816417  3560 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:49.823122  3653 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.823766  3653 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.828945  3627 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.829563  3627 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.832050  3627 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
W20260709 12:24:49.900866  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 55628.3us
I20260709 12:24:49.876637  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:49.854487  3321 raft_consensus.cc:359] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.906998  3321 raft_consensus.cc:385] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.853317  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:49.907531  3321 raft_consensus.cc:740] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.907986  3047 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:49.846218  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:49.908403  3321 consensus_queue.cc:260] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.909220  3274 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:49.910228  3321 ts_tablet_manager.cc:1434] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.004s
I20260709 12:24:49.910938  3166 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:49.835021  3125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:49.900323  3628 consensus_queue.cc:1048] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:24:49.846550  3322 raft_consensus.cc:359] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:49.912962  3322 raft_consensus.cc:385] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.913245  3322 raft_consensus.cc:740] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.914022  3322 consensus_queue.cc:260] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:49.873518  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:49.915387  3049 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:49.882427  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:49.916867  3271 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:49.840094  3653 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:49.918372  3015 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:49.918573  3320 tablet_bootstrap.cc:492] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:49.919377  3320 ts_tablet_manager.cc:1403] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.349s	user 0.009s	sys 0.012s
I20260709 12:24:49.919685  3630 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:49.920183  3630 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.921469  3322 ts_tablet_manager.cc:1434] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.274s	user 0.013s	sys 0.001s
I20260709 12:24:49.922556  3322 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:49.851038  3726 consensus_queue.cc:1048] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260709 12:24:49.923702  3647 consensus_queue.cc:1048] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:49.884402  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:49.926011  3630 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.911281  3321 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:49.906985  3197 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:49.873059  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:49.937958  3692 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:49.937469  3320 raft_consensus.cc:359] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:49.939249  3692 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.940404  3692 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.944746  3321 tablet_bootstrap.cc:654] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.938715  3320 raft_consensus.cc:385] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:49.945304  3320 raft_consensus.cc:740] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:49.944416  3124 raft_consensus.cc:3060] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:49.947108  3241 leader_election.cc:343] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:49.952708  3240 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:49.953543  3718 raft_consensus.cc:493] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.953737  3240 leader_election.cc:343] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:49.954110  3718 raft_consensus.cc:515] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:49.954432  3729 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:49.963145  3729 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.963793  3729 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:49.964839  3718 leader_election.cc:290] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:49.954213  3240 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:49.959055  3320 consensus_queue.cc:260] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:49.968204  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:49.972888  3718 raft_consensus.cc:2749] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:49.974444  3320 ts_tablet_manager.cc:1434] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.001s
I20260709 12:24:49.975147  3322 tablet_bootstrap.cc:654] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:49.975914  3320 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:49.977553  3653 consensus_queue.cc:1048] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:49.984447  3559 raft_consensus.cc:493] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.985138  3559 raft_consensus.cc:515] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
W20260709 12:24:49.986802  3241 leader_election.cc:343] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:49.995990  3559 leader_election.cc:290] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:49.997473  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:50.001525  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:50.003383  3241 leader_election.cc:343] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.022681  3324 tablet_bootstrap.cc:492] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
W20260709 12:24:50.046123  3241 leader_election.cc:343] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.060194  3241 leader_election.cc:304] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:50.060631  3320 tablet_bootstrap.cc:654] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.043843  3627 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.042407  3399 consensus_queue.cc:1048] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:24:50.075591  3321 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:50.076786  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:50.084324  3321 ts_tablet_manager.cc:1403] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.173s	user 0.025s	sys 0.046s
I20260709 12:24:50.083788  3627 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.068550  3718 raft_consensus.cc:2749] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.100203  2947 catalog_manager.cc:5697] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.073618  3645 consensus_queue.cc:1048] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:24:50.114955  3321 raft_consensus.cc:359] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.117210  3321 raft_consensus.cc:385] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.117677  3321 raft_consensus.cc:740] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
W20260709 12:24:50.118021  3240 leader_election.cc:343] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.118521  3240 leader_election.cc:304] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:50.118347  3321 consensus_queue.cc:260] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.122311  3653 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.130319  3653 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.131664  3692 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.132527  3653 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:50.134119  3718 raft_consensus.cc:493] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.134682  3718 raft_consensus.cc:515] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.137009  3718 leader_election.cc:290] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:50.141486  3560 raft_consensus.cc:2749] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.144912  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:50.123461  3729 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:50.147261  3241 leader_election.cc:343] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.149885  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:50.150642  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:50.151398  3271 raft_consensus.cc:2468] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:50.150709  3276 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:50.131678  3630 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.154824  3729 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:50.156296  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:50.157208  3197 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:50.159325  3324 tablet_bootstrap.cc:654] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.167050  3321 ts_tablet_manager.cc:1434] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 12:24:50.168339  3321 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:50.170696  3630 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:50.172286  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:50.173431  3276 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:50.184039  3627 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:50.187045  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:50.187870  3197 raft_consensus.cc:2468] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:50.188889  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:50.189661  3201 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:50.189119  2947 catalog_manager.cc:5697] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.192036  3653 consensus_queue.cc:1048] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:50.192863  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:50.193547  3050 raft_consensus.cc:2468] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:50.195309  3165 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:50.196841  3015 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:50.198120  3015 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:50.198421  3391 raft_consensus.cc:2804] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.198838  3391 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.199286  3391 raft_consensus.cc:3060] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.198854  3321 tablet_bootstrap.cc:654] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.191309  2947 catalog_manager.cc:5697] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.206691  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:50.208460  3276 raft_consensus.cc:2468] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:50.207334  3653 raft_consensus.cc:2804] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.220305  3391 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.223804  3653 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.227066  3653 raft_consensus.cc:3060] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.232028  3391 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:50.237152  3700 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.242367  3322 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:50.243010  3322 ts_tablet_manager.cc:1403] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.321s	user 0.014s	sys 0.013s
I20260709 12:24:50.210176  3692 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:50.258322  3322 raft_consensus.cc:359] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.259115  3322 raft_consensus.cc:385] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.259405  3322 raft_consensus.cc:740] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.260083  3322 consensus_queue.cc:260] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.248199  3650 consensus_queue.cc:1048] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:24:50.267380  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:50.268247  3045 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:50.268324  3630 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.268891  3630 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.273185  3046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:50.275583  3045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:50.276468  3045 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
W20260709 12:24:50.281327  3240 leader_election.cc:343] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.281879  3240 leader_election.cc:304] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:50.275723  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:50.289678  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:50.290374  3276 raft_consensus.cc:3060] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.308596  3322 ts_tablet_manager.cc:1434] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.001s
I20260709 12:24:50.309999  3276 raft_consensus.cc:2468] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:50.285686  3718 raft_consensus.cc:2749] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.319078  3240 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
W20260709 12:24:50.307585  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 53572.6us
I20260709 12:24:50.320165  3166 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:50.320411  3559 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.321264  3697 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.327931  3322 tablet_bootstrap.cc:492] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:50.329000  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:50.330063  3124 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:50.331477  3015 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:50.317869  3630 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:50.342607  3015 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:50.341791  3700 raft_consensus.cc:2804] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.381737  3324 tablet_bootstrap.cc:492] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:50.382539  3324 ts_tablet_manager.cc:1403] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.360s	user 0.027s	sys 0.005s
I20260709 12:24:50.348338  3602 raft_consensus.cc:2804] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.375516  3700 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.401037  3324 raft_consensus.cc:359] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.403173  3324 raft_consensus.cc:385] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.403757  3324 raft_consensus.cc:740] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.404121  3320 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:50.404663  3320 ts_tablet_manager.cc:1403] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.429s	user 0.016s	sys 0.014s
I20260709 12:24:50.404547  3324 consensus_queue.cc:260] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.411697  3324 ts_tablet_manager.cc:1434] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:24:50.412804  3324 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:50.413733  3653 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.415092  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:50.415854  3272 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:50.416064  3197 raft_consensus.cc:2393] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:50.397747  3602 raft_consensus.cc:697] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:50.421449  3602 consensus_queue.cc:237] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.403694  3700 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.440265  3322 tablet_bootstrap.cc:654] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.444664  3321 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:50.445274  3321 ts_tablet_manager.cc:1403] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.277s	user 0.013s	sys 0.006s
I20260709 12:24:50.454883  3320 raft_consensus.cc:359] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.483687  3320 raft_consensus.cc:385] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.483985  3320 raft_consensus.cc:740] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.482631  3324 tablet_bootstrap.cc:654] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.487794  3320 consensus_queue.cc:260] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.489169  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:50.448873  3321 raft_consensus.cc:359] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:50.495517  3321 raft_consensus.cc:385] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.495853  3321 raft_consensus.cc:740] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.496342  3270 raft_consensus.cc:2393] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:50.448149  3700 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.497812  3321 consensus_queue.cc:260] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:50.501771  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:50.502489  3121 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.504575  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:50.505259  3270 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.507242  3320 ts_tablet_manager.cc:1434] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260709 12:24:50.508391  3320 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
W20260709 12:24:50.514971  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 66054.3us
I20260709 12:24:50.522068  3321 ts_tablet_manager.cc:1434] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.076s	user 0.012s	sys 0.003s
I20260709 12:24:50.514773  3700 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:50.525203  3653 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:50.525889  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:50.527719  3165 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:50.529060  3653 raft_consensus.cc:2749] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.531553  3270 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:50.544864  3320 tablet_bootstrap.cc:654] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.549116  3121 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:50.551319  3015 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:50.554270  3322 tablet_bootstrap.cc:492] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:50.554728  3729 raft_consensus.cc:493] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.555127  3322 ts_tablet_manager.cc:1403] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.246s	user 0.013s	sys 0.012s
I20260709 12:24:50.555570  3729 raft_consensus.cc:515] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.559270  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:50.561281  3240 leader_election.cc:343] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.562206  3729 leader_election.cc:290] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:50.562824  3700 raft_consensus.cc:2804] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.563463  3700 raft_consensus.cc:697] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:50.564458  3700 consensus_queue.cc:237] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.567224  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:50.568118  3321 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:50.568598  3322 raft_consensus.cc:359] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.569780  3322 raft_consensus.cc:385] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:50.570070  3241 leader_election.cc:343] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.570937  3241 leader_election.cc:304] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:50.570140  3322 raft_consensus.cc:740] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.572069  3755 raft_consensus.cc:2749] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.572589  3322 consensus_queue.cc:260] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.583827  3322 ts_tablet_manager.cc:1434] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:24:50.597541  3653 raft_consensus.cc:493] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.598189  3653 raft_consensus.cc:515] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.600560  3653 leader_election.cc:290] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:50.603569  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290114d0aee44b25b8178f30491c27e2" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:50.603470  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290114d0aee44b25b8178f30491c27e2" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:50.604691  3270 raft_consensus.cc:2468] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:50.605041  3121 raft_consensus.cc:2468] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:50.594882  3324 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:50.606227  3166 leader_election.cc:304] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:50.606526  3324 ts_tablet_manager.cc:1403] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.194s	user 0.021s	sys 0.001s
I20260709 12:24:50.584813  3321 tablet_bootstrap.cc:654] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.607985  3653 raft_consensus.cc:2804] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.608456  3653 raft_consensus.cc:493] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.608916  3653 raft_consensus.cc:3060] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.610632  3324 raft_consensus.cc:359] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:50.611452  3324 raft_consensus.cc:385] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.612941  3324 raft_consensus.cc:740] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.613842  3324 consensus_queue.cc:260] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:50.615244  2947 catalog_manager.cc:5697] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:50.616328  3322 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:50.617482  3324 ts_tablet_manager.cc:1434] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:24:50.617163  2947 catalog_manager.cc:5697] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.618556  3324 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:50.620159  3653 raft_consensus.cc:515] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.623375  3320 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:50.623965  3320 ts_tablet_manager.cc:1403] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.020s
I20260709 12:24:50.626928  3320 raft_consensus.cc:359] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.627592  3320 raft_consensus.cc:385] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.627910  3320 raft_consensus.cc:740] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.629834  3653 leader_election.cc:290] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:50.631665  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290114d0aee44b25b8178f30491c27e2" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:50.632333  3121 raft_consensus.cc:3060] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.634153  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290114d0aee44b25b8178f30491c27e2" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:50.634796  3270 raft_consensus.cc:3060] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.642078  3322 tablet_bootstrap.cc:654] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.645303  3320 consensus_queue.cc:260] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.648007  3320 ts_tablet_manager.cc:1434] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:24:50.649066  3320 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:50.627661  3321 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:50.654927  3321 ts_tablet_manager.cc:1403] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.001s
I20260709 12:24:50.655105  3320 tablet_bootstrap.cc:654] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.657799  3321 raft_consensus.cc:359] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.658573  3321 raft_consensus.cc:385] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.666106  3322 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:50.666682  3322 ts_tablet_manager.cc:1403] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.008s
I20260709 12:24:50.669543  3322 raft_consensus.cc:359] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:50.670315  3322 raft_consensus.cc:385] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.670611  3322 raft_consensus.cc:740] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.671449  3322 consensus_queue.cc:260] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:50.674074  3322 ts_tablet_manager.cc:1434] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:50.675089  3322 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:50.677573  3320 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:50.678267  3320 ts_tablet_manager.cc:1403] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.007s
I20260709 12:24:50.680910  3322 tablet_bootstrap.cc:654] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.681552  3320 raft_consensus.cc:359] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.682467  3320 raft_consensus.cc:385] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.682827  3320 raft_consensus.cc:740] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.683590  3320 consensus_queue.cc:260] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.692751  3322 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:50.693358  3322 ts_tablet_manager.cc:1403] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.018s	user 0.001s	sys 0.015s
I20260709 12:24:50.694168  3700 raft_consensus.cc:493] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.692414  3320 ts_tablet_manager.cc:1434] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:24:50.694711  3121 raft_consensus.cc:2468] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:50.695724  3320 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:50.691285  3270 raft_consensus.cc:2468] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:50.694761  3700 raft_consensus.cc:515] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:50.696250  3322 raft_consensus.cc:359] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.701973  3322 raft_consensus.cc:385] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.702314  3322 raft_consensus.cc:740] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.703033  3322 consensus_queue.cc:260] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.705130  3700 leader_election.cc:290] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:50.705600  3322 ts_tablet_manager.cc:1434] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 12:24:50.706840  3322 tablet_bootstrap.cc:492] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:50.707345  3166 leader_election.cc:304] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:50.658864  3321 raft_consensus.cc:740] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.712934  3322 tablet_bootstrap.cc:654] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.712280  3321 consensus_queue.cc:260] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.713557  3653 raft_consensus.cc:2804] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:50.714150  3653 raft_consensus.cc:697] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:50.715008  3653 consensus_queue.cc:237] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.715438  3340 raft_consensus.cc:493] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.711045  3324 tablet_bootstrap.cc:654] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.716004  3340 raft_consensus.cc:515] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.718191  3340 leader_election.cc:290] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:50.720165  3321 ts_tablet_manager.cc:1434] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 12:24:50.719866  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:50.720824  3047 raft_consensus.cc:2468] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:50.722208  3089 leader_election.cc:304] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:50.723434  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773e38b369a4da2ba1e065e6565c5c1" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:50.724269  3196 raft_consensus.cc:2468] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:50.726076  3712 raft_consensus.cc:2804] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.726629  3712 raft_consensus.cc:493] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.726965  3712 raft_consensus.cc:3060] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.730010  3321 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:50.731395  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773e38b369a4da2ba1e065e6565c5c1" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:50.732151  3120 raft_consensus.cc:2468] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:50.735114  3320 tablet_bootstrap.cc:654] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.738708  3015 leader_election.cc:304] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:50.740873  3700 raft_consensus.cc:2804] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:50.741403  3700 raft_consensus.cc:493] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.741750  3700 raft_consensus.cc:3060] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:50.743736  3322 tablet_bootstrap.cc:492] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:50.744308  3322 ts_tablet_manager.cc:1403] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 12:24:50.746598  3321 tablet_bootstrap.cc:654] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.747259  3322 raft_consensus.cc:359] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.748006  3322 raft_consensus.cc:385] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.748299  3322 raft_consensus.cc:740] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.751587  3320 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:50.752208  3320 ts_tablet_manager.cc:1403] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.000s
I20260709 12:24:50.762056  3322 consensus_queue.cc:260] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:50.764405  3755 raft_consensus.cc:493] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.764748  3322 ts_tablet_manager.cc:1434] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:24:50.765153  3755 raft_consensus.cc:515] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.766835  3322 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:50.767133  3321 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:50.767680  3321 ts_tablet_manager.cc:1403] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.000s
W20260709 12:24:50.769207  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:50.769994  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:50.764207  3320 raft_consensus.cc:359] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.771616  3320 raft_consensus.cc:385] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:24:50.771960  3241 leader_election.cc:343] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.773748  3322 tablet_bootstrap.cc:654] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:50.776636  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:50.771973  3320 raft_consensus.cc:740] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.778910  3320 consensus_queue.cc:260] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.782618  3320 ts_tablet_manager.cc:1434] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
W20260709 12:24:50.786768  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 48152.6us
I20260709 12:24:50.798740  3755 leader_election.cc:290] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:50.783901  3321 raft_consensus.cc:359] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.800069  3321 raft_consensus.cc:385] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:50.801254  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:50.803908  3270 raft_consensus.cc:2468] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:50.805437  3320 tablet_bootstrap.cc:492] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a: Bootstrap starting.
I20260709 12:24:50.800405  3321 raft_consensus.cc:740] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:50.809959  3321 consensus_queue.cc:260] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:50.819607  3712 raft_consensus.cc:515] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:50.823745  3321 ts_tablet_manager.cc:1434] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 12:24:50.824761  3729 raft_consensus.cc:493] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.828718  3320 tablet_bootstrap.cc:654] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:50.833268  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 45178.9us
W20260709 12:24:50.833885  3240 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.28.234.126:41381, user_credentials={real_user=slave}} blocked reactor thread for 54692.1us
W20260709 12:24:50.929167  3089 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 55901.6us
I20260709 12:24:50.955328  3321 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
W20260709 12:24:50.967209  3240 leader_election.cc:343] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:50.967749  3240 leader_election.cc:304] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:50.989481  2947 catalog_manager.cc:5697] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:50.981680  3718 raft_consensus.cc:2749] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:50.964455  3729 raft_consensus.cc:515] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.031955  3322 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:51.032750  3322 ts_tablet_manager.cc:1403] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.266s	user 0.063s	sys 0.094s
I20260709 12:24:51.033946  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:51.036875  3272 raft_consensus.cc:3060] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.040987  3712 leader_election.cc:290] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:51.045187  3272 raft_consensus.cc:2468] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:51.050853  3771 raft_consensus.cc:493] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.048305  3602 consensus_queue.cc:1048] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:51.101398  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 47156.3us
W20260709 12:24:51.103559  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 66588us
W20260709 12:24:51.097157  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 45060.5us
I20260709 12:24:51.105311  3324 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:51.095893  3320 tablet_bootstrap.cc:492] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a: No bootstrap required, opened a new log
I20260709 12:24:51.105973  3324 ts_tablet_manager.cc:1403] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.488s	user 0.071s	sys 0.098s
I20260709 12:24:51.106138  3320 ts_tablet_manager.cc:1403] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent bootstrapping tablet: real 0.301s	user 0.019s	sys 0.015s
I20260709 12:24:51.107466  3321 tablet_bootstrap.cc:654] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:51.111766  3240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 60293.4us
I20260709 12:24:51.112884  3559 raft_consensus.cc:493] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.098973  3771 raft_consensus.cc:515] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.132694  3559 raft_consensus.cc:515] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.149641  3712 raft_consensus.cc:493] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.151456  3771 leader_election.cc:290] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:51.151695  3712 raft_consensus.cc:515] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
W20260709 12:24:51.155707  3015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 107637us
I20260709 12:24:51.112103  3700 raft_consensus.cc:515] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.180622  3322 raft_consensus.cc:359] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.181877  3322 raft_consensus.cc:385] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.182372  3322 raft_consensus.cc:740] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.186462  3322 consensus_queue.cc:260] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
W20260709 12:24:51.188112  3240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 75663.2us
I20260709 12:24:51.169656  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:51.192395  3090 leader_election.cc:304] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:51.180990  3729 leader_election.cc:290] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:51.183725  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:51.204046  3700 leader_election.cc:290] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:51.175606  3776 consensus_queue.cc:1048] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:24:51.214309  3322 ts_tablet_manager.cc:1434] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.181s	user 0.007s	sys 0.007s
I20260709 12:24:51.209975  3701 raft_consensus.cc:2804] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.209530  3050 raft_consensus.cc:3060] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.211850  3712 leader_election.cc:290] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:51.234297  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38cbb84ab714516acb50aa88c24fab8" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:51.256263  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773e38b369a4da2ba1e065e6565c5c1" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:51.256888  3201 raft_consensus.cc:3060] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.258119  3701 raft_consensus.cc:697] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:51.259171  3701 consensus_queue.cc:237] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:51.265027  3320 raft_consensus.cc:359] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:51.265895  3320 raft_consensus.cc:385] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.266191  3320 raft_consensus.cc:740] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.266880  3320 consensus_queue.cc:260] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:51.266208  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:51.269903  3276 raft_consensus.cc:2468] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:51.230280  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:51.221462  3559 leader_election.cc:290] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:51.236729  3324 raft_consensus.cc:359] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.238173  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:51.273427  3320 ts_tablet_manager.cc:1434] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a: Time spent starting tablet: real 0.167s	user 0.007s	sys 0.002s
I20260709 12:24:51.276024  3322 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:51.276373  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773e38b369a4da2ba1e065e6565c5c1" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:51.284847  3124 raft_consensus.cc:3060] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.272738  3324 raft_consensus.cc:385] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.279271  3776 consensus_queue.cc:1048] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:51.298777  3241 leader_election.cc:343] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:51.299582  3241 leader_election.cc:343] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.284044  3015 leader_election.cc:304] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:51.304940  3050 raft_consensus.cc:2468] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:51.286675  3324 raft_consensus.cc:740] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.306900  3324 consensus_queue.cc:260] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.307291  3773 consensus_queue.cc:1048] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:51.308897  3324 ts_tablet_manager.cc:1434] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.203s	user 0.002s	sys 0.005s
I20260709 12:24:51.311825  3194 raft_consensus.cc:2468] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:51.313040  3602 raft_consensus.cc:2804] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.313514  3602 raft_consensus.cc:493] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.313903  3602 raft_consensus.cc:3060] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.353932  3324 tablet_bootstrap.cc:492] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:51.355743  3322 tablet_bootstrap.cc:654] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:51.363834  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 171497us
W20260709 12:24:51.369793  3090 leader_election.cc:343] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.380894  3276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:51.381688  3276 raft_consensus.cc:2468] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:51.359225  3201 raft_consensus.cc:2468] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:51.382617  3124 raft_consensus.cc:2468] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:51.391208  3090 leader_election.cc:304] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:51.379163  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:51.403627  3015 leader_election.cc:304] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:51.400116  3645 raft_consensus.cc:2804] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:51.421880  3774 raft_consensus.cc:2804] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.427752  3645 raft_consensus.cc:493] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.440243  3774 raft_consensus.cc:697] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:51.445694  3645 raft_consensus.cc:3060] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.475329  3324 tablet_bootstrap.cc:654] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.461951  3653 consensus_queue.cc:1048] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:51.464395  3321 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:51.478191  3321 ts_tablet_manager.cc:1403] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.523s	user 0.011s	sys 0.019s
I20260709 12:24:51.467936  3602 raft_consensus.cc:515] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.465132  3774 consensus_queue.cc:237] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.484053  3321 raft_consensus.cc:359] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.485622  3321 raft_consensus.cc:385] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.486019  3321 raft_consensus.cc:740] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.491921  3321 consensus_queue.cc:260] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:51.504626  3321 ts_tablet_manager.cc:1434] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 12:24:51.505647  3321 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:51.494827  3602 leader_election.cc:290] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:51.510010  3645 raft_consensus.cc:515] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:51.510599  3322 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:51.511062  3324 tablet_bootstrap.cc:492] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:51.511227  3322 ts_tablet_manager.cc:1403] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.235s	user 0.006s	sys 0.014s
I20260709 12:24:51.511827  3324 ts_tablet_manager.cc:1403] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.202s	user 0.010s	sys 0.006s
I20260709 12:24:51.513226  3645 leader_election.cc:290] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
W20260709 12:24:51.573333  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 131660us
I20260709 12:24:51.583462  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38cbb84ab714516acb50aa88c24fab8" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:51.600090  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 137134us
I20260709 12:24:51.604346  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:51.610308  3645 raft_consensus.cc:493] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.611850  3645 raft_consensus.cc:515] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.612331  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:51.628340  3645 leader_election.cc:290] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:51.630975  3274 raft_consensus.cc:3060] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.636502  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52738b922b3c4c1cbbe2390f6b879c49" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:51.639588  3089 leader_election.cc:343] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.647578  3324 raft_consensus.cc:359] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:51.648943  3324 raft_consensus.cc:385] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.649363  3324 raft_consensus.cc:740] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.651062  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:51.652083  3270 raft_consensus.cc:3060] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:51.651383  3324 consensus_queue.cc:260] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:51.656430  3324 ts_tablet_manager.cc:1434] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.144s	user 0.000s	sys 0.011s
W20260709 12:24:51.652088  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 72626us
I20260709 12:24:51.632822  3322 raft_consensus.cc:359] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.669275  3322 raft_consensus.cc:385] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.669741  3322 raft_consensus.cc:740] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.679800  3324 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
W20260709 12:24:51.700099  3240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 43921.9us
I20260709 12:24:51.700986  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:51.701939  3197 raft_consensus.cc:3060] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:51.702100  3240 leader_election.cc:343] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.702775  3240 leader_election.cc:304] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
W20260709 12:24:51.705087  3240 leader_election.cc:343] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.707444  3718 raft_consensus.cc:2749] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:51.705174  3324 tablet_bootstrap.cc:654] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.709452  2948 catalog_manager.cc:5697] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.705605  3240 leader_election.cc:304] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:51.712670  3717 raft_consensus.cc:2749] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:51.751346  3321 tablet_bootstrap.cc:654] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.735586  3322 consensus_queue.cc:260] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.767053  3322 ts_tablet_manager.cc:1434] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.255s	user 0.009s	sys 0.002s
I20260709 12:24:51.766639  2947 catalog_manager.cc:5697] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.768671  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52738b922b3c4c1cbbe2390f6b879c49" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:51.734880  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 45195.5us
I20260709 12:24:51.781858  3653 consensus_queue.cc:1048] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:51.756494  3090 leader_election.cc:343] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:51.788290  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 45150.7us
I20260709 12:24:51.768713  3322 tablet_bootstrap.cc:492] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:51.810981  3197 raft_consensus.cc:2468] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:51.831612  3324 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:51.832312  3324 ts_tablet_manager.cc:1403] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.005s
W20260709 12:24:51.834713  3090 leader_election.cc:343] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.836175  3090 leader_election.cc:304] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:51.846011  3561 raft_consensus.cc:493] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.846835  3399 raft_consensus.cc:493] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.847589  3399 raft_consensus.cc:515] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.846714  3561 raft_consensus.cc:515] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:51.828253  3645 consensus_queue.cc:1048] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:24:51.855593  3561 leader_election.cc:290] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:51.863458  3399 leader_election.cc:290] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:51.873569  3324 raft_consensus.cc:359] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.874845  3324 raft_consensus.cc:385] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:51.875247  3324 raft_consensus.cc:740] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:51.875345  3270 raft_consensus.cc:2468] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:51.876415  3324 consensus_queue.cc:260] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:51.868486  3274 raft_consensus.cc:2468] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:51.880743  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:51.885105  3015 leader_election.cc:304] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:51.888497  3794 raft_consensus.cc:2804] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.889441  3794 raft_consensus.cc:697] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
W20260709 12:24:51.894997  3241 leader_election.cc:343] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.896147  3794 consensus_queue.cc:237] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:51.902722  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 68021.9us
I20260709 12:24:51.904886  3800 raft_consensus.cc:2749] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:51.914292  3324 ts_tablet_manager.cc:1434] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.080s	user 0.010s	sys 0.000s
I20260709 12:24:51.914619  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:51.916953  3090 leader_election.cc:304] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:51.940245  3324 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:51.948859  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:51.940486  3322 tablet_bootstrap.cc:654] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:51.942168  3650 raft_consensus.cc:2804] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:51.972702  3321 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:51.973655  3321 ts_tablet_manager.cc:1403] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.468s	user 0.007s	sys 0.015s
W20260709 12:24:51.982908  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 70266.4us
W20260709 12:24:51.985054  3090 leader_election.cc:343] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:51.993492  3089 leader_election.cc:343] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:51.968668  3650 raft_consensus.cc:697] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:52.001597  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:52.004451  3089 leader_election.cc:304] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:52.031626  3800 raft_consensus.cc:2749] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.045706  3650 consensus_queue.cc:237] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.076442  3321 raft_consensus.cc:359] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.077293  3324 tablet_bootstrap.cc:654] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.077379  3321 raft_consensus.cc:385] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.077937  3321 raft_consensus.cc:740] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.082983  3321 consensus_queue.cc:260] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
W20260709 12:24:52.088501  3241 leader_election.cc:343] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.092355  3700 raft_consensus.cc:493] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.093221  3700 raft_consensus.cc:515] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.097044  3700 leader_election.cc:290] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:52.097151  3790 raft_consensus.cc:493] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.097860  3790 raft_consensus.cc:515] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.104830  3790 leader_election.cc:290] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:52.105818  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52738b922b3c4c1cbbe2390f6b879c49" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:52.106676  3044 raft_consensus.cc:2468] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:52.107807  3165 leader_election.cc:304] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:52.111121  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52738b922b3c4c1cbbe2390f6b879c49" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:52.111897  3120 raft_consensus.cc:2468] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:52.089044  3241 leader_election.cc:304] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:52.124619  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.125476  3273 raft_consensus.cc:2468] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 0.
I20260709 12:24:52.126199  3322 tablet_bootstrap.cc:492] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:52.126804  3322 ts_tablet_manager.cc:1403] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.359s	user 0.030s	sys 0.018s
I20260709 12:24:52.129390  3399 consensus_queue.cc:1048] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:24:52.132452  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 43985.3us
I20260709 12:24:52.132624  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:52.133795  3718 raft_consensus.cc:2749] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.136399  3321 ts_tablet_manager.cc:1434] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.004s
I20260709 12:24:52.138660  3796 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.139293  3796 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.120551  3790 raft_consensus.cc:2804] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.140172  3790 raft_consensus.cc:493] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.140558  3790 raft_consensus.cc:3060] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.141692  3796 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
W20260709 12:24:52.149932  3015 leader_election.cc:343] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.154172  3430 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.153970  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.154835  3430 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.155561  3272 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:52.154681  3773 consensus_queue.cc:1048] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:24:52.157382  3430 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:52.158192  3697 raft_consensus.cc:493] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.158694  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:52.154628  3321 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:52.159910  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:52.167173  3697 raft_consensus.cc:515] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.165887  3200 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:52.169749  3697 leader_election.cc:290] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:52.165604  3015 leader_election.cc:304] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:52.171103  3044 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:52.172654  3773 raft_consensus.cc:2804] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.173996  3322 raft_consensus.cc:359] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.174762  3165 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:52.175017  3322 raft_consensus.cc:385] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.173019  3773 raft_consensus.cc:493] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.175474  3322 raft_consensus.cc:740] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.175810  3773 raft_consensus.cc:3060] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.176656  3322 consensus_queue.cc:260] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.179239  3697 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:52.179804  3697 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.180164  3697 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.180933  3321 tablet_bootstrap.cc:654] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.186312  3015 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:52.190130  3322 ts_tablet_manager.cc:1434] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 12:24:52.192430  3796 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:52.185222  3790 raft_consensus.cc:515] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.210729  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.210533  3775 consensus_queue.cc:1048] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:24:52.211567  3272 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:52.214114  3322 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:52.204955  3796 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.221565  3796 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.246562  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.247664  3274 raft_consensus.cc:2393] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:52.233865  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbedacd971d04ba59a5f8bbcbf37126e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:52.279611  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52738b922b3c4c1cbbe2390f6b879c49" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:52.280335  3044 raft_consensus.cc:3060] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.282668  3790 leader_election.cc:290] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:24:52.291066  2996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:52.293211  3645 raft_consensus.cc:493] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.295895  3166 leader_election.cc:304] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:52.311980  3044 raft_consensus.cc:2468] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:52.328322  3697 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.336536  3165 leader_election.cc:304] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:52.340449  3653 raft_consensus.cc:2804] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.341082  3653 raft_consensus.cc:697] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:52.306541  3796 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.342094  3653 consensus_queue.cc:237] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.343215  3796 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:52.343132  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52738b922b3c4c1cbbe2390f6b879c49" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:52.346454  3119 raft_consensus.cc:3060] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.350301  3322 tablet_bootstrap.cc:654] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.353504  3324 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:52.354111  3324 ts_tablet_manager.cc:1403] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.414s	user 0.025s	sys 0.025s
I20260709 12:24:52.319638  3645 raft_consensus.cc:515] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.359175  3697 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:52.360723  3773 raft_consensus.cc:515] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.337234  3790 raft_consensus.cc:3060] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.363521  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:52.364816  3049 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 2: Already voted for candidate 7691286241bb4eec9fd1a29b7e102d3b in this term.
I20260709 12:24:52.372398  3194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:52.372433  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:52.374784  3198 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 2: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:52.377257  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:52.378439  3271 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.384680  3790 raft_consensus.cc:2749] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:52.388583  3090 leader_election.cc:343] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.390678  3645 leader_election.cc:290] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:52.392987  3119 raft_consensus.cc:2468] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:52.394795  3774 consensus_queue.cc:1048] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:52.398140  3773 leader_election.cc:290] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:52.402428  3324 raft_consensus.cc:359] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.403259  3324 raft_consensus.cc:385] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.403571  3324 raft_consensus.cc:740] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.404814  3324 consensus_queue.cc:260] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.410977  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:52.432694  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.433528  3273 raft_consensus.cc:2468] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 0.
I20260709 12:24:52.443792  3090 leader_election.cc:304] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:52.451390  3726 raft_consensus.cc:2804] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.451823  3726 raft_consensus.cc:493] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.452167  3726 raft_consensus.cc:3060] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.454846  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:52.455863  3198 raft_consensus.cc:3060] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.459834  3321 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:52.460569  3321 ts_tablet_manager.cc:1403] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.307s	user 0.042s	sys 0.081s
I20260709 12:24:52.460836  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:52.461606  3273 raft_consensus.cc:3060] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.468091  3321 raft_consensus.cc:359] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.468953  3321 raft_consensus.cc:385] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.469322  3321 raft_consensus.cc:740] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.469081  3726 raft_consensus.cc:515] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.471647  3324 ts_tablet_manager.cc:1434] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.003s
I20260709 12:24:52.481897  3340 consensus_queue.cc:1048] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:52.470135  3321 consensus_queue.cc:260] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:52.504871  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 52737us
I20260709 12:24:52.506317  3166 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:52.508174  3430 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:52.508626  2946 catalog_manager.cc:5697] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.519116  3321 ts_tablet_manager.cc:1434] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.000s
I20260709 12:24:52.520486  3321 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:52.520476  3271 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:24:52.527935  3015 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:52.529661  3794 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.530550  3794 raft_consensus.cc:697] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:52.539710  3273 raft_consensus.cc:2468] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:52.524528  3700 consensus_queue.cc:1048] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:24:52.541800  3324 tablet_bootstrap.cc:492] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:52.545714  3198 raft_consensus.cc:2468] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 1.
I20260709 12:24:52.550012  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
W20260709 12:24:52.552685  3090 leader_election.cc:343] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:52.554570  3645 consensus_queue.cc:1048] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.555941  3726 leader_election.cc:290] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:52.558931  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:52.560446  3321 tablet_bootstrap.cc:654] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.560562  3015 leader_election.cc:304] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:52.559718  3272 raft_consensus.cc:3060] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.559545  3794 consensus_queue.cc:237] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.565821  3796 raft_consensus.cc:2804] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.577373  3796 raft_consensus.cc:697] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:24:52.578851  3796 consensus_queue.cc:237] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.591197  3324 tablet_bootstrap.cc:654] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.599051  3322 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:52.599675  3322 ts_tablet_manager.cc:1403] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.401s	user 0.015s	sys 0.015s
I20260709 12:24:52.610955  3272 raft_consensus.cc:2468] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:52.614204  3090 leader_election.cc:304] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:52.615178  3340 raft_consensus.cc:2804] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.615952  3340 raft_consensus.cc:697] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:52.622500  3322 raft_consensus.cc:359] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.623468  3322 raft_consensus.cc:385] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.617156  3340 consensus_queue.cc:237] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.623884  3322 raft_consensus.cc:740] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.636191  3322 consensus_queue.cc:260] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.649194  3322 ts_tablet_manager.cc:1434] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:24:52.650540  3322 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e: Bootstrap starting.
I20260709 12:24:52.644953  2948 catalog_manager.cc:5697] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.665689  3324 tablet_bootstrap.cc:492] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:52.666339  3324 ts_tablet_manager.cc:1403] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.001s
I20260709 12:24:52.671972  3321 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:52.672552  3321 ts_tablet_manager.cc:1403] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.015s
I20260709 12:24:52.680415  3322 tablet_bootstrap.cc:654] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.681279  3321 raft_consensus.cc:359] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.684417  3321 raft_consensus.cc:385] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.684758  3321 raft_consensus.cc:740] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.685285  3324 raft_consensus.cc:359] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.687316  3324 raft_consensus.cc:385] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.687687  3324 raft_consensus.cc:740] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.689461  3321 consensus_queue.cc:260] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.688611  3324 consensus_queue.cc:260] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.697213  3324 ts_tablet_manager.cc:1434] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 12:24:52.699532  3324 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:52.701905  3321 ts_tablet_manager.cc:1434] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:24:52.703603  3321 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:52.719911  2946 catalog_manager.cc:5697] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 1 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.725414  3322 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e: No bootstrap required, opened a new log
I20260709 12:24:52.726995  3324 tablet_bootstrap.cc:654] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.729043  3322 ts_tablet_manager.cc:1403] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.002s
I20260709 12:24:52.735067  2946 catalog_manager.cc:5697] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 0 to 2, leader changed from <none> to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.742447  3324 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:52.742995  3324 ts_tablet_manager.cc:1403] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.013s
I20260709 12:24:52.737309  3322 raft_consensus.cc:359] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.744827  3322 raft_consensus.cc:385] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.745177  3322 raft_consensus.cc:740] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.739449  3321 tablet_bootstrap.cc:654] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.745908  3324 raft_consensus.cc:359] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.746701  3324 raft_consensus.cc:385] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.747016  3324 raft_consensus.cc:740] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.747841  3324 consensus_queue.cc:260] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.748564  3322 consensus_queue.cc:260] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.750891  3324 ts_tablet_manager.cc:1434] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:52.752058  3324 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a: Bootstrap starting.
I20260709 12:24:52.755234  3322 ts_tablet_manager.cc:1434] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:24:52.754629  2945 catalog_manager.cc:5697] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 0 to 1, leader changed from <none> to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 1 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.770362  3831 consensus_queue.cc:1048] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:52.778381  2948 catalog_manager.cc:5697] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.793823  3831 raft_consensus.cc:493] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.794548  3831 raft_consensus.cc:515] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:24:52.795949  3827 raft_consensus.cc:493] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.796535  3827 raft_consensus.cc:515] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.799747  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:52.801880  3324 tablet_bootstrap.cc:654] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.802577  3831 leader_election.cc:290] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:52.806563  3044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:52.807260  3321 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:52.807305  3044 raft_consensus.cc:2468] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:52.807997  3321 ts_tablet_manager.cc:1403] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.000s
I20260709 12:24:52.810066  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352d5275a7ca43abb1b933b90dcb2960" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.810959  3273 raft_consensus.cc:2393] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 1: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:52.811247  3321 raft_consensus.cc:359] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.812059  3321 raft_consensus.cc:385] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.812364  3321 raft_consensus.cc:740] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.812644  3718 raft_consensus.cc:493] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.812587  3240 leader_election.cc:304] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:52.813158  3321 consensus_queue.cc:260] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.813465  3718 raft_consensus.cc:515] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.814255  3561 raft_consensus.cc:2804] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.826567  3321 ts_tablet_manager.cc:1434] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:24:52.826731  3561 raft_consensus.cc:493] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.827193  3561 raft_consensus.cc:3060] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.828576  3321 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:52.837394  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:52.838223  3119 raft_consensus.cc:2468] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:52.839725  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:52.840416  3119 raft_consensus.cc:2468] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:52.815719  3166 leader_election.cc:304] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:52.818768  3794 raft_consensus.cc:493] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.841041  3718 leader_election.cc:290] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:52.841693  3241 leader_election.cc:304] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:52.850903  3559 raft_consensus.cc:2804] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.852558  3321 tablet_bootstrap.cc:654] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:52.852828  3559 raft_consensus.cc:493] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.853390  3559 raft_consensus.cc:3060] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.842289  3794 raft_consensus.cc:515] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.873001  3559 raft_consensus.cc:515] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.876776  3561 raft_consensus.cc:515] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.879562  3430 consensus_queue.cc:1048] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:52.881711  3559 leader_election.cc:290] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:52.887653  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:52.900424  3047 raft_consensus.cc:2468] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 0.
I20260709 12:24:52.890066  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:52.902115  3050 raft_consensus.cc:3060] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.902107  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:52.903836  3119 raft_consensus.cc:3060] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.893814  3794 leader_election.cc:290] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:52.841833  3827 leader_election.cc:290] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:52.843500  3831 raft_consensus.cc:3060] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.896593  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.910494  3273 raft_consensus.cc:2393] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 1: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:52.913522  3050 raft_consensus.cc:2468] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:52.898795  3324 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a: No bootstrap required, opened a new log
I20260709 12:24:52.898481  3121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:52.917819  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:52.918551  3120 raft_consensus.cc:3060] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.919394  3015 leader_election.cc:304] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:52.920826  3796 raft_consensus.cc:2749] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.920868  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:52.921617  3047 raft_consensus.cc:3060] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.930665  3561 leader_election.cc:290] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:52.930231  3324 ts_tablet_manager.cc:1403] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a: Time spent bootstrapping tablet: real 0.178s	user 0.023s	sys 0.029s
I20260709 12:24:52.934666  3324 raft_consensus.cc:359] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.940618  3324 raft_consensus.cc:385] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.941054  3324 raft_consensus.cc:740] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.941850  3831 raft_consensus.cc:2749] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:52.945860  3324 consensus_queue.cc:260] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:52.949965  3324 ts_tablet_manager.cc:1434] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:24:52.937953  3321 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: No bootstrap required, opened a new log
I20260709 12:24:52.951501  3321 ts_tablet_manager.cc:1403] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.123s	user 0.031s	sys 0.018s
I20260709 12:24:52.950471  3430 raft_consensus.cc:493] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.915023  3119 raft_consensus.cc:2468] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:52.953217  3430 raft_consensus.cc:515] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.953896  3241 leader_election.cc:304] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:52.955129  3561 raft_consensus.cc:2804] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.955900  3561 raft_consensus.cc:697] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:52.956967  3321 raft_consensus.cc:359] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.957222  3561 consensus_queue.cc:237] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.959658  3049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38cbb84ab714516acb50aa88c24fab8" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:52.961578  3430 leader_election.cc:290] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:52.963899  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38cbb84ab714516acb50aa88c24fab8" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:52.964890  3273 raft_consensus.cc:2468] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:52.936733  3047 raft_consensus.cc:2468] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:52.966714  3166 leader_election.cc:304] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:52.967767  3240 leader_election.cc:304] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:24:52.968189  3430 raft_consensus.cc:2804] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:52.968699  3718 raft_consensus.cc:2804] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:52.968981  3430 raft_consensus.cc:493] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.969434  3718 raft_consensus.cc:697] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:52.969005  3796 consensus_queue.cc:1048] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:24:52.957867  3321 raft_consensus.cc:385] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:52.970809  3718 consensus_queue.cc:237] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:52.971616  3321 raft_consensus.cc:740] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:52.972491  3321 consensus_queue.cc:260] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:52.973443  3049 raft_consensus.cc:2468] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:52.969609  3430 raft_consensus.cc:3060] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:52.980482  3321 ts_tablet_manager.cc:1434] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:24:52.994503  2947 catalog_manager.cc:5697] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.002746  3120 raft_consensus.cc:2468] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:53.006696  3200 raft_consensus.cc:1275] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:53.006906  3272 raft_consensus.cc:1275] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:53.008519  3430 raft_consensus.cc:515] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:53.013417  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38cbb84ab714516acb50aa88c24fab8" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:53.014114  3273 raft_consensus.cc:3060] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:53.022818  3430 leader_election.cc:290] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:53.023326  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38cbb84ab714516acb50aa88c24fab8" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:53.024161  3050 raft_consensus.cc:3060] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:53.024335  3273 raft_consensus.cc:2468] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:53.025647  3166 leader_election.cc:304] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:53.026467  3430 raft_consensus.cc:2804] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:53.027241  3430 raft_consensus.cc:697] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:53.027243  2947 catalog_manager.cc:5697] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 0 to 1, leader changed from <none> to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 1 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.028471  3430 consensus_queue.cc:237] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:53.031766  3776 consensus_queue.cc:1048] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:53.033255  3776 consensus_queue.cc:1048] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.033941  3773 consensus_queue.cc:1048] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.043356  3050 raft_consensus.cc:2468] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:53.089234  2945 catalog_manager.cc:5697] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:53.118809  3800 consensus_queue.cc:1048] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.137063  3340 consensus_queue.cc:1048] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.187004  3831 raft_consensus.cc:493] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.187639  3831 raft_consensus.cc:515] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:53.189967  3831 leader_election.cc:290] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:53.191624  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:53.192021  3050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:53.192525  3120 raft_consensus.cc:2468] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:53.192672  3050 raft_consensus.cc:2468] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 0.
I20260709 12:24:53.194084  3166 leader_election.cc:304] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:53.195065  3831 raft_consensus.cc:2804] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:53.195523  3831 raft_consensus.cc:493] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.196089  3831 raft_consensus.cc:3060] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:53.203125  3831 raft_consensus.cc:515] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:53.205384  3831 leader_election.cc:290] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:53.205920  3047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:53.206355  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:53.206621  3047 raft_consensus.cc:3060] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:53.207017  3120 raft_consensus.cc:3060] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:53.214442  3047 raft_consensus.cc:2468] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:53.214442  3120 raft_consensus.cc:2468] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:53.215943  3165 leader_election.cc:304] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:53.216682  3831 raft_consensus.cc:2804] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:53.217381  3831 raft_consensus.cc:697] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:53.218324  3831 consensus_queue.cc:237] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:53.229061  2947 catalog_manager.cc:5697] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 1 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:53.415850  3559 consensus_queue.cc:1048] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.439214  3561 consensus_queue.cc:1048] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.439606  3718 consensus_queue.cc:1048] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.458647  3561 consensus_queue.cc:1048] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:53.463507  3831 consensus_queue.cc:1048] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:53.508060  3653 consensus_queue.cc:1048] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:53.640267  3653 consensus_queue.cc:1048] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:53.651974  3869 consensus_queue.cc:1048] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:55.049504 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
W20260709 12:24:55.084139  3089 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:24:55.091409  3089 consensus_peers.cc:597] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.094936 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:24:55.095709 29609 tablet_replica.cc:333] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.096423 29609 raft_consensus.cc:2243] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.096874 29609 raft_consensus.cc:2272] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.098963 29609 tablet_replica.cc:333] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.099573 29609 raft_consensus.cc:2243] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.099987 29609 raft_consensus.cc:2272] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.101822 29609 tablet_replica.cc:333] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.102523 29609 raft_consensus.cc:2243] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.103314 29609 raft_consensus.cc:2272] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.105954 29609 tablet_replica.cc:333] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
W20260709 12:24:55.106590  3240 consensus_peers.cc:597] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.106695 29609 raft_consensus.cc:2243] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.107709 29609 raft_consensus.cc:2272] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.109915 29609 tablet_replica.cc:333] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.110572 29609 raft_consensus.cc:2243] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.111023 29609 raft_consensus.cc:2272] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.113265 29609 tablet_replica.cc:333] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.113983 29609 raft_consensus.cc:2243] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.114952 29609 raft_consensus.cc:2272] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.117317 29609 tablet_replica.cc:333] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.118152 29609 raft_consensus.cc:2243] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.118701 29609 raft_consensus.cc:2272] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.120591 29609 tablet_replica.cc:333] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.121469 29609 raft_consensus.cc:2243] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.122011 29609 raft_consensus.cc:2272] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.124832 29609 tablet_replica.cc:333] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
W20260709 12:24:55.124969  3240 consensus_peers.cc:597] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.125651 29609 raft_consensus.cc:2243] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.126212 29609 raft_consensus.cc:2272] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.128405 29609 tablet_replica.cc:333] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.128968 29609 raft_consensus.cc:2243] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.129820 29609 raft_consensus.cc:2272] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.131973 29609 tablet_replica.cc:333] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.132685 29609 raft_consensus.cc:2243] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.133174 29609 raft_consensus.cc:2272] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.135982 29609 tablet_replica.cc:333] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.136691 29609 raft_consensus.cc:2243] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.137293 29609 raft_consensus.cc:2272] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.139324 29609 tablet_replica.cc:333] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.139952 29609 raft_consensus.cc:2243] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.140420 29609 raft_consensus.cc:2272] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.142658 29609 tablet_replica.cc:333] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.143253 29609 raft_consensus.cc:2243] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.144181 29609 raft_consensus.cc:2272] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.146512 29609 tablet_replica.cc:333] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.147322 29609 raft_consensus.cc:2243] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.148444 29609 raft_consensus.cc:2272] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:55.151023  3240 consensus_peers.cc:597] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.151494 29609 tablet_replica.cc:333] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.152245 29609 raft_consensus.cc:2243] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.152719 29609 raft_consensus.cc:2272] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.154814 29609 tablet_replica.cc:333] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.155654 29609 raft_consensus.cc:2243] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.156173 29609 raft_consensus.cc:2272] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.158243 29609 tablet_replica.cc:333] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
W20260709 12:24:55.158703  3240 consensus_peers.cc:597] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.159081 29609 raft_consensus.cc:2243] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.160300 29609 raft_consensus.cc:2272] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.162688 29609 tablet_replica.cc:333] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
W20260709 12:24:55.163044  3165 consensus_peers.cc:597] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.163417 29609 raft_consensus.cc:2243] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.163945 29609 raft_consensus.cc:2272] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.166107 29609 tablet_replica.cc:333] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.166720 29609 raft_consensus.cc:2243] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.167603 29609 raft_consensus.cc:2272] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.170140 29609 tablet_replica.cc:333] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.171034 29609 raft_consensus.cc:2243] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.171571 29609 raft_consensus.cc:2272] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.174522 29609 tablet_replica.cc:333] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.175376 29609 raft_consensus.cc:2243] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:24:55.176316  3089 consensus_peers.cc:597] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.176406 29609 raft_consensus.cc:2272] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.179186 29609 tablet_replica.cc:333] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.179909 29609 raft_consensus.cc:2243] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.180405 29609 raft_consensus.cc:2272] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.182574 29609 tablet_replica.cc:333] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.183171 29609 raft_consensus.cc:2243] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.184013 29609 raft_consensus.cc:2272] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.186306 29609 tablet_replica.cc:333] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.186996 29609 raft_consensus.cc:2243] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.187518 29609 raft_consensus.cc:2272] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:55.189488  3165 consensus_peers.cc:597] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.190285 29609 tablet_replica.cc:333] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.191047 29609 raft_consensus.cc:2243] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.191486 29609 raft_consensus.cc:2272] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.193477 29609 tablet_replica.cc:333] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.194222 29609 raft_consensus.cc:2243] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.194662 29609 raft_consensus.cc:2272] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.196851 29609 tablet_replica.cc:333] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.197546 29609 raft_consensus.cc:2243] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.198207 29609 raft_consensus.cc:2272] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.200932 29609 tablet_replica.cc:333] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.201750 29609 raft_consensus.cc:2243] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.202838 29609 raft_consensus.cc:2272] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.205153 29609 tablet_replica.cc:333] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.205921 29609 raft_consensus.cc:2243] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.206409 29609 raft_consensus.cc:2272] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.208936 29609 tablet_replica.cc:333] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.209646 29609 raft_consensus.cc:2243] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.210670 29609 raft_consensus.cc:2272] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.213042 29609 tablet_replica.cc:333] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.213665 29609 raft_consensus.cc:2243] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.214648 29609 raft_consensus.cc:2272] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.216614 29609 tablet_replica.cc:333] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.217304 29609 raft_consensus.cc:2243] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.217854 29609 raft_consensus.cc:2272] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.219944 29609 tablet_replica.cc:333] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.220551 29609 raft_consensus.cc:2243] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.221012 29609 raft_consensus.cc:2272] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.223224 29609 tablet_replica.cc:333] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.223856 29609 raft_consensus.cc:2243] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.224668 29609 raft_consensus.cc:2272] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.226985 29609 tablet_replica.cc:333] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.227490 29609 raft_consensus.cc:2243] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.228343 29609 raft_consensus.cc:2272] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.231108 29609 tablet_replica.cc:333] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.231722 29609 raft_consensus.cc:2243] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.232254 29609 raft_consensus.cc:2272] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.234320 29609 tablet_replica.cc:333] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.234800 29609 raft_consensus.cc:2243] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:24:55.235585 29609 raft_consensus.cc:2272] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.237543 29609 tablet_replica.cc:333] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.238098 29609 raft_consensus.cc:2243] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.238554 29609 raft_consensus.cc:2272] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.241304 29609 tablet_replica.cc:333] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.242117 29609 raft_consensus.cc:2243] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.242640 29609 raft_consensus.cc:2272] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:55.243321  3089 consensus_peers.cc:597] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.245013 29609 tablet_replica.cc:333] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.245702 29609 raft_consensus.cc:2243] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.246229 29609 raft_consensus.cc:2272] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.248529 29609 tablet_replica.cc:333] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.249073 29609 raft_consensus.cc:2243] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.249517 29609 raft_consensus.cc:2272] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.251595 29609 tablet_replica.cc:333] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.252187 29609 raft_consensus.cc:2243] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.252717 29609 raft_consensus.cc:2272] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.255089 29609 tablet_replica.cc:333] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.255632 29609 raft_consensus.cc:2243] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.256053 29609 raft_consensus.cc:2272] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:55.257926 29609 tablet_replica.cc:333] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: stopping tablet replica
I20260709 12:24:55.258404 29609 raft_consensus.cc:2243] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:55.258816 29609 raft_consensus.cc:2272] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:55.262701  3240 consensus_peers.cc:597] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.276755  3240 consensus_peers.cc:597] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.281255  3240 consensus_peers.cc:597] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.292809  3089 consensus_peers.cc:597] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.336725 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
W20260709 12:24:55.363968  3089 consensus_peers.cc:597] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.394788  3089 consensus_peers.cc:597] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.395344  3165 consensus_peers.cc:597] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.400112  3240 consensus_peers.cc:597] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.425660  3240 consensus_peers.cc:597] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.430404 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:55.440218  3883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.440699  3882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.449314  3165 consensus_peers.cc:597] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.450958  3089 consensus_peers.cc:597] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.454794  3240 consensus_peers.cc:597] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.455621 29609 server_base.cc:1061] running on GCE node
W20260709 12:24:55.457866  3885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.460076 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.460415 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.460666 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599895460645 us; error 0 us; skew 500 ppm
I20260709 12:24:55.461465 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.465891 29609 webserver.cc:533] Webserver started at http://127.28.234.65:43805/ using document root <none> and password file <none>
I20260709 12:24:55.466586 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.466849 29609 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:24:55.477885  3089 consensus_peers.cc:597] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.488970  3089 consensus_peers.cc:597] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.489470  3089 consensus_peers.cc:597] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.491276 29609 fs_manager.cc:714] Time spent opening directory manager: real 0.023s	user 0.008s	sys 0.012s
W20260709 12:24:55.494159  3165 consensus_peers.cc:597] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.502337  3165 consensus_peers.cc:597] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.507078  3890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.508174 29609 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.001s	sys 0.005s
I20260709 12:24:55.508641 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "7691286241bb4eec9fd1a29b7e102d3b"
format_stamp: "Formatted at 2026-07-09 12:24:39 on dist-test-slave-8c39"
I20260709 12:24:55.509218 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.522917 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.524611 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.526645 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:55.533123  3897 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:24:55.539271  3089 consensus_peers.cc:597] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.546625  3240 consensus_peers.cc:597] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:55.555703  3089 consensus_peers.cc:597] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:55.845121 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:24:55.845559 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.314s	user 0.010s	sys 0.001s
I20260709 12:24:55.845903 29609 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:24:55.852732  3897 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:55.877471  3897 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:55.878556  3897 tablet_bootstrap.cc:492] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:55.879113  3897 ts_tablet_manager.cc:1403] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.000s
I20260709 12:24:55.881316  3897 raft_consensus.cc:359] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:55.881906  3897 raft_consensus.cc:740] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.882617  3897 consensus_queue.cc:260] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:55.886648  3897 ts_tablet_manager.cc:1434] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:55.887506  3897 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:55.907491  3897 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:55.920585  3897 tablet_bootstrap.cc:492] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:55.921335  3897 ts_tablet_manager.cc:1403] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:24:55.926117  3897 raft_consensus.cc:359] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:55.932487  3897 raft_consensus.cc:740] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.933265  3897 consensus_queue.cc:260] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:55.935429  3897 ts_tablet_manager.cc:1434] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:24:55.936269  3897 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:55.963912  3897 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:55.964931  3897 tablet_bootstrap.cc:492] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:55.965620  3897 ts_tablet_manager.cc:1403] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 12:24:55.968219  3897 raft_consensus.cc:359] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:55.968959  3897 raft_consensus.cc:740] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.969692  3897 consensus_queue.cc:260] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:55.971611  3897 ts_tablet_manager.cc:1434] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:55.972404  3897 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.002658  3897 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.003858  3897 tablet_bootstrap.cc:492] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.004545  3897 ts_tablet_manager.cc:1403] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.012s
I20260709 12:24:56.007299  3897 raft_consensus.cc:359] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.008009  3897 raft_consensus.cc:740] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.008715  3897 consensus_queue.cc:260] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.010733  3897 ts_tablet_manager.cc:1434] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:56.011960  3897 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.030575  3897 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.031594  3897 tablet_bootstrap.cc:492] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.032226  3897 ts_tablet_manager.cc:1403] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:24:56.034794  3897 raft_consensus.cc:359] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.035501  3897 raft_consensus.cc:740] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.036171  3897 consensus_queue.cc:260] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.038113  3897 ts_tablet_manager.cc:1434] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:24:56.038929  3897 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.056394  3897 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.057482  3897 tablet_bootstrap.cc:492] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.058091  3897 ts_tablet_manager.cc:1403] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:24:56.060256  3897 raft_consensus.cc:359] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.060832  3897 raft_consensus.cc:740] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.061373  3897 consensus_queue.cc:260] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.062767  3897 ts_tablet_manager.cc:1434] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:24:56.063449  3897 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.077744  3897 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.078807  3897 tablet_bootstrap.cc:492] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.079525  3897 ts_tablet_manager.cc:1403] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:24:56.082002  3897 raft_consensus.cc:359] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.082661  3897 raft_consensus.cc:740] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.083415  3897 consensus_queue.cc:260] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.085529  3897 ts_tablet_manager.cc:1434] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:56.086321  3897 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.096670  3905 raft_consensus.cc:493] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.097281  3905 raft_consensus.cc:515] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.100167  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.100364  3905 leader_election.cc:290] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.104164  3897 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:56.104326  3089 leader_election.cc:336] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.104879  3089 leader_election.cc:304] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:56.105127  3897 tablet_bootstrap.cc:492] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.105695  3905 raft_consensus.cc:2749] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.105974  3897 ts_tablet_manager.cc:1403] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:24:56.108137  3897 raft_consensus.cc:359] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.108662  3897 raft_consensus.cc:740] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.109254  3897 consensus_queue.cc:260] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.110929  3897 ts_tablet_manager.cc:1434] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:24:56.111697  3897 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.124986  3897 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.125510  3869 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.126068  3897 tablet_bootstrap.cc:492] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.126199  3869 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.127647  3897 ts_tablet_manager.cc:1403] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:24:56.130035  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.130596  3897 raft_consensus.cc:359] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.131376  3897 raft_consensus.cc:740] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.132021  3869 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.132083  3897 consensus_queue.cc:260] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.134406  3897 ts_tablet_manager.cc:1434] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
W20260709 12:24:56.134722  3165 leader_election.cc:336] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.135211  3897 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.135211  3165 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.136215  3869 raft_consensus.cc:2749] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.139037  3561 raft_consensus.cc:493] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.139609  3561 raft_consensus.cc:515] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.141638  3561 leader_election.cc:290] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.143237  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.155583  3897 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.156608  3897 tablet_bootstrap.cc:492] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.157579  3897 ts_tablet_manager.cc:1403] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:24:56.160267  3897 raft_consensus.cc:359] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.160971  3897 raft_consensus.cc:740] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.161602  3897 consensus_queue.cc:260] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.163645  3897 ts_tablet_manager.cc:1434] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:24:56.164479 29609 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:24:56.164793 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.319s	user 0.271s	sys 0.006s
W20260709 12:24:56.165344  3240 leader_election.cc:336] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.165902  3240 leader_election.cc:304] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:56.165030  3897 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.167573  3561 raft_consensus.cc:2749] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.186944  3897 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.188162  3897 tablet_bootstrap.cc:492] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.188910  3897 ts_tablet_manager.cc:1403] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:24:56.191874  3897 raft_consensus.cc:359] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.192625  3897 raft_consensus.cc:740] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.193499  3897 consensus_queue.cc:260] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.196033  3897 ts_tablet_manager.cc:1434] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:24:56.196959  3897 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.207213  3561 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.207829  3561 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.209570  3864 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.210363  3864 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.212342  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.213439  3561 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.215034  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:56.215276  3240 leader_election.cc:336] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.215788  3240 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:56.215842  3198 raft_consensus.cc:2468] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:56.216620  3561 raft_consensus.cc:2749] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.217547  3241 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.226001  3561 raft_consensus.cc:2804] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.226557  3561 raft_consensus.cc:493] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.226998  3561 raft_consensus.cc:3060] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.228780  3897 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.229835  3897 tablet_bootstrap.cc:492] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.230484  3897 ts_tablet_manager.cc:1403] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.004s
I20260709 12:24:56.231419  3898 raft_consensus.cc:493] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.231986  3898 raft_consensus.cc:515] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.234149  3898 leader_election.cc:290] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:24:56.238500  3240 leader_election.cc:336] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.240496  3897 raft_consensus.cc:359] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.241262  3897 raft_consensus.cc:740] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.241461  3869 raft_consensus.cc:493] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.242251  3869 raft_consensus.cc:515] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.242127  3897 consensus_queue.cc:260] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.245538  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.246065  3897 ts_tablet_manager.cc:1434] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:24:56.247279  3897 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
W20260709 12:24:56.253729  3165 leader_election.cc:336] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.254504  3165 leader_election.cc:304] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.255926  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.258910  3653 raft_consensus.cc:2749] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.260231  3653 raft_consensus.cc:493] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.260912  3653 raft_consensus.cc:515] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.263772  3653 leader_election.cc:290] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.265407  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.266512  3898 raft_consensus.cc:493] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.267833  3898 raft_consensus.cc:515] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:56.269840  3165 leader_election.cc:336] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.270670  3898 leader_election.cc:290] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.272737  3241 leader_election.cc:304] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:56.273599  3898 raft_consensus.cc:2749] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.274928  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.275715  3897 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.276662  3897 tablet_bootstrap.cc:492] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.277577  3897 ts_tablet_manager.cc:1403] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.016s
I20260709 12:24:56.278407  3273 raft_consensus.cc:2468] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
W20260709 12:24:56.279311  3240 leader_election.cc:336] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.279801  3240 leader_election.cc:304] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:56.280856  3897 raft_consensus.cc:359] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.281773  3897 raft_consensus.cc:740] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.282737  3897 consensus_queue.cc:260] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.285332  3897 ts_tablet_manager.cc:1434] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:56.286499  3897 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.288166  3905 raft_consensus.cc:493] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.288727  3905 raft_consensus.cc:515] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.291190  3905 leader_election.cc:290] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
W20260709 12:24:56.297786  3089 leader_election.cc:336] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.300619  3864 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.301260  3869 leader_election.cc:290] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.306047  3898 raft_consensus.cc:2749] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.309850  3166 leader_election.cc:304] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.328617  3869 raft_consensus.cc:2804] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.329387  3869 raft_consensus.cc:493] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.329998  3869 raft_consensus.cc:3060] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.334048  3898 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.335041  3898 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.337670  3905 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.353179  3905 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.355522  3905 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.355592  3650 raft_consensus.cc:493] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.356155  3650 raft_consensus.cc:515] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.356554  3653 raft_consensus.cc:493] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.357038  3653 raft_consensus.cc:515] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.358335  3650 leader_election.cc:290] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.359231  3653 leader_election.cc:290] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.352236  3864 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.360517  3864 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.363360  3899 raft_consensus.cc:493] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.363912  3899 raft_consensus.cc:515] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.366402  3899 leader_election.cc:290] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.378911  3899 raft_consensus.cc:493] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.379662  3899 raft_consensus.cc:515] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.363175  3864 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.382120  3899 leader_election.cc:290] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.383522  3864 raft_consensus.cc:493] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.384143  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773e38b369a4da2ba1e065e6565c5c1" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.384019  3864 raft_consensus.cc:515] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.388952  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.390213  3864 leader_election.cc:290] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:24:56.394033  3165 leader_election.cc:336] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.407001  3561 raft_consensus.cc:515] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.454023  3561 leader_election.cc:290] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.411038  3898 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.422632  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.426321  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.428586  3943 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.455293  3272 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:56.455351  3943 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.456460  3273 raft_consensus.cc:2468] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:56.457949  3943 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.428826  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.429044  3899 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.459473  3899 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.462313  3899 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.464259  3873 raft_consensus.cc:493] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.465076  3873 raft_consensus.cc:515] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.468156  3873 leader_election.cc:290] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
W20260709 12:24:56.451288  3089 leader_election.cc:336] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.409432  3165 leader_election.cc:336] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.473843  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.477903  3274 raft_consensus.cc:2468] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:56.479036  3165 leader_election.cc:304] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:56.480051  3899 raft_consensus.cc:2749] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:56.480247  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 70891.9us
W20260709 12:24:56.481248  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 201141us
W20260709 12:24:56.486372  3089 leader_election.cc:336] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.486792  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.487599  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.492676  3198 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:56.493642  3873 raft_consensus.cc:493] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.493943  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.496059  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6a87c57d96e4b1b9bf92f2c8f31d096" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:56.494300  3873 raft_consensus.cc:515] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.496941  3122 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:56.497123  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.497787  3274 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:56.498522  3119 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:56.498826  3873 leader_election.cc:290] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:56.496655  3198 raft_consensus.cc:3060] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:56.500890  3240 leader_election.cc:336] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.505936  3561 raft_consensus.cc:493] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.506803  3561 raft_consensus.cc:515] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.508837  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.511243  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.511974  3274 raft_consensus.cc:2468] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:56.507391  3939 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.514276  3939 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.516465  3939 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.517812  3561 leader_election.cc:290] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.521442  3198 raft_consensus.cc:2468] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:24:56.523000  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773e38b369a4da2ba1e065e6565c5c1" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.523751  3090 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.524412  3873 raft_consensus.cc:493] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.525213  3650 raft_consensus.cc:2804] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.525049  3873 raft_consensus.cc:515] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.525652  3650 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.526115  3650 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.527673  3873 leader_election.cc:290] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:56.523638  3200 raft_consensus.cc:2468] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:56.530134  3241 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:56.530925  3561 raft_consensus.cc:2804] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.531276  3561 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.531623  3561 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.532392  3241 leader_election.cc:304] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:56.533321  3090 leader_election.cc:304] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.539073  3905 raft_consensus.cc:2804] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.539458  3905 raft_consensus.cc:493] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.539783  3905 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.534332  3166 leader_election.cc:304] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.542644  3943 raft_consensus.cc:2804] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.543066  3943 raft_consensus.cc:493] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.543423  3943 raft_consensus.cc:3060] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.544392  3561 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.546657  3090 leader_election.cc:304] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.552055  3873 raft_consensus.cc:2749] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.527813  3869 raft_consensus.cc:515] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:56.558748  3165 leader_election.cc:336] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.560662  3165 leader_election.cc:304] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:56.558017  3939 raft_consensus.cc:2804] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.561898  3939 raft_consensus.cc:493] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.562299  3939 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.563409  3869 leader_election.cc:290] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.565176  3905 raft_consensus.cc:515] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.557952  3899 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.554365  3897 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.566691  3899 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.567938  3897 tablet_bootstrap.cc:492] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.568981  3899 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.559252  3561 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:24:56.575258  3089 leader_election.cc:336] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.578002  3899 raft_consensus.cc:2749] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:56.580327  3240 leader_election.cc:336] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.581259  3240 leader_election.cc:336] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.575572  3939 raft_consensus.cc:515] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.584794  3939 leader_election.cc:290] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.576432  3166 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.575721  3650 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.586572  3166 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.587363  3869 raft_consensus.cc:2804] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.587666  3650 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.587752  3869 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.588516  3869 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.587718  3899 raft_consensus.cc:2804] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.589614  3899 raft_consensus.cc:493] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.590045  3899 raft_consensus.cc:3060] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.590359  3943 raft_consensus.cc:515] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.591528  3653 raft_consensus.cc:493] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.591918  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.592010  3653 raft_consensus.cc:515] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.592649  3196 raft_consensus.cc:2468] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 1.
I20260709 12:24:56.592763  3943 leader_election.cc:290] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.576134  3897 ts_tablet_manager.cc:1403] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.290s	user 0.098s	sys 0.106s
I20260709 12:24:56.594067  3653 leader_election.cc:290] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.567597  3905 leader_election.cc:290] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.596138  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.598119  3122 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:56.599886  3166 leader_election.cc:304] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.600843  3653 raft_consensus.cc:2804] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.601290  3653 raft_consensus.cc:493] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.601162  3869 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.601804  3653 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:56.608090  3089 leader_election.cc:336] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.608855  3089 leader_election.cc:336] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.576084  3241 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
W20260709 12:24:56.610463  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 58826us
W20260709 12:24:56.610870  3240 leader_election.cc:336] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.611366  3940 raft_consensus.cc:2804] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.611835  3940 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.612229  3940 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.613566  3090 leader_election.cc:304] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:56.617933  3943 raft_consensus.cc:493] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.596980  3897 raft_consensus.cc:359] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.618726  3943 raft_consensus.cc:515] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.619273  3897 raft_consensus.cc:740] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.620316  3897 consensus_queue.cc:260] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.621703  3943 leader_election.cc:290] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.622143  3241 leader_election.cc:304] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.623355  3940 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.624290  3873 raft_consensus.cc:2749] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.624480  3942 raft_consensus.cc:2804] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:56.624935  3089 leader_election.cc:336] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.625083  3942 raft_consensus.cc:697] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:56.626359  3942 consensus_queue.cc:237] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.627202  3653 raft_consensus.cc:515] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.631781  3899 raft_consensus.cc:515] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.628199  3090 leader_election.cc:304] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.632534  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.633316  3196 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:24:56.633911  3873 raft_consensus.cc:2804] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.634408  3873 raft_consensus.cc:493] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.634819  3873 raft_consensus.cc:3060] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.635708  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:56.636417  3196 raft_consensus.cc:2468] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:56.623384  3897 ts_tablet_manager.cc:1434] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:24:56.631199  3940 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.638326  3897 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
W20260709 12:24:56.641615  3089 leader_election.cc:336] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.643225  3939 raft_consensus.cc:493] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
W20260709 12:24:56.631559  3165 leader_election.cc:336] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.643852  3939 raft_consensus.cc:515] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.644387  3869 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.646029  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:56.646450  3939 leader_election.cc:290] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.646929  3120 raft_consensus.cc:2393] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 2: Already voted for candidate 91322fbc5a384d2991766a8b76dc690e in this term.
I20260709 12:24:56.648005  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:56.648654  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.649209  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "028dc6ae74914f00a3e8defc67d0bad2" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:56.649497  3273 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:56.649914  3274 raft_consensus.cc:3060] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.650481  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:56.651060  3272 raft_consensus.cc:3060] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.652594  3899 leader_election.cc:290] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.648618  3122 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.654184  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:56.655103  3271 raft_consensus.cc:2393] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 2: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:56.657882  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:56.658614  3269 raft_consensus.cc:2468] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:56.660910  3272 raft_consensus.cc:2468] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:56.661895  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03446eaea8f426dae5a2b32c67bb9cf" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:56.662490  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:56.662850  3269 raft_consensus.cc:3060] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.663206  3120 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.669080  3122 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:56.669409  3196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:56.670326  3196 raft_consensus.cc:2393] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 2: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:56.676409  3120 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
W20260709 12:24:56.676450  3240 leader_election.cc:336] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.677721  3274 raft_consensus.cc:2468] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:56.678663  3653 leader_election.cc:290] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.679242  3653 raft_consensus.cc:493] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.679682  3653 raft_consensus.cc:515] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:56.680950  3240 leader_election.cc:336] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.681613  3240 leader_election.cc:336] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.644259  3165 leader_election.cc:336] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.680459  3269 raft_consensus.cc:2468] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:56.691293  3166 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.691412  3241 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.692673  3166 leader_election.cc:304] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.693183  3942 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:56.693629  3942 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.693866  3869 raft_consensus.cc:2804] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.694967  3869 raft_consensus.cc:697] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:56.697187  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.694072  3942 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.695120  3241 leader_election.cc:304] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.696722  3869 consensus_queue.cc:237] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.702004  3166 leader_election.cc:304] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.703293  3943 raft_consensus.cc:2804] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.703733  3943 raft_consensus.cc:493] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.704159  3943 raft_consensus.cc:3060] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.703382  2945 catalog_manager.cc:5697] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 2 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.705837  3940 raft_consensus.cc:2804] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.706183  3166 leader_election.cc:304] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.706564  3940 raft_consensus.cc:493] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.692720  3953 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:56.707259  3940 raft_consensus.cc:3060] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.708623  3090 leader_election.cc:304] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.714192  3653 leader_election.cc:290] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.725508  3653 raft_consensus.cc:2804] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.726243  3653 raft_consensus.cc:697] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
W20260709 12:24:56.715037  3165 leader_election.cc:336] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.729208  3165 leader_election.cc:336] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.735239  3240 leader_election.cc:336] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.735926  3240 leader_election.cc:336] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.736330  3240 leader_election.cc:336] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.736642  3240 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:56.737313  3561 raft_consensus.cc:2749] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.738368  3241 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:56.739514  3561 raft_consensus.cc:2749] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.740684  3241 leader_election.cc:304] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.741744  3561 raft_consensus.cc:2804] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.742244  3561 raft_consensus.cc:697] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:56.732125  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:56.775028  3940 raft_consensus.cc:515] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.707813  3953 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.732074  3653 consensus_queue.cc:237] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.731585  3905 raft_consensus.cc:2804] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.707650  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:56.714093  3122 raft_consensus.cc:2468] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 1.
I20260709 12:24:56.777627  3561 consensus_queue.cc:237] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.720386  3873 raft_consensus.cc:515] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.779953  3269 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:56.786621  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 80520.8us
I20260709 12:24:56.798408  3166 leader_election.cc:304] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.746784  3943 raft_consensus.cc:515] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.784961  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:56.785398  3905 raft_consensus.cc:493] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.800294  3166 leader_election.cc:304] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.780208  3953 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.819386  3964 raft_consensus.cc:2804] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:56.819589  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.68:46779, user_credentials={real_user=slave}} blocked reactor thread for 71743.9us
I20260709 12:24:56.788344  3120 raft_consensus.cc:2468] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 1.
I20260709 12:24:56.820621  3905 raft_consensus.cc:3060] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.819941  3964 raft_consensus.cc:697] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:56.843044  3942 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.843847  3940 leader_election.cc:290] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.845342  3942 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
W20260709 12:24:56.845786  3240 leader_election.cc:336] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.845902  3959 raft_consensus.cc:2804] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.837486  3274 raft_consensus.cc:2393] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 2: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:56.867633  3959 raft_consensus.cc:697] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:56.857788  3166 leader_election.cc:304] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:56.869656  3090 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.861352  3964 consensus_queue.cc:237] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.875492  3653 raft_consensus.cc:2804] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.881248  3653 raft_consensus.cc:493] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.881703  3653 raft_consensus.cc:3060] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:56.878517  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 135899us
I20260709 12:24:56.885880  3959 consensus_queue.cc:237] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.877667  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1437a4a42b8748fc85fd7a3af43a519b" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:56.893208  3274 raft_consensus.cc:3060] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.894565  3873 leader_election.cc:290] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:56.896693  3897 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:56.885944  3948 raft_consensus.cc:2749] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.897728  3897 tablet_bootstrap.cc:492] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:56.901818  3897 ts_tablet_manager.cc:1403] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.264s	user 0.014s	sys 0.009s
I20260709 12:24:56.904181  3269 raft_consensus.cc:2468] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:24:56.904829  3897 raft_consensus.cc:359] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.890913  3905 raft_consensus.cc:515] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:56.905704  3897 raft_consensus.cc:740] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
W20260709 12:24:56.913332  3165 leader_election.cc:336] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.914255  3165 leader_election.cc:336] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.913589  3897 consensus_queue.cc:260] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:56.915004  3165 leader_election.cc:336] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.915714  3165 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.912137  3241 leader_election.cc:304] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.918038  3897 ts_tablet_manager.cc:1434] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:24:56.918478  3653 raft_consensus.cc:515] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.920984  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe20097de44ae683647a127a68de29" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:56.922571  3200 raft_consensus.cc:3060] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.923746  3090 leader_election.cc:304] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.927758  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:56.928059  3561 raft_consensus.cc:2804] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.928485  3561 raft_consensus.cc:493] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:24:56.928896  3561 raft_consensus.cc:3060] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.934474  3873 raft_consensus.cc:2804] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.935056  3873 raft_consensus.cc:697] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:56.936008  3873 consensus_queue.cc:237] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.938750  3905 leader_election.cc:290] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
W20260709 12:24:56.941285  3240 leader_election.cc:336] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:56.942333  3240 leader_election.cc:336] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.944886  3653 leader_election.cc:290] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:56.945096  3200 raft_consensus.cc:2468] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
W20260709 12:24:56.959127  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 44146.3us
I20260709 12:24:56.947077  3561 raft_consensus.cc:515] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:56.952273  2947 catalog_manager.cc:5697] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 2 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:56.963173  3165 leader_election.cc:336] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.954816  3943 leader_election.cc:290] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.966078  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca0e56a228f47efae3b79c83b301878" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:56.966857  3119 raft_consensus.cc:3060] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:56.967945  3165 leader_election.cc:336] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:56.968134  3897 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:56.951189  3869 raft_consensus.cc:2749] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.972703  3953 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:56.975337  3953 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:56.975524  3198 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 3: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:56.978169  3197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b773e38b369a4da2ba1e065e6565c5c1" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:56.979031  3197 raft_consensus.cc:3060] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.982163  3241 leader_election.cc:304] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:56.995530  3940 raft_consensus.cc:2804] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.996235  3940 raft_consensus.cc:697] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:56.998337  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb0db37449f4bdeb5c0987dd9d90865" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:24:56.999200  3195 raft_consensus.cc:3060] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:56.999253  3165 leader_election.cc:336] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:57.000231  3165 leader_election.cc:336] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:57.002949  3241 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:57.004953  3974 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.955664  3274 raft_consensus.cc:2468] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:56.997292  3940 consensus_queue.cc:237] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:56.989264  3089 leader_election.cc:336] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:57.014156  3561 leader_election.cc:290] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:57.018633  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b9dba5e63804370825d907a8132c51a" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:57.014117  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
W20260709 12:24:57.019387  3165 leader_election.cc:336] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:57.020232  3165 leader_election.cc:336] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:57.021102  3274 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a1c10036e0434e268ddde97a8a846b5a in current term 3: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
W20260709 12:24:57.025197  3165 leader_election.cc:336] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:24:57.025847  3089 leader_election.cc:336] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:57.026995  3166 leader_election.cc:304] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:57.019382  3123 raft_consensus.cc:3060] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.029543  3166 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:57.031261  3653 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:57.037339  3119 raft_consensus.cc:2468] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:57.040068  3166 leader_election.cc:304] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:57.042126  3978 raft_consensus.cc:2804] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.042744  3978 raft_consensus.cc:697] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:57.043704  3978 consensus_queue.cc:237] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:57.045805  3240 leader_election.cc:336] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:24:57.045951  3943 raft_consensus.cc:2804] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.046818  3943 raft_consensus.cc:697] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:57.047742  3943 consensus_queue.cc:237] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.071408  3197 raft_consensus.cc:2468] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:24:57.078572  3090 leader_election.cc:304] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:57.080521  3873 raft_consensus.cc:2804] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.081238  3873 raft_consensus.cc:697] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:57.082413  3873 consensus_queue.cc:237] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:57.104570  3195 raft_consensus.cc:2468] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:24:57.110143  3901 raft_consensus.cc:493] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.143577  3901 raft_consensus.cc:515] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.149832  3090 leader_election.cc:304] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:57.152491  3948 raft_consensus.cc:2804] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.152647  3901 leader_election.cc:290] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:57.152855  3123 raft_consensus.cc:2468] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:24:57.153087  3948 raft_consensus.cc:697] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:24:57.154716  3241 leader_election.cc:304] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:57.156199  3561 raft_consensus.cc:2804] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.162117  3561 raft_consensus.cc:697] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:57.162135  2948 catalog_manager.cc:5697] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 2 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:57.165305  3561 consensus_queue.cc:237] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.164887  3948 consensus_queue.cc:237] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:57.201478  3897 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:57.204046  3897 tablet_bootstrap.cc:492] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
W20260709 12:24:57.204084  3165 consensus_peers.cc:597] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.211652  3897 ts_tablet_manager.cc:1403] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.244s	user 0.019s	sys 0.010s
I20260709 12:24:57.214059  3901 raft_consensus.cc:493] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.217983  3901 raft_consensus.cc:515] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.216400  2945 catalog_manager.cc:5697] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 2 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.228338  2945 catalog_manager.cc:5697] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 2 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.243260  3897 raft_consensus.cc:359] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.245662  3897 raft_consensus.cc:740] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.261992  3195 raft_consensus.cc:1275] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:57.264699  3240 consensus_peers.cc:597] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.265300  3961 consensus_queue.cc:1048] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:57.266494  3901 leader_election.cc:290] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:24:57.265302  3240 consensus_peers.cc:597] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.271365  3901 raft_consensus.cc:493] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.272001  3901 raft_consensus.cc:515] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:57.272156  3897 consensus_queue.cc:260] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.280709  2948 catalog_manager.cc:5697] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 2 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.284838  2948 catalog_manager.cc:5697] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 2 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.286106  2948 catalog_manager.cc:5697] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 2 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.287286  2948 catalog_manager.cc:5697] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 2 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:57.293044  3165 consensus_peers.cc:597] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.279937  3274 raft_consensus.cc:1275] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.295583  2945 catalog_manager.cc:5697] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 2 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.290658  3901 leader_election.cc:290] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:57.304975  2948 catalog_manager.cc:5697] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 2 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.309984  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a66c9d2932647f78f50e3fe9b152ef0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.312704  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.317984  3119 raft_consensus.cc:1275] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.304994  3943 consensus_queue.cc:1048] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:24:57.324772  2947 catalog_manager.cc:5697] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 2 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.337347  3897 ts_tablet_manager.cc:1434] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.123s	user 0.015s	sys 0.016s
I20260709 12:24:57.338274  3897 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:57.339128  2947 catalog_manager.cc:5697] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 1 to 2, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 2 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.339407  3901 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.341900  3901 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:57.349152  3240 consensus_peers.cc:597] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:57.340034  3943 consensus_queue.cc:1048] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 12:24:57.383325  3089 consensus_peers.cc:597] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:57.386857  3269 raft_consensus.cc:1275] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.388635  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:57.391848  3089 consensus_peers.cc:597] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.417229  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a66c9d2932647f78f50e3fe9b152ef0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:57.419615  3893 leader_election.cc:304] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:57.437999  3901 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:57.455646  4004 raft_consensus.cc:493] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.456250  4004 raft_consensus.cc:515] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:57.457367  3975 consensus_queue.cc:1048] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:57.458388  4004 leader_election.cc:290] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:57.450837  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:57.465022  3194 raft_consensus.cc:1275] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.467696  3940 consensus_queue.cc:1048] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:57.454327  3901 raft_consensus.cc:2749] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:57.468708  3122 raft_consensus.cc:1275] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:57.470907  3165 consensus_peers.cc:597] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.491353  3901 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.492069  3901 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:57.482059  3961 consensus_queue.cc:1048] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:24:57.494591  3901 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:57.499723  3269 raft_consensus.cc:1275] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.500475  3122 raft_consensus.cc:1275] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.506208  3985 consensus_queue.cc:1048] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:57.506722  3240 consensus_peers.cc:597] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:57.520231  3943 consensus_queue.cc:1048] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:57.531822  3901 raft_consensus.cc:493] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.532505  3901 raft_consensus.cc:515] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.535003  3901 leader_election.cc:290] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:24:57.563567  3893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 143748us
I20260709 12:24:57.615550  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.616416  3273 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 3: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:57.630131  3272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.631043  3272 raft_consensus.cc:2393] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 2: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:57.631224  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.635334  3274 raft_consensus.cc:1275] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.630326  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.646694  3901 raft_consensus.cc:493] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.655445  3901 raft_consensus.cc:515] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:57.640952  4013 raft_consensus.cc:493] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.664206  3897 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:57.669343  3240 consensus_peers.cc:597] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.657313  3893 leader_election.cc:304] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:57.671425  4004 raft_consensus.cc:2749] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:57.679404  3897 tablet_bootstrap.cc:492] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:57.680335  3897 ts_tablet_manager.cc:1403] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.342s	user 0.028s	sys 0.022s
I20260709 12:24:57.658444  3948 consensus_queue.cc:1048] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:24:57.668325  4013 raft_consensus.cc:515] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.691875  3901 leader_election.cc:290] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:24:57.707943  3198 raft_consensus.cc:1275] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.719956  3201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:57.707324  4013 leader_election.cc:290] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:57.723011  3201 raft_consensus.cc:1275] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.725561  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:57.726958  3198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:57.728070  3198 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 3: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
W20260709 12:24:57.729648  3240 consensus_peers.cc:597] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.731277  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f380d7dc4159446e89f77c1d9f91aa6e" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:57.732232  3893 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:57.733719  3893 leader_election.cc:304] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:57.735071  3901 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.735271  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.735589  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:57.736444  3193 raft_consensus.cc:2393] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7691286241bb4eec9fd1a29b7e102d3b in current term 2: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:57.736897  3269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2205dfdff74e0da375c18cee844a6d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.742139  4013 raft_consensus.cc:2749] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:57.746544  3165 consensus_peers.cc:597] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:57.746937  3901 raft_consensus.cc:2749] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:57.747283  3165 consensus_peers.cc:597] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:57.747994  3165 consensus_peers.cc:597] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.748644  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f10a2a7c7054d938f07a61863951def" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:57.749276  3165 consensus_peers.cc:597] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:57.750017  3897 raft_consensus.cc:359] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:57.751140  3897 raft_consensus.cc:740] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.752130  3897 consensus_queue.cc:260] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:57.754535  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06665f03bd4d4cbba62e3aa2a3ef3ec0" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:57.755439  3118 raft_consensus.cc:1275] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.746588  3893 leader_election.cc:304] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:57.758711  4013 raft_consensus.cc:2749] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:57.759233  3893 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:57.760658  3893 leader_election.cc:304] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:57.760876  4013 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.761546  4004 raft_consensus.cc:2749] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:57.766283  3893 leader_election.cc:304] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:57.767342  4004 raft_consensus.cc:2749] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:57.767282  3974 consensus_queue.cc:1048] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:57.771076  4004 raft_consensus.cc:493] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.771616  4004 raft_consensus.cc:515] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.781193  3897 ts_tablet_manager.cc:1434] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.001s
I20260709 12:24:57.782109  4004 leader_election.cc:290] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:57.783386  3270 raft_consensus.cc:1275] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.783236  3897 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:57.776337  3948 consensus_queue.cc:1048] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:57.798602  4013 raft_consensus.cc:2749] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:57.790292  4022 consensus_queue.cc:1048] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:24:57.823374  3953 consensus_queue.cc:1048] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:24:57.820057  3893 leader_election.cc:304] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:57.878360  4013 raft_consensus.cc:2749] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:57.906044  4004 raft_consensus.cc:493] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:57.887259  3893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 83470.9us
I20260709 12:24:57.914525  4004 raft_consensus.cc:515] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:57.938740  4004 leader_election.cc:290] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:24:57.927945  4013 raft_consensus.cc:493] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.953504  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:57.950606  4004 raft_consensus.cc:493] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.956568  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:57.989825  3240 consensus_peers.cc:597] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:57.991531  3089 consensus_peers.cc:597] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:57.992218  3089 consensus_peers.cc:597] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:57.992908  3089 consensus_peers.cc:597] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:57.993402  3089 consensus_peers.cc:597] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:57.953271  4013 raft_consensus.cc:515] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:57.995553  4013 leader_election.cc:290] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:57.997001  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
W20260709 12:24:58.005481  3240 consensus_peers.cc:597] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.006138  3165 consensus_peers.cc:597] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.006022  4004 raft_consensus.cc:515] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
W20260709 12:24:58.014508  3089 consensus_peers.cc:597] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.021205  4004 leader_election.cc:290] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
W20260709 12:24:58.023681  3240 consensus_peers.cc:597] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.024533  3240 consensus_peers.cc:597] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.031190  3240 consensus_peers.cc:597] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.031713  3240 consensus_peers.cc:597] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.034114  3089 consensus_peers.cc:597] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.060529  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:58.065125  3119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:58.065913  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:58.066497  3120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c523bd710e24e8bb7476e4e69d4213d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:58.067195  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b29d7654294465b09126471663431e" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
W20260709 12:24:58.075397  3089 consensus_peers.cc:597] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.096258  3893 leader_election.cc:304] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:58.097746  3893 leader_election.cc:304] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:24:58.098611  4013 raft_consensus.cc:2749] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:58.099093  3893 leader_election.cc:304] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:58.099327  4013 raft_consensus.cc:2749] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:58.102077  3089 consensus_peers.cc:597] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.102603  3089 consensus_peers.cc:597] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.120036  4037 raft_consensus.cc:2749] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:58.136327  4013 raft_consensus.cc:493] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.136947  4013 raft_consensus.cc:515] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.140487  4013 leader_election.cc:290] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
W20260709 12:24:58.148980  3893 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 49976.4us
I20260709 12:24:58.150648  3893 leader_election.cc:304] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:58.151576  4013 raft_consensus.cc:2749] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:58.153635  3897 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.155405  3195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
W20260709 12:24:58.156095  3089 consensus_peers.cc:597] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.158372  3897 tablet_bootstrap.cc:492] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.158178  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74198c23b23a4969b625c2245d554fb1" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
W20260709 12:24:58.163524  3165 consensus_peers.cc:597] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.169857  3893 leader_election.cc:304] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b; no voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:58.171203  3897 ts_tablet_manager.cc:1403] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.389s	user 0.032s	sys 0.014s
I20260709 12:24:58.171309  4013 raft_consensus.cc:2749] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:58.171897  3165 consensus_peers.cc:597] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.178169  3897 raft_consensus.cc:359] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.185148  3897 raft_consensus.cc:740] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.186172  3897 consensus_queue.cc:260] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.188609  3897 ts_tablet_manager.cc:1434] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:24:58.189424  3897 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
W20260709 12:24:58.200486  3165 consensus_peers.cc:597] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.222795 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:45381
I20260709 12:24:58.226737  3897 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.227711  3897 tablet_bootstrap.cc:492] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.228371  3897 ts_tablet_manager.cc:1403] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.005s
I20260709 12:24:58.222947  4055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:45381 every 8 connection(s)
I20260709 12:24:58.233320  3897 raft_consensus.cc:359] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.234413  3897 raft_consensus.cc:740] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.235878  3897 consensus_queue.cc:260] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.239235  3897 ts_tablet_manager.cc:1434] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:24:58.247592  3897 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.301613  3950 raft_consensus.cc:3060] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.302243  3947 raft_consensus.cc:3060] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.307547  3949 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.317095  3952 raft_consensus.cc:3060] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:58.330081  3089 consensus_peers.cc:597] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:58.365694  3089 consensus_peers.cc:597] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:24:58.377250  3897 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.379241  3897 tablet_bootstrap.cc:492] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.380182  3897 ts_tablet_manager.cc:1403] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.002s
I20260709 12:24:58.384629  3897 raft_consensus.cc:359] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.391286  3897 raft_consensus.cc:740] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.392352  3897 consensus_queue.cc:260] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.395736  3897 ts_tablet_manager.cc:1434] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:24:58.396957  3897 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.401572  4056 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41381
I20260709 12:24:58.402328  4056 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:58.403611  4056 heartbeater.cc:507] Master 127.28.234.126:41381 requested a full tablet report, sending...
I20260709 12:24:58.422156  3897 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.423054  3897 tablet_bootstrap.cc:492] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.423748  3897 ts_tablet_manager.cc:1403] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 12:24:58.426314  3897 raft_consensus.cc:359] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.427019  3897 raft_consensus.cc:740] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.427928  2948 ts_manager.cc:194] Re-registered known tserver with Master: 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:58.427699  3897 consensus_queue.cc:260] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.431061  3897 ts_tablet_manager.cc:1434] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:58.431999  3897 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.432191  3949 raft_consensus.cc:3060] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.463842  3897 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.464906  3897 tablet_bootstrap.cc:492] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.467442  3897 ts_tablet_manager.cc:1403] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.008s
I20260709 12:24:58.470723  3897 raft_consensus.cc:359] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.471545  3897 raft_consensus.cc:740] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.472275  3897 consensus_queue.cc:260] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.474644  3897 ts_tablet_manager.cc:1434] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:58.475589  3897 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.498409  2948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56984
I20260709 12:24:58.502676  3897 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.503707  3897 tablet_bootstrap.cc:492] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.504431  4056 heartbeater.cc:499] Master 127.28.234.126:41381 was elected leader, sending a full tablet report...
I20260709 12:24:58.504683  3897 ts_tablet_manager.cc:1403] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.004s
I20260709 12:24:58.507501  3897 raft_consensus.cc:359] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.508193  3897 raft_consensus.cc:740] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.508816  3897 consensus_queue.cc:260] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.511108  3897 ts_tablet_manager.cc:1434] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:58.511925  3897 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.529152  3897 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.530026  3897 tablet_bootstrap.cc:492] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.530727  3897 ts_tablet_manager.cc:1403] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:24:58.532799  3897 raft_consensus.cc:359] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.533326  3897 raft_consensus.cc:740] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.534008  3897 consensus_queue.cc:260] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.535869  3897 ts_tablet_manager.cc:1434] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:24:58.536675  3897 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.545147  3949 raft_consensus.cc:3060] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.554862  3897 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.556043  3897 tablet_bootstrap.cc:492] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.556762  3897 ts_tablet_manager.cc:1403] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:24:58.559614  3897 raft_consensus.cc:359] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.560426  3897 raft_consensus.cc:740] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.561218  3897 consensus_queue.cc:260] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.564565  3897 ts_tablet_manager.cc:1434] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:58.565848  3897 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.585240  3897 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.586153  3897 tablet_bootstrap.cc:492] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.586787  3897 ts_tablet_manager.cc:1403] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 12:24:58.589473  3897 raft_consensus.cc:359] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.590168  3897 raft_consensus.cc:740] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.591138  3897 consensus_queue.cc:260] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.593231  3897 ts_tablet_manager.cc:1434] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:58.594094  3897 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.631057  3897 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.632701  3897 tablet_bootstrap.cc:492] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.643112  3897 ts_tablet_manager.cc:1403] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.009s
I20260709 12:24:58.645838  3949 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.646447  3897 raft_consensus.cc:359] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.647120  3897 raft_consensus.cc:740] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.648005  3897 consensus_queue.cc:260] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.650311  3897 ts_tablet_manager.cc:1434] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:58.651533  3897 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.675864  3897 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.676707  3653 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.677382  3897 tablet_bootstrap.cc:492] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.677333  3653 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.678195  3897 ts_tablet_manager.cc:1403] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 12:24:58.681018  3949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:58.681783  3949 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:58.681227  3653 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:58.681835  3897 raft_consensus.cc:359] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.682905  3897 raft_consensus.cc:740] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.683845  3897 consensus_queue.cc:260] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.686022  3897 ts_tablet_manager.cc:1434] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:24:58.686858  3897 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.686983  3165 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:58.694551  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:58.695386  3270 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:24:58.706521  3653 raft_consensus.cc:2804] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:58.713276  3653 raft_consensus.cc:493] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.714368  3653 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.717391  3897 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.718972  3897 tablet_bootstrap.cc:492] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.720012  3897 ts_tablet_manager.cc:1403] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.003s
I20260709 12:24:58.724059  3897 raft_consensus.cc:359] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.724995  3897 raft_consensus.cc:740] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.726079  3897 consensus_queue.cc:260] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.728762  3897 ts_tablet_manager.cc:1434] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:24:58.735747  3897 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.758385  3897 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.759491  3897 tablet_bootstrap.cc:492] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.760236  3897 ts_tablet_manager.cc:1403] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.003s
I20260709 12:24:58.767150  3897 raft_consensus.cc:359] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.767936  3897 raft_consensus.cc:740] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.778319  3897 consensus_queue.cc:260] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.788100  3897 ts_tablet_manager.cc:1434] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:24:58.789487  3897 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.792430  3653 raft_consensus.cc:515] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
W20260709 12:24:58.795183  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 107226us
I20260709 12:24:58.801182  3949 raft_consensus.cc:3060] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.809738  3653 leader_election.cc:290] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:58.814975  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:58.815729  3950 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.832326  3950 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 3.
I20260709 12:24:58.833995  3165 leader_election.cc:304] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:58.838100  3653 raft_consensus.cc:2804] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:58.838865  3653 raft_consensus.cc:697] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 3 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:58.838167  3952 raft_consensus.cc:3060] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.848304  3653 consensus_queue.cc:237] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.871093  3897 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:58.871532  4093 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.872253  3897 tablet_bootstrap.cc:492] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:58.872185  4093 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.873170  3897 ts_tablet_manager.cc:1403] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.020s
I20260709 12:24:58.875521  4093 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:58.876063  3897 raft_consensus.cc:359] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.877351  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:58.878345  3950 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 3.
I20260709 12:24:58.879801  3165 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:58.881407  4090 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:58.881913  4090 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.882398  4090 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.886272  3942 raft_consensus.cc:493] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.886986  3942 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.888712  3270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803b9d76331940da95ae7b7083092e04" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:58.889412  3270 raft_consensus.cc:3060] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.889381  3942 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:58.879776  3897 raft_consensus.cc:740] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:58.895589  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a1c10036e0434e268ddde97a8a846b5a" is_pre_election: true
I20260709 12:24:58.902235  3897 consensus_queue.cc:260] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:58.904891  3270 raft_consensus.cc:2468] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 3.
I20260709 12:24:58.910678  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:58.911578  3274 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 3.
I20260709 12:24:58.896279  4090 raft_consensus.cc:515] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:58.912897  2945 catalog_manager.cc:5697] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 3, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 3 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.914995  4090 leader_election.cc:290] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 4 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:58.904948  3897 ts_tablet_manager.cc:1434] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 12:24:58.915822  3199 raft_consensus.cc:2393] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 10d6c936aa794194a9f8ff7e5d48950a in current term 4: Already voted for candidate a1c10036e0434e268ddde97a8a846b5a in this term.
I20260709 12:24:58.916523  3897 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:58.919989  4022 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.920626  4022 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.927210  3952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
W20260709 12:24:58.929965  3089 leader_election.cc:343] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:58.933019  3940 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.933737  3940 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.936447  3940 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:58.938853  3271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:24:58.939603  3271 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.944274  3123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e" is_pre_election: true
I20260709 12:24:58.945122  3123 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:24:58.949895  3950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:58.950699  3950 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 3.
I20260709 12:24:58.956144  3241 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:24:58.956940  3940 raft_consensus.cc:2804] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:58.957412  3940 raft_consensus.cc:493] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.957814  3940 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.925630  4022 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
I20260709 12:24:58.968530  3949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4defa68b934bc2ad3ea4eb0d16d97c" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
I20260709 12:24:58.969292  3949 raft_consensus.cc:3060] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.971648  3940 raft_consensus.cc:515] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:58.977391  3940 leader_election.cc:290] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: Requested vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:24:58.988520  3240 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: a1c10036e0434e268ddde97a8a846b5a
I20260709 12:24:58.991472  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a" is_pre_election: true
I20260709 12:24:58.993172  3274 raft_consensus.cc:2393] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91322fbc5a384d2991766a8b76dc690e in current term 3: Already voted for candidate 10d6c936aa794194a9f8ff7e5d48950a in this term.
I20260709 12:24:58.994200  3271 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 4.
I20260709 12:24:58.994927  3940 raft_consensus.cc:2764] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:58.996474  3090 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e; no voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:58.997530  3166 leader_election.cc:304] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:24:59.001443  4022 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.001509  3653 raft_consensus.cc:2804] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:59.005847  3653 raft_consensus.cc:697] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 4 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:24:59.007397  3897 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:59.010572  3653 consensus_queue.cc:237] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:59.021644  3897 tablet_bootstrap.cc:492] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:59.022544  3897 ts_tablet_manager.cc:1403] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.014s
I20260709 12:24:59.026309  3897 raft_consensus.cc:359] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:59.027014  3897 raft_consensus.cc:740] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:59.027786  3897 consensus_queue.cc:260] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:24:59.032480  3897 ts_tablet_manager.cc:1434] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:24:59.030474  3118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:24:59.086678  3952 raft_consensus.cc:3060] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:59.090973  3951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b" is_pre_election: true
I20260709 12:24:59.056200  3950 raft_consensus.cc:3060] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:59.106453  3938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "960c1cb2ab5940509b7b2f09e2ec3df0" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
W20260709 12:24:59.121187  3240 leader_election.cc:343] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:59.123201  3240 leader_election.cc:343] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:59.125455  3897 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:59.140967  4022 raft_consensus.cc:2749] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:59.158211  3951 raft_consensus.cc:3060] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:59.163997  3949 raft_consensus.cc:2468] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 4.
I20260709 12:24:59.505718  3118 raft_consensus.cc:2468] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 3.
I20260709 12:24:59.568149  3945 raft_consensus.cc:1275] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:59.581688  3945 raft_consensus.cc:1275] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 4 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:59.581168  4125 consensus_queue.cc:1048] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:59.712052  3089 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.003s	sys 0.011s
W20260709 12:24:59.712476  3089 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.003s	sys 0.011s
I20260709 12:24:59.730130  3897 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:59.731009  3897 tablet_bootstrap.cc:492] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:59.731736  3897 ts_tablet_manager.cc:1403] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.607s	user 0.024s	sys 0.000s
I20260709 12:24:59.734385  3897 raft_consensus.cc:359] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:59.735123  3897 raft_consensus.cc:740] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:59.735817  3897 consensus_queue.cc:260] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:24:59.739164  3897 ts_tablet_manager.cc:1434] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:59.739979  3897 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:59.758126  3897 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:59.759295  3897 tablet_bootstrap.cc:492] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:59.760013  3897 ts_tablet_manager.cc:1403] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:24:59.762655  3897 raft_consensus.cc:359] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:59.763222  3897 raft_consensus.cc:740] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:59.763875  3897 consensus_queue.cc:260] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
W20260709 12:24:59.764431  3091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.005s	sys 0.006s
W20260709 12:24:59.764822  3091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.005s	sys 0.006s
I20260709 12:24:59.765815  3897 ts_tablet_manager.cc:1434] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:24:59.766796  3897 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
W20260709 12:24:59.794049  2945 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.026s	sys 0.007s
W20260709 12:24:59.794586  2945 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.026s	sys 0.007s
W20260709 12:24:59.796674  3090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.010s	sys 0.009s
W20260709 12:24:59.797066  3090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.010s	sys 0.009s
I20260709 12:24:59.799798  3897 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:59.800973  3897 tablet_bootstrap.cc:492] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:59.801807  3897 ts_tablet_manager.cc:1403] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.016s
I20260709 12:24:59.804803  3897 raft_consensus.cc:359] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:59.805644  3897 raft_consensus.cc:740] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:59.806483  3897 consensus_queue.cc:260] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:59.812508  3897 ts_tablet_manager.cc:1434] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:24:59.813999  3897 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:59.843667  3897 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:59.844803  3897 tablet_bootstrap.cc:492] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:59.845606  3897 ts_tablet_manager.cc:1403] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.009s
I20260709 12:24:59.855736  3897 raft_consensus.cc:359] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:59.856492  3897 raft_consensus.cc:740] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:59.857332  3897 consensus_queue.cc:260] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:59.859537  3897 ts_tablet_manager.cc:1434] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:24:59.860405  3897 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
W20260709 12:24:59.862162  3240 consensus_peers.cc:597] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:24:59.877170  3240 consensus_peers.cc:597] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:24:59.895502  3241 leader_election.cc:304] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:24:59.896522  4079 raft_consensus.cc:2804] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:59.897166  4079 raft_consensus.cc:697] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:24:59.898524  3897 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:59.899600  3897 tablet_bootstrap.cc:492] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:24:59.900296  3897 ts_tablet_manager.cc:1403] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.004s
I20260709 12:24:59.903232  3897 raft_consensus.cc:359] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:24:59.903949  3897 raft_consensus.cc:740] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:24:59.904630  3897 consensus_queue.cc:260] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
W20260709 12:24:59.916968  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 334207us
I20260709 12:24:59.919294  3897 ts_tablet_manager.cc:1434] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:24:59.920904  3897 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:24:59.923714  4121 consensus_queue.cc:1048] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:59.931347  3273 raft_consensus.cc:1275] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:59.934248  3269 raft_consensus.cc:1275] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 4 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:59.942176  4079 consensus_queue.cc:237] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:24:59.946786  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 51397.2us
I20260709 12:24:59.980564  4121 consensus_queue.cc:1048] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:59.991003  3964 consensus_queue.cc:1048] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:00.025708  3090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:46515, user_credentials={real_user=slave}} blocked reactor thread for 45673us
I20260709 12:25:00.031226  2946 catalog_manager.cc:5697] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 2 to 4, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 4 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:00.046664  3241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 86942.9us
I20260709 12:25:00.047224  2948 catalog_manager.cc:5697] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 3, leader changed from 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 3 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.059870  3897 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.064604  3897 tablet_bootstrap.cc:492] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.065359  3897 ts_tablet_manager.cc:1403] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.145s	user 0.028s	sys 0.014s
I20260709 12:25:00.068277  3897 raft_consensus.cc:359] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:00.069011  3897 raft_consensus.cc:740] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
W20260709 12:25:00.098476  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 73981.5us
I20260709 12:25:00.101660  3897 consensus_queue.cc:260] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:00.141786  3897 ts_tablet_manager.cc:1434] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.003s
I20260709 12:25:00.158355  3897 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:25:00.205806  3897 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.206859  3897 tablet_bootstrap.cc:492] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.207567  3897 ts_tablet_manager.cc:1403] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.007s
I20260709 12:25:00.210467  3897 raft_consensus.cc:359] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:00.211223  3897 raft_consensus.cc:740] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:25:00.212193  3897 consensus_queue.cc:260] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:00.233501  3897 ts_tablet_manager.cc:1434] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.004s
I20260709 12:25:00.234948  3897 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:25:00.257885  3897 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.258956  3897 tablet_bootstrap.cc:492] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.259718  3897 ts_tablet_manager.cc:1403] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 12:25:00.262456  3897 raft_consensus.cc:359] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.263216  3897 raft_consensus.cc:740] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:25:00.263916  3897 consensus_queue.cc:260] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.266633  3897 ts_tablet_manager.cc:1434] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:00.267880  3897 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:25:00.287257  3897 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.288468  3897 tablet_bootstrap.cc:492] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.289335  3897 ts_tablet_manager.cc:1403] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:25:00.292235  3897 raft_consensus.cc:359] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:00.293346  3897 raft_consensus.cc:740] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:25:00.294294  3897 consensus_queue.cc:260] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:00.297143  3897 ts_tablet_manager.cc:1434] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:00.298336  3897 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:25:00.325634  3897 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.326671  3897 tablet_bootstrap.cc:492] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.327291  3897 ts_tablet_manager.cc:1403] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 12:25:00.329273  3897 raft_consensus.cc:359] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.329873  3897 raft_consensus.cc:740] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:25:00.330574  3897 consensus_queue.cc:260] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.332435  3897 ts_tablet_manager.cc:1434] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:00.333886  3897 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:25:00.339730  3950 raft_consensus.cc:3060] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:25:00.393972  3950 raft_consensus.cc:1275] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:00.434428  4112 consensus_queue.cc:1048] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:00.495585  3119 raft_consensus.cc:1275] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:00.501644  4107 consensus_queue.cc:1048] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:00.507354  3897 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.508612  3897 tablet_bootstrap.cc:492] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.509568  3897 ts_tablet_manager.cc:1403] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.176s	user 0.051s	sys 0.061s
I20260709 12:25:00.512436  3897 raft_consensus.cc:359] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.513242  3897 raft_consensus.cc:740] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:25:00.516175  3897 consensus_queue.cc:260] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.533213  3897 ts_tablet_manager.cc:1434] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:25:00.538375  3897 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:25:00.561820  3897 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.562841  3897 tablet_bootstrap.cc:492] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.563864  3897 ts_tablet_manager.cc:1403] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:25:00.566759  3897 raft_consensus.cc:359] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.567512  3897 raft_consensus.cc:740] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:25:00.568267  3897 consensus_queue.cc:260] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.570756  3897 ts_tablet_manager.cc:1434] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:00.572206  3897 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap starting.
I20260709 12:25:00.592033  3897 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:00.593052  3897 tablet_bootstrap.cc:492] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Bootstrap complete.
I20260709 12:25:00.593967  3897 ts_tablet_manager.cc:1403] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 12:25:00.596822  3897 raft_consensus.cc:359] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.597610  3897 raft_consensus.cc:740] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Initialized, Role: FOLLOWER
I20260709 12:25:00.598367  3897 consensus_queue.cc:260] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:00.601171  3897 ts_tablet_manager.cc:1434] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:25:00.635653  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6400 after lost signal to thread 29612
W20260709 12:25:00.636965  3147 debug-util.cc:398] Leaking SignalData structure 0x7b0800224340 after lost signal to thread 2982
W20260709 12:25:00.638105  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080035d940 after lost signal to thread 3150
W20260709 12:25:00.639083  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080014d160 after lost signal to thread 3225
W20260709 12:25:00.640033  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080019b9a0 after lost signal to thread 3300
W20260709 12:25:00.641177  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7be0 after lost signal to thread 4055
I20260709 12:25:00.957882  3936 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.487090 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.539985  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41189efb74354067997fff21cfbf01f4"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:52528
I20260709 12:25:08.540781  3122 raft_consensus.cc:606] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:08.555553  3275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "a1c10036e0434e268ddde97a8a846b5a"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:08.556169  3275 raft_consensus.cc:606] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS a1c10036e0434e268ddde97a8a846b5a
I20260709 12:25:08.559067  3275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "764ad628906949f2ae30282799496feb"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:08.559607  3275 raft_consensus.cc:606] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:08.562741  3275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:08.563338  3275 raft_consensus.cc:606] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:08.565909  3275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b9543061e96403798babacc8aa31868"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:08.566533  3275 raft_consensus.cc:606] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:08.582355  3199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f"
dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:36302
I20260709 12:25:08.583148  3199 raft_consensus.cc:606] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:08.586481  3275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:08.587069  3275 raft_consensus.cc:606] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:08.588181 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:25:08.589460 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.590257 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.649353  4199 raft_consensus.cc:993] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.650068  4193 raft_consensus.cc:1081] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.652006  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:08.652693  3945 raft_consensus.cc:493] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.653119  3945 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.660501  3945 raft_consensus.cc:515] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.662981  3945 leader_election.cc:290] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:08.664067  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:08.664672  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97440158a2d84b48946fe629834bfbd5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:08.665117  3275 raft_consensus.cc:3055] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:08.665815  3122 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.665735  3275 raft_consensus.cc:740] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:08.667315  3275 consensus_queue.cc:260] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.668883  3275 raft_consensus.cc:3060] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.672674  3122 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 3.
I20260709 12:25:08.674268  3893 leader_election.cc:304] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:08.675570  3275 raft_consensus.cc:2468] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 3.
I20260709 12:25:08.676708  4205 raft_consensus.cc:2804] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:08.679179  4205 raft_consensus.cc:697] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:08.680423  4205 consensus_queue.cc:237] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.684099  4191 raft_consensus.cc:993] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.684968  4103 raft_consensus.cc:1081] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.686843  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41189efb74354067997fff21cfbf01f4"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47702
I20260709 12:25:08.687553  3945 raft_consensus.cc:493] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.687963  3945 raft_consensus.cc:3060] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.695777  3945 raft_consensus.cc:515] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.697556  3945 leader_election.cc:290] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:08.698846  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:08.699554  3122 raft_consensus.cc:3055] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:08.699784  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41189efb74354067997fff21cfbf01f4" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:08.699888  3122 raft_consensus.cc:740] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:08.699136  2947 catalog_manager.cc:5697] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 2 to 3, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 3 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.701020  3122 consensus_queue.cc:260] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.702646  3122 raft_consensus.cc:3060] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.709863  3275 raft_consensus.cc:3060] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.713888  3122 raft_consensus.cc:2468] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:08.715466  3893 leader_election.cc:304] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:08.716372  4205 raft_consensus.cc:2804] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:08.716902  4205 raft_consensus.cc:697] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:08.718576  3275 raft_consensus.cc:2468] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:08.718119  4205 consensus_queue.cc:237] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.739915  2947 catalog_manager.cc:5697] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 91322fbc5a384d2991766a8b76dc690e (127.28.234.66) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.769704  4187 raft_consensus.cc:993] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.770390  4197 raft_consensus.cc:1081] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.771942  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47706
I20260709 12:25:08.772526  3945 raft_consensus.cc:493] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.772831  3945 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.779614  3945 raft_consensus.cc:515] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:08.781092  3945 leader_election.cc:290] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:25:08.782485  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:08.782573  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3c4f3bd9c814c4bae322d5e4e11e37f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:08.783397  3122 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.783469  3199 raft_consensus.cc:3055] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:08.784042  3199 raft_consensus.cc:740] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:25:08.785487  3199 consensus_queue.cc:260] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:08.786985  3199 raft_consensus.cc:3060] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:08.793855  3122 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 3.
I20260709 12:25:08.795197  3199 raft_consensus.cc:2468] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 3.
I20260709 12:25:08.796757  3893 leader_election.cc:304] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:08.797695  4205 raft_consensus.cc:2804] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:08.798276  4205 raft_consensus.cc:697] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 3 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:08.799383  4205 consensus_queue.cc:237] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:08.823755  2947 catalog_manager.cc:5697] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 2 to 3, leader changed from a1c10036e0434e268ddde97a8a846b5a (127.28.234.67) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 3 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.853315  4193 raft_consensus.cc:993] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.854008  4199 raft_consensus.cc:1081] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.855854  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:08.856437  3945 raft_consensus.cc:493] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.856892  3945 raft_consensus.cc:3060] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.862185  3945 raft_consensus.cc:515] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.863656  3945 leader_election.cc:290] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:08.864699  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:08.864967  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff3ec9c718045a9b97d990c642c5f1f" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:08.865375  3273 raft_consensus.cc:3055] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:08.865478  3122 raft_consensus.cc:3060] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.865793  3273 raft_consensus.cc:740] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:08.866619  3273 consensus_queue.cc:260] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.867969  3273 raft_consensus.cc:3060] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.872925  3122 raft_consensus.cc:2468] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:08.874416  3893 leader_election.cc:304] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:08.875244  4205 raft_consensus.cc:2804] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:08.875697  4205 raft_consensus.cc:697] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:08.875909  3273 raft_consensus.cc:2468] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:08.876645  4205 consensus_queue.cc:237] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.882457  4193 raft_consensus.cc:993] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.883064  4199 raft_consensus.cc:1081] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:08.884965  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b9543061e96403798babacc8aa31868"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:08.885645  3945 raft_consensus.cc:493] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.886081  3945 raft_consensus.cc:3060] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.888027  2947 catalog_manager.cc:5697] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.894780  3945 raft_consensus.cc:515] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.896875  3945 leader_election.cc:290] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:08.898705  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:08.899077  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b9543061e96403798babacc8aa31868" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:08.900028  3122 raft_consensus.cc:3060] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.899310  3273 raft_consensus.cc:3055] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:08.904371  3273 raft_consensus.cc:740] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:08.905238  3273 consensus_queue.cc:260] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.906373  3273 raft_consensus.cc:3060] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.908102  3122 raft_consensus.cc:2468] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:08.909583  3893 leader_election.cc:304] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:08.910447  4205 raft_consensus.cc:2804] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:08.910945  4205 raft_consensus.cc:697] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:08.911993  4205 consensus_queue.cc:237] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:08.915479  4193 raft_consensus.cc:993] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower a1c10036e0434e268ddde97a8a846b5a to start an election
I20260709 12:25:08.916232  4193 raft_consensus.cc:1081] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer a1c10036e0434e268ddde97a8a846b5a to start an election
I20260709 12:25:08.919581  3200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419"
dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
 from {username='slave'} at 127.0.0.1:35354
I20260709 12:25:08.920156  3200 raft_consensus.cc:493] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:08.920518  3200 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.927894  3273 raft_consensus.cc:2468] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:08.931540  3200 raft_consensus.cc:515] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:08.934381  3200 leader_election.cc:290] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:25:08.937903  2947 catalog_manager.cc:5697] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.938890  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:08.939698  3273 raft_consensus.cc:3055] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:08.940088  3273 raft_consensus.cc:740] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:08.940855  3273 consensus_queue.cc:260] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:08.939392  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "a1c10036e0434e268ddde97a8a846b5a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:08.941869  3122 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.942245  3273 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:08.950438  3273 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:25:08.950655  3122 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c10036e0434e268ddde97a8a846b5a in term 2.
I20260709 12:25:08.951632  3166 leader_election.cc:304] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:08.952482  4187 raft_consensus.cc:2804] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:08.952953  4187 raft_consensus.cc:697] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Leader. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:25:08.953917  4187 consensus_queue.cc:237] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:08.965739  2947 catalog_manager.cc:5697] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to a1c10036e0434e268ddde97a8a846b5a (127.28.234.67). New cstate: current_term: 2 leader_uuid: "a1c10036e0434e268ddde97a8a846b5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.009107  4199 raft_consensus.cc:993] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:09.010071  4185 raft_consensus.cc:1081] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:09.012015  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "764ad628906949f2ae30282799496feb"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:09.012763  3945 raft_consensus.cc:493] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:09.013190  3945 raft_consensus.cc:3060] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.022220  3945 raft_consensus.cc:515] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.024710  3945 leader_election.cc:290] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:09.026199  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:09.027114  3122 raft_consensus.cc:3060] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.027611  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "764ad628906949f2ae30282799496feb" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:09.028335  3273 raft_consensus.cc:3055] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:09.028918  3273 raft_consensus.cc:740] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:09.030030  3273 consensus_queue.cc:260] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.031574  3273 raft_consensus.cc:3060] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.039765  3122 raft_consensus.cc:2468] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:09.040429  3273 raft_consensus.cc:2468] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:09.041190  3893 leader_election.cc:304] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:09.042133  4205 raft_consensus.cc:2804] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:09.042616  4205 raft_consensus.cc:697] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:09.043403  4205 consensus_queue.cc:237] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:25:09.061820  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8f40 after lost signal to thread 29612
W20260709 12:25:09.063285  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080038d620 after lost signal to thread 2982
W20260709 12:25:09.064958  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08001dae00 after lost signal to thread 3150
W20260709 12:25:09.066514  3147 debug-util.cc:398] Leaking SignalData structure 0x7b080015d740 after lost signal to thread 3225
W20260709 12:25:09.068020  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08002267c0 after lost signal to thread 3300
I20260709 12:25:09.073601  2947 catalog_manager.cc:5697] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:09.086835  3147 debug-util.cc:398] Leaking SignalData structure 0x7b08001cec20 after lost signal to thread 4055
I20260709 12:25:09.154018  3122 raft_consensus.cc:1275] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.155804  4205 consensus_queue.cc:1048] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:09.167784  3275 raft_consensus.cc:1275] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.170599  4206 consensus_queue.cc:1048] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:09.221526  3122 raft_consensus.cc:1275] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:09.223198  4206 consensus_queue.cc:1048] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:09.234225  3275 raft_consensus.cc:1275] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:09.238610  4205 consensus_queue.cc:1048] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:09.264182  3274 raft_consensus.cc:1275] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.265805  4205 consensus_queue.cc:1048] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:09.283970  3122 raft_consensus.cc:1275] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.286331  4225 consensus_queue.cc:1048] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:09.330399  3122 raft_consensus.cc:1275] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.332190  4225 consensus_queue.cc:1048] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:09.358080  3274 raft_consensus.cc:1275] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.363224  4205 consensus_queue.cc:1048] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:09.366585  3199 raft_consensus.cc:1275] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:09.374217  4225 consensus_queue.cc:1048] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:09.375162  3124 raft_consensus.cc:1275] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:09.383384  4225 consensus_queue.cc:1048] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:09.390655  3124 raft_consensus.cc:1275] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.392403  4197 consensus_queue.cc:1048] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:09.424328  3274 raft_consensus.cc:1275] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer a1c10036e0434e268ddde97a8a846b5a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.426718  4197 consensus_queue.cc:1048] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:09.446554  3124 raft_consensus.cc:1275] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.448149  4206 consensus_queue.cc:1048] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:09.480204  3274 raft_consensus.cc:1275] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:09.481626  4206 consensus_queue.cc:1048] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:09.632665 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:09.672266  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
mode: GRACEFUL
new_leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:52528
I20260709 12:25:09.672771  3122 raft_consensus.cc:606] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Received request to transfer leadership to TS 10d6c936aa794194a9f8ff7e5d48950a
I20260709 12:25:09.675781  3199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994"
dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
mode: GRACEFUL
new_leader_uuid: "91322fbc5a384d2991766a8b76dc690e"
 from {username='slave'} at 127.0.0.1:36302
I20260709 12:25:09.676637  3199 raft_consensus.cc:606] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Received request to transfer leadership to TS 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:09.679661  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:52528
I20260709 12:25:09.680263  3122 raft_consensus.cc:606] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:09.683029  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:52528
I20260709 12:25:09.683557  3122 raft_consensus.cc:606] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:09.686367  3275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:09.687017  3275 raft_consensus.cc:606] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:09.690421  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d26951aa0726479b8d555809a049d925"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
mode: GRACEFUL
new_leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:52528
I20260709 12:25:09.691118  3122 raft_consensus.cc:606] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Received request to transfer leadership to TS 10d6c936aa794194a9f8ff7e5d48950a
I20260709 12:25:09.692377 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:09.694509 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:09.695225 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:09.748488  4103 raft_consensus.cc:993] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:09.749102  4213 raft_consensus.cc:1081] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:09.750968  3950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47702
I20260709 12:25:09.751428  3950 raft_consensus.cc:493] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:09.751754  3950 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:09.759356  3950 raft_consensus.cc:515] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.761396  3950 leader_election.cc:290] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:09.762169  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:09.762894  3275 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:09.763383  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eacdbf96bb44cfeaa489486fbbc3ddf" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:09.764117  3122 raft_consensus.cc:3055] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:09.764446  3122 raft_consensus.cc:740] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:09.765337  3122 consensus_queue.cc:260] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.766945  3122 raft_consensus.cc:3060] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:09.774953  3122 raft_consensus.cc:2468] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 3.
I20260709 12:25:09.775583  3275 raft_consensus.cc:2468] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 3.
I20260709 12:25:09.776631  3893 leader_election.cc:304] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:09.777550  4206 raft_consensus.cc:2804] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:09.778281  4206 raft_consensus.cc:697] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 3 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:09.779268  4206 consensus_queue.cc:237] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.790244  2945 catalog_manager.cc:5697] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 2 to 3, leader changed from 91322fbc5a384d2991766a8b76dc690e (127.28.234.66) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 3 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.828073  4199 raft_consensus.cc:993] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:09.829895  4185 raft_consensus.cc:1081] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:09.832484  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:09.833117  3945 raft_consensus.cc:493] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:09.833503  3945 raft_consensus.cc:3060] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.840175  3945 raft_consensus.cc:515] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.841672  3945 leader_election.cc:290] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:09.842530  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:09.843114  3275 raft_consensus.cc:3055] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:09.843158  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b549db2d234b4f4f8cee3dd5878d523d" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:09.843467  3275 raft_consensus.cc:740] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:09.843847  3122 raft_consensus.cc:3060] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.844348  3275 consensus_queue.cc:260] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.845525  3275 raft_consensus.cc:3060] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.851752  3122 raft_consensus.cc:2468] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:09.852566  3275 raft_consensus.cc:2468] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:09.853940  3893 leader_election.cc:304] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:25:09.854805  4187 raft_consensus.cc:993] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a: : Instructing follower 91322fbc5a384d2991766a8b76dc690e to start an election
I20260709 12:25:09.855326  4187 raft_consensus.cc:1081] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Signalling peer 91322fbc5a384d2991766a8b76dc690e to start an election
I20260709 12:25:09.855639  4205 raft_consensus.cc:2804] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:09.856163  4205 raft_consensus.cc:697] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:09.857051  4205 consensus_queue.cc:237] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:09.857879  3122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
 from {username='slave'} at 127.0.0.1:48460
I20260709 12:25:09.858451  3122 raft_consensus.cc:493] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:09.858831  3122 raft_consensus.cc:3060] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.866756  3122 raft_consensus.cc:515] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.868561  3122 leader_election.cc:290] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:25:09.869730  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:09.870430  3200 raft_consensus.cc:3055] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:09.870731  3200 raft_consensus.cc:740] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:25:09.869517  2945 catalog_manager.cc:5697] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.871593  3200 consensus_queue.cc:260] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.873425  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d5e0281e90149f1b903270f360d0994" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:09.874177  3275 raft_consensus.cc:3060] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.874722  3200 raft_consensus.cc:3060] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.882611  3275 raft_consensus.cc:2468] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:25:09.883167  3200 raft_consensus.cc:2468] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:25:09.884886  3090 leader_election.cc:304] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:09.885802  4103 raft_consensus.cc:2804] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:09.886528  4103 raft_consensus.cc:697] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:09.887421  4103 consensus_queue.cc:237] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.900929  2945 catalog_manager.cc:5697] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 1 to 2, leader changed from a1c10036e0434e268ddde97a8a846b5a (127.28.234.67) to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 2 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:09.904662  4103 raft_consensus.cc:993] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e: : Instructing follower 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:09.905220  4191 raft_consensus.cc:1081] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Signalling peer 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:09.908162  3274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d26951aa0726479b8d555809a049d925"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:56078
I20260709 12:25:09.908705  3274 raft_consensus.cc:493] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:09.909050  3274 raft_consensus.cc:3060] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.918150  3274 raft_consensus.cc:515] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.920125  3274 leader_election.cc:290] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:25:09.920851  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:09.921540  3124 raft_consensus.cc:3055] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:09.921869  3124 raft_consensus.cc:740] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:09.922688  3124 consensus_queue.cc:260] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.924021  3124 raft_consensus.cc:3060] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.924984  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d26951aa0726479b8d555809a049d925" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:09.925617  3200 raft_consensus.cc:3060] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.932782  3200 raft_consensus.cc:2468] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:25:09.934036  3241 leader_election.cc:304] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:09.935045  4242 raft_consensus.cc:2804] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:09.936527  4242 raft_consensus.cc:697] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:09.940405  3124 raft_consensus.cc:2468] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:25:09.941928  4191 raft_consensus.cc:993] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e: : Instructing follower 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:09.942471  4103 raft_consensus.cc:1081] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Signalling peer 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:09.937569  4242 consensus_queue.cc:237] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.948302  3274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:56078
I20260709 12:25:09.948918  3274 raft_consensus.cc:493] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:09.949271  3274 raft_consensus.cc:3060] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.955736  3274 raft_consensus.cc:515] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.957347  3274 leader_election.cc:290] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:25:09.958144  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:09.957749  2945 catalog_manager.cc:5697] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 2, leader changed from 91322fbc5a384d2991766a8b76dc690e (127.28.234.66) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 2 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:09.958776  3124 raft_consensus.cc:3055] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:09.958724  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1499d010b3c3480d9be748a5943d0c21" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:09.959450  3124 raft_consensus.cc:740] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:09.959662  3200 raft_consensus.cc:3060] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.960327  3124 consensus_queue.cc:260] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.961424  3124 raft_consensus.cc:3060] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:09.966323  3200 raft_consensus.cc:2468] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:25:09.967378  3124 raft_consensus.cc:2468] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:25:09.967945  3241 leader_election.cc:304] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:09.968827  4242 raft_consensus.cc:2804] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:09.969326  4242 raft_consensus.cc:697] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:09.970191  4242 consensus_queue.cc:237] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:09.981527  2945 catalog_manager.cc:5697] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 2, leader changed from 91322fbc5a384d2991766a8b76dc690e (127.28.234.66) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 2 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.070482  4191 raft_consensus.cc:993] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:10.071094  4103 raft_consensus.cc:1081] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:10.072913  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47702
I20260709 12:25:10.073441  3945 raft_consensus.cc:493] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.073827  3945 raft_consensus.cc:3060] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.081476  3945 raft_consensus.cc:515] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:10.084125  3945 leader_election.cc:290] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:25:10.084306  3124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:10.085016  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fa2497fe6414fd5a9682b6fcb1eeea5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:10.085657  3200 raft_consensus.cc:3060] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.085363  3124 raft_consensus.cc:3055] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:10.086627  3124 raft_consensus.cc:740] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:10.087520  3124 consensus_queue.cc:260] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:10.089685  3124 raft_consensus.cc:3060] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.092823  3200 raft_consensus.cc:2468] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:10.094081  3893 leader_election.cc:304] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:10.094849  4205 raft_consensus.cc:2804] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:10.095259  4205 raft_consensus.cc:697] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:10.096127  4205 consensus_queue.cc:237] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:10.097044  3124 raft_consensus.cc:2468] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:10.107360  2945 catalog_manager.cc:5697] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 91322fbc5a384d2991766a8b76dc690e (127.28.234.66) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.257731  3124 raft_consensus.cc:1275] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:10.258996  4205 consensus_queue.cc:1048] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:10.263329  3274 raft_consensus.cc:1275] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.266224  4206 consensus_queue.cc:1048] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:10.270565  3273 raft_consensus.cc:1275] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:10.275990  4225 consensus_queue.cc:1048] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:10.282805  3274 raft_consensus.cc:1275] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.289908  3122 raft_consensus.cc:1275] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.291658  4225 consensus_queue.cc:1048] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:10.288642  4191 consensus_queue.cc:1048] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:10.332384  3200 raft_consensus.cc:1275] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.334939  4191 consensus_queue.cc:1048] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:10.410274  3200 raft_consensus.cc:1275] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.411623  4185 consensus_queue.cc:1048] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:10.414429  3124 raft_consensus.cc:1275] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.416076  4185 consensus_queue.cc:1048] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:10.430689  3122 raft_consensus.cc:1275] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.433837  4242 consensus_queue.cc:1048] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:10.446168  3200 raft_consensus.cc:1275] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.451987  4199 consensus_queue.cc:1048] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:10.540166  3199 raft_consensus.cc:1275] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.541468  4225 consensus_queue.cc:1048] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:10.551349  3119 raft_consensus.cc:1275] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:10.553392  4206 consensus_queue.cc:1048] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:10.740609 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:10.787272  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:52528
I20260709 12:25:10.787828  3122 raft_consensus.cc:606] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:10.791049  3200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419"
dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
mode: GRACEFUL
new_leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:36302
I20260709 12:25:10.791656  3200 raft_consensus.cc:606] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Received request to transfer leadership to TS 10d6c936aa794194a9f8ff7e5d48950a
I20260709 12:25:10.794772  3273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:10.795403  3273 raft_consensus.cc:606] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:10.798537  3273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "91322fbc5a384d2991766a8b76dc690e"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:10.799129  3273 raft_consensus.cc:606] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:10.801733  3200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19"
dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
mode: GRACEFUL
new_leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:36302
I20260709 12:25:10.802287  3200 raft_consensus.cc:606] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Received request to transfer leadership to TS 10d6c936aa794194a9f8ff7e5d48950a
I20260709 12:25:10.803547 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:10.804949 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:10.805830 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:10.821653  4213 raft_consensus.cc:993] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:10.822388  4257 raft_consensus.cc:1081] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:10.823940  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47702
I20260709 12:25:10.824401  3945 raft_consensus.cc:493] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.824680  3945 raft_consensus.cc:3060] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.830267  3945 raft_consensus.cc:515] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:10.832131  3945 leader_election.cc:290] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:25:10.837154  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:10.837821  3122 raft_consensus.cc:3055] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:10.838060  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a7a6e705524f76936e9871b4a350dd" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:10.837463  4187 raft_consensus.cc:993] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a: : Instructing follower 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:10.839736  3122 raft_consensus.cc:740] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:10.839845  3200 raft_consensus.cc:3060] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.840225  4187 raft_consensus.cc:1081] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Signalling peer 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:10.840778  3122 consensus_queue.cc:260] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:10.842172  3122 raft_consensus.cc:3060] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.842258  3273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:56070
I20260709 12:25:10.842943  3273 raft_consensus.cc:493] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.843315  3273 raft_consensus.cc:3060] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.849943  3122 raft_consensus.cc:2468] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:10.851948  3893 leader_election.cc:304] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:10.852294  3273 raft_consensus.cc:515] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:10.852674  4206 raft_consensus.cc:2804] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:10.853408  4206 raft_consensus.cc:697] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:10.854538  3200 raft_consensus.cc:2468] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:10.854396  4206 consensus_queue.cc:237] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:10.855659  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:10.855659  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f64d9df087d445d583410b9a3cd7ed19" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:10.858383  3122 raft_consensus.cc:3060] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.858664  3199 raft_consensus.cc:3055] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:10.858990  3199 raft_consensus.cc:740] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:25:10.859792  3199 consensus_queue.cc:260] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:10.861056  3199 raft_consensus.cc:3060] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.867079  3122 raft_consensus.cc:2468] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:25:10.868311  3241 leader_election.cc:304] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:10.869629  4199 raft_consensus.cc:2804] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:10.870937  4199 raft_consensus.cc:697] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:10.871505  3199 raft_consensus.cc:2468] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 2.
I20260709 12:25:10.854564  3273 leader_election.cc:290] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 2 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:25:10.872045  4199 consensus_queue.cc:237] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:10.885478  2945 catalog_manager.cc:5697] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 91322fbc5a384d2991766a8b76dc690e (127.28.234.66) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.902993  2947 catalog_manager.cc:5697] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 1 to 2, leader changed from a1c10036e0434e268ddde97a8a846b5a (127.28.234.67) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 2 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.947911  4273 raft_consensus.cc:993] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 91322fbc5a384d2991766a8b76dc690e to start an election
I20260709 12:25:10.948541  4273 raft_consensus.cc:1081] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 91322fbc5a384d2991766a8b76dc690e to start an election
I20260709 12:25:10.951767  3122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
 from {username='slave'} at 127.0.0.1:48448
I20260709 12:25:10.952327  3122 raft_consensus.cc:493] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.952806  3122 raft_consensus.cc:3060] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.960167  3122 raft_consensus.cc:515] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:10.962368  3122 leader_election.cc:290] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:25:10.963178  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:10.963442  3273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb08278f5a45f7af3e85e7306f7605" candidate_uuid: "91322fbc5a384d2991766a8b76dc690e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:10.963845  3200 raft_consensus.cc:3060] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.964041  3273 raft_consensus.cc:3055] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:10.964473  3273 raft_consensus.cc:740] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:10.965322  3273 consensus_queue.cc:260] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:10.966948  3273 raft_consensus.cc:3060] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.976222  3200 raft_consensus.cc:2468] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:25:10.976966  3273 raft_consensus.cc:2468] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91322fbc5a384d2991766a8b76dc690e in term 2.
I20260709 12:25:10.977734  3090 leader_election.cc:304] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91322fbc5a384d2991766a8b76dc690e, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:10.978852  4270 raft_consensus.cc:2804] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:10.979372  4270 raft_consensus.cc:697] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Becoming Leader. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:10.980262  4270 consensus_queue.cc:237] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:11.003531  2945 catalog_manager.cc:5697] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 91322fbc5a384d2991766a8b76dc690e (127.28.234.66). New cstate: current_term: 2 leader_uuid: "91322fbc5a384d2991766a8b76dc690e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.073647  4279 raft_consensus.cc:993] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a: : Instructing follower 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:11.074651  4279 raft_consensus.cc:1081] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Signalling peer 10d6c936aa794194a9f8ff7e5d48950a to start an election
I20260709 12:25:11.076231  3273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
 from {username='slave'} at 127.0.0.1:56070
I20260709 12:25:11.076856  3273 raft_consensus.cc:493] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.077327  3273 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.085776  3273 raft_consensus.cc:515] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:11.090155  3273 leader_election.cc:290] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: Requested vote from peers 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749), a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515)
I20260709 12:25:11.092065  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:11.092747  3199 raft_consensus.cc:3055] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:11.093056  3199 raft_consensus.cc:740] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1c10036e0434e268ddde97a8a846b5a, State: Running, Role: LEADER
I20260709 12:25:11.093808  3199 consensus_queue.cc:260] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:11.094992  3199 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.100076  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ebfc57c93ee42b7bed740e2958f8419" candidate_uuid: "10d6c936aa794194a9f8ff7e5d48950a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:11.100728  3122 raft_consensus.cc:3060] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.113608  3122 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 3.
I20260709 12:25:11.114966  3241 leader_election.cc:304] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:11.117470  3199 raft_consensus.cc:2468] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10d6c936aa794194a9f8ff7e5d48950a in term 3.
I20260709 12:25:11.117921  4199 raft_consensus.cc:2804] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:11.118781  4199 raft_consensus.cc:697] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 LEADER]: Becoming Leader. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:11.121429  4199 consensus_queue.cc:237] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } }
I20260709 12:25:11.131230  2945 catalog_manager.cc:5697] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a reported cstate change: term changed from 2 to 3, leader changed from a1c10036e0434e268ddde97a8a846b5a (127.28.234.67) to 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68). New cstate: current_term: 3 leader_uuid: "10d6c936aa794194a9f8ff7e5d48950a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.216145  4273 raft_consensus.cc:993] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:11.216635  4199 raft_consensus.cc:1081] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:11.218495  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:11.219111  3945 raft_consensus.cc:493] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.219470  3945 raft_consensus.cc:3060] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.227109  3945 raft_consensus.cc:515] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:11.229024  3945 leader_election.cc:290] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:25:11.229709  3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:11.229998  3275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68f410bf87dc479b968f4908ea4a1b31" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:11.230506  3199 raft_consensus.cc:3060] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.230582  3275 raft_consensus.cc:3055] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.231071  3275 raft_consensus.cc:740] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:11.231828  3275 consensus_queue.cc:260] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:11.233083  3275 raft_consensus.cc:3060] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.237821  3199 raft_consensus.cc:2468] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:11.239198  3893 leader_election.cc:304] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:11.240075  3275 raft_consensus.cc:2468] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:11.240091  4266 raft_consensus.cc:2804] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.240856  4266 raft_consensus.cc:697] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:11.241811  4266 consensus_queue.cc:237] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:11.254010  2945 catalog_manager.cc:5697] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.286847  3122 raft_consensus.cc:1275] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.288405  4266 consensus_queue.cc:1048] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.299911  3119 raft_consensus.cc:1275] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.301947  3200 raft_consensus.cc:1275] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.301914  4199 consensus_queue.cc:1048] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.311745  4266 consensus_queue.cc:1048] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.322085  3199 raft_consensus.cc:1275] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.330469  4199 consensus_queue.cc:1048] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.398298  3199 raft_consensus.cc:1275] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.399703  4270 consensus_queue.cc:1048] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.411747  3275 raft_consensus.cc:1275] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 91322fbc5a384d2991766a8b76dc690e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.414563  4292 consensus_queue.cc:1048] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.522599  3200 raft_consensus.cc:1275] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.523780  4185 consensus_queue.cc:1048] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.534878  3122 raft_consensus.cc:1275] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Refusing update from remote peer 10d6c936aa794194a9f8ff7e5d48950a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.536329  4185 consensus_queue.cc:1048] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.751217  3273 raft_consensus.cc:1275] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.752681  4206 consensus_queue.cc:1048] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.773622  3200 raft_consensus.cc:1275] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.779860  4266 consensus_queue.cc:1048] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.852941 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:12.046669  3166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:46749, user_credentials={real_user=slave}} blocked reactor thread for 138485us
W20260709 12:25:12.050103  3165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:45381, user_credentials={real_user=slave}} blocked reactor thread for 70913.1us
I20260709 12:25:12.181999  3274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:12.183156  3274 raft_consensus.cc:606] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:12.186581  3274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977"
dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:42214
I20260709 12:25:12.187155  3274 raft_consensus.cc:606] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:12.190349  3122 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20"
dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
mode: GRACEFUL
new_leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:52528
I20260709 12:25:12.191004  3122 raft_consensus.cc:606] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Received request to transfer leadership to TS 7691286241bb4eec9fd1a29b7e102d3b
I20260709 12:25:12.192638 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:12.194865 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:12.196328 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:12.199806  4273 raft_consensus.cc:993] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:12.200634  4273 raft_consensus.cc:1081] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:12.204449  3945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:12.205163  3945 raft_consensus.cc:493] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.205646  3945 raft_consensus.cc:3060] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.218353  3945 raft_consensus.cc:515] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:12.233471  3945 leader_election.cc:290] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:12.234761  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:12.235741  3122 raft_consensus.cc:3060] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.244844  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "618abe6b52674e39aa10b2e2f7a95977" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:12.245611  3274 raft_consensus.cc:3055] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.246215  3274 raft_consensus.cc:740] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:12.247277  3274 consensus_queue.cc:260] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:12.248456  3274 raft_consensus.cc:3060] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.248803  3122 raft_consensus.cc:2468] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:12.250586  3893 leader_election.cc:304] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e; no voters: 
I20260709 12:25:12.251681  4299 raft_consensus.cc:2804] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.252218  4299 raft_consensus.cc:697] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:12.253332  4299 consensus_queue.cc:237] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:12.263165  3274 raft_consensus.cc:2468] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:12.284569  2947 catalog_manager.cc:5697] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.298368  4292 raft_consensus.cc:993] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:12.299147  4292 raft_consensus.cc:1081] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:12.301458  3950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47702
I20260709 12:25:12.302155  3950 raft_consensus.cc:493] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.302618  3950 raft_consensus.cc:3060] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.309573  3950 raft_consensus.cc:515] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:12.311210  3950 leader_election.cc:290] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:12.312059  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:12.312708  3274 raft_consensus.cc:3060] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.312760  3122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127a8af49cf4394a1db83d4dcb4cf20" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91322fbc5a384d2991766a8b76dc690e"
I20260709 12:25:12.313380  3122 raft_consensus.cc:3055] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.313719  3122 raft_consensus.cc:740] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91322fbc5a384d2991766a8b76dc690e, State: Running, Role: LEADER
I20260709 12:25:12.314618  3122 consensus_queue.cc:260] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:12.315776  3122 raft_consensus.cc:3060] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.321031  3274 raft_consensus.cc:2468] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:12.322293  3893 leader_election.cc:304] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a, 7691286241bb4eec9fd1a29b7e102d3b; no voters: 
I20260709 12:25:12.323164  4225 raft_consensus.cc:2804] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.323342  3122 raft_consensus.cc:2468] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:12.323714  4225 raft_consensus.cc:697] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:12.324776  4225 consensus_queue.cc:237] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:12.335762  2947 catalog_manager.cc:5697] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 91322fbc5a384d2991766a8b76dc690e (127.28.234.66) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.662328  4273 raft_consensus.cc:993] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a: : Instructing follower 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:12.662905  4273 raft_consensus.cc:1081] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Signalling peer 7691286241bb4eec9fd1a29b7e102d3b to start an election
I20260709 12:25:12.664677  3950 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5"
dest_uuid: "7691286241bb4eec9fd1a29b7e102d3b"
 from {username='slave'} at 127.0.0.1:47696
I20260709 12:25:12.665350  3950 raft_consensus.cc:493] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:12.667382  3950 raft_consensus.cc:3060] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.675608  3950 raft_consensus.cc:515] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:12.678712  3950 leader_election.cc:290] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Requested vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68:46779)
I20260709 12:25:12.679483  3193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1c10036e0434e268ddde97a8a846b5a"
I20260709 12:25:12.679759  3274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a5ba9c7ef564ecc9bdd815ade936fb5" candidate_uuid: "7691286241bb4eec9fd1a29b7e102d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "10d6c936aa794194a9f8ff7e5d48950a"
I20260709 12:25:12.680169  3193 raft_consensus.cc:3060] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.680454  3274 raft_consensus.cc:3055] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:12.681002  3274 raft_consensus.cc:740] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 10d6c936aa794194a9f8ff7e5d48950a, State: Running, Role: LEADER
I20260709 12:25:12.681751  3274 consensus_queue.cc:260] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:12.683015  3274 raft_consensus.cc:3060] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:12.687506  3193 raft_consensus.cc:2468] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:12.689024  3893 leader_election.cc:304] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a; no voters: 
I20260709 12:25:12.690007  4225 raft_consensus.cc:2804] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:12.690623  4225 raft_consensus.cc:697] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Becoming Leader. State: Replica: 7691286241bb4eec9fd1a29b7e102d3b, State: Running, Role: LEADER
I20260709 12:25:12.691274  3274 raft_consensus.cc:2468] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7691286241bb4eec9fd1a29b7e102d3b in term 2.
I20260709 12:25:12.691491  4225 consensus_queue.cc:237] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:12.700799  3274 raft_consensus.cc:1275] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.703291  4225 consensus_queue.cc:1048] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:12.705612  2947 catalog_manager.cc:5697] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b reported cstate change: term changed from 1 to 2, leader changed from 10d6c936aa794194a9f8ff7e5d48950a (127.28.234.68) to 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65). New cstate: current_term: 2 leader_uuid: "7691286241bb4eec9fd1a29b7e102d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:12.724047  3122 raft_consensus.cc:1275] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.726238  4206 consensus_queue.cc:1048] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:12.936832  3122 raft_consensus.cc:1275] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.940171  4206 consensus_queue.cc:1048] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:12.948537  3275 raft_consensus.cc:1275] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:12.950184  4225 consensus_queue.cc:1048] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.231437  3193 raft_consensus.cc:1275] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.232615  4225 consensus_queue.cc:1048] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.242986  3274 raft_consensus.cc:1275] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Refusing update from remote peer 7691286241bb4eec9fd1a29b7e102d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:13.249004  4225 consensus_queue.cc:1048] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.281574 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.331192 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:13.332907 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:13.333694 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.380694 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.416127 29609 tablet_server.cc:179] TabletServer@127.28.234.65:45381 shutting down...
W20260709 12:25:13.426152  3240 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 244 similar messages]
W20260709 12:25:13.443866  3240 consensus_peers.cc:597] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.474546  3089 consensus_peers.cc:597] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.475302  3089 consensus_peers.cc:597] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.477308  3089 consensus_peers.cc:597] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.479162  3165 consensus_peers.cc:597] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.483856 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:25:13.485234  3089 consensus_peers.cc:597] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.486732 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.488720 29609 raft_consensus.cc:2243] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.490181 29609 raft_consensus.cc:2272] T 41189efb74354067997fff21cfbf01f4 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.495131 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.496173 29609 raft_consensus.cc:2243] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.497148 29609 raft_consensus.cc:2272] T 97440158a2d84b48946fe629834bfbd5 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.499634 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.500684 29609 raft_consensus.cc:2243] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.501371 29609 raft_consensus.cc:2272] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.507059 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.508179 29609 raft_consensus.cc:2243] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.509361 29609 raft_consensus.cc:2272] T 05a7a6e705524f76936e9871b4a350dd P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.513701 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.514988 29609 raft_consensus.cc:2243] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.515586 29609 raft_consensus.cc:2272] T ed34225837124e1b8ac0a237db1f0ead P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.519425 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.520671 29609 raft_consensus.cc:2243] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.521540 29609 raft_consensus.cc:2272] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.525542 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.526856 29609 raft_consensus.cc:2243] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.528004 29609 raft_consensus.cc:2272] T d127a8af49cf4394a1db83d4dcb4cf20 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.528654  3089 consensus_peers.cc:597] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.531901 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.532810 29609 raft_consensus.cc:2243] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.533298 29609 raft_consensus.cc:2272] T c38cbb84ab714516acb50aa88c24fab8 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.535864 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.536720 29609 raft_consensus.cc:2243] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.537312 29609 raft_consensus.cc:2272] T 6d3255b68cdc495c9a753494c3f2f2cf P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.540939 29609 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:13.541739  3165 consensus_peers.cc:597] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.542035 29609 raft_consensus.cc:2243] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.543531 29609 raft_consensus.cc:2272] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.546589  3165 consensus_peers.cc:597] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.547380 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.548436 29609 raft_consensus.cc:2243] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.549186 29609 raft_consensus.cc:2272] T b773e38b369a4da2ba1e065e6565c5c1 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.551932 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.552632 29609 raft_consensus.cc:2243] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.553148 29609 raft_consensus.cc:2272] T b03446eaea8f426dae5a2b32c67bb9cf P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.556743 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.557706 29609 raft_consensus.cc:2243] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.558984 29609 raft_consensus.cc:2272] T b549db2d234b4f4f8cee3dd5878d523d P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.559998  3240 consensus_peers.cc:597] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.562830 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.563943 29609 raft_consensus.cc:2243] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.564559 29609 raft_consensus.cc:2272] T 52738b922b3c4c1cbbe2390f6b879c49 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.568015 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.568746 29609 raft_consensus.cc:2243] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.569238 29609 raft_consensus.cc:2272] T 1785d60abe3b48a2ab7a4329aec2166a P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.571744 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.572434 29609 raft_consensus.cc:2243] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.573011 29609 raft_consensus.cc:2272] T fc4defa68b934bc2ad3ea4eb0d16d97c P 7691286241bb4eec9fd1a29b7e102d3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.575848 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.576692 29609 raft_consensus.cc:2243] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.577733 29609 raft_consensus.cc:2272] T 618abe6b52674e39aa10b2e2f7a95977 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.580900 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.581881 29609 raft_consensus.cc:2243] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.583081 29609 raft_consensus.cc:2272] T a3c4f3bd9c814c4bae322d5e4e11e37f P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.586274 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.587057 29609 raft_consensus.cc:2243] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.587668 29609 raft_consensus.cc:2272] T 0ba3c6335b4349149377369fd75c48fb P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.590266 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.591192 29609 raft_consensus.cc:2243] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.591747 29609 raft_consensus.cc:2272] T ead227dd136a401db0ffb15035d0952f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.594816 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.595695 29609 raft_consensus.cc:2243] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:13.595811  3165 consensus_peers.cc:597] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.596467 29609 raft_consensus.cc:2272] T ee2205dfdff74e0da375c18cee844a6d P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.599175  3165 consensus_peers.cc:597] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.599663 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.600422 29609 raft_consensus.cc:2243] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.600950 29609 raft_consensus.cc:2272] T 74198c23b23a4969b625c2245d554fb1 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.603498 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.604142 29609 raft_consensus.cc:2243] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.604605 29609 raft_consensus.cc:2272] T 37fe20097de44ae683647a127a68de29 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.607213 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.607883 29609 raft_consensus.cc:2243] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.609056 29609 raft_consensus.cc:2272] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.612196 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.612915 29609 raft_consensus.cc:2243] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.613560 29609 raft_consensus.cc:2272] T 3c523bd710e24e8bb7476e4e69d4213d P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.617529 29609 tablet_replica.cc:333] stopping tablet replica
W20260709 12:25:13.617933  3165 consensus_peers.cc:597] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.618304 29609 raft_consensus.cc:2243] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.618880 29609 raft_consensus.cc:2272] T bda9cc4c7e654f8d94d79671bcbf148f P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.621865 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.622695 29609 raft_consensus.cc:2243] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.623231 29609 raft_consensus.cc:2272] T f380d7dc4159446e89f77c1d9f91aa6e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.624601  3165 consensus_peers.cc:597] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.626451 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.627264 29609 raft_consensus.cc:2243] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.627763 29609 raft_consensus.cc:2272] T 028dc6ae74914f00a3e8defc67d0bad2 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.630162 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.630842 29609 raft_consensus.cc:2243] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.631287 29609 raft_consensus.cc:2272] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.633889 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.634690 29609 raft_consensus.cc:2243] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.635164 29609 raft_consensus.cc:2272] T 31b29d7654294465b09126471663431e P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.637244 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.637941 29609 raft_consensus.cc:2243] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.638803 29609 raft_consensus.cc:2272] T 9b9543061e96403798babacc8aa31868 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.641534 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.642335 29609 raft_consensus.cc:2243] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.642855 29609 raft_consensus.cc:2272] T 2f3cee2b435d4ec5be91bead992f6663 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.643275  3165 consensus_peers.cc:597] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.646586 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.647356 29609 raft_consensus.cc:2243] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.647994 29609 raft_consensus.cc:2272] T 1437a4a42b8748fc85fd7a3af43a519b P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.650823 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.651497 29609 raft_consensus.cc:2243] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.652056 29609 raft_consensus.cc:2272] T 803b9d76331940da95ae7b7083092e04 P 7691286241bb4eec9fd1a29b7e102d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.654691 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.655318 29609 raft_consensus.cc:2243] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.655892 29609 raft_consensus.cc:2272] T 3b9dba5e63804370825d907a8132c51a P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.658424 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.658982 29609 raft_consensus.cc:2243] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.660104 29609 raft_consensus.cc:2272] T 764ad628906949f2ae30282799496feb P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.662949 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.663622 29609 raft_consensus.cc:2243] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.664000 29609 raft_consensus.cc:2272] T beaeb83845184eabb73c7ed4590fa307 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.666365 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.666872 29609 raft_consensus.cc:2243] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.667294 29609 raft_consensus.cc:2272] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.669625 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.670260 29609 raft_consensus.cc:2243] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.670744 29609 raft_consensus.cc:2272] T 1f10a2a7c7054d938f07a61863951def P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.673576 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.674382 29609 raft_consensus.cc:2243] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.674993 29609 raft_consensus.cc:2272] T 1a66c9d2932647f78f50e3fe9b152ef0 P 7691286241bb4eec9fd1a29b7e102d3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.678138 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.678977 29609 raft_consensus.cc:2243] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.680085 29609 raft_consensus.cc:2272] T cff3ec9c718045a9b97d990c642c5f1f P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.682952 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.683755 29609 raft_consensus.cc:2243] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:13.684149  3165 consensus_peers.cc:597] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.684412 29609 raft_consensus.cc:2272] T 9bb0db37449f4bdeb5c0987dd9d90865 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.687345 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.687907 29609 raft_consensus.cc:2243] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.688762 29609 raft_consensus.cc:2272] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.691490 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.692183 29609 raft_consensus.cc:2243] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.693154 29609 raft_consensus.cc:2272] T 68f410bf87dc479b968f4908ea4a1b31 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.695349 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:13.696085 29609 raft_consensus.cc:2243] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.696748 29609 raft_consensus.cc:2272] T 2ca0e56a228f47efae3b79c83b301878 P 7691286241bb4eec9fd1a29b7e102d3b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.701704  3165 consensus_peers.cc:597] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.707791  3089 consensus_peers.cc:597] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.713006  3240 consensus_peers.cc:597] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.748498  3165 consensus_peers.cc:597] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.759783  3089 consensus_peers.cc:597] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.781941  3240 consensus_peers.cc:597] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.784497 29609 tablet_server.cc:196] TabletServer@127.28.234.65:45381 shutdown complete.
W20260709 12:25:13.788287  3089 consensus_peers.cc:597] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.790702  3089 consensus_peers.cc:597] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.800804  3165 consensus_peers.cc:597] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.803807  3165 consensus_peers.cc:597] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.848840  3240 consensus_peers.cc:597] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.855191  3240 consensus_peers.cc:597] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.878026  3089 consensus_peers.cc:597] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.885244 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
W20260709 12:25:13.908943  3240 consensus_peers.cc:597] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.927759  3241 consensus_peers.cc:597] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:13.938261  3240 consensus_peers.cc:597] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Couldn't send request to peer 7691286241bb4eec9fd1a29b7e102d3b. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.939965 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:13.941038 29609 tablet_replica.cc:333] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.942443 29609 raft_consensus.cc:2243] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.943620 29609 raft_consensus.cc:2272] T 352d5275a7ca43abb1b933b90dcb2960 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.946319 29609 tablet_replica.cc:333] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.947113 29609 raft_consensus.cc:2243] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.947664 29609 raft_consensus.cc:2272] T 290114d0aee44b25b8178f30491c27e2 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.949570  3241 consensus_peers.cc:597] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.950654 29609 tablet_replica.cc:333] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.951664 29609 raft_consensus.cc:2243] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.952162 29609 raft_consensus.cc:2272] T d127a8af49cf4394a1db83d4dcb4cf20 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.952751  3166 consensus_peers.cc:597] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.955493 29609 tablet_replica.cc:333] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.956275 29609 raft_consensus.cc:2243] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.956707 29609 raft_consensus.cc:2272] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.958866 29609 tablet_replica.cc:333] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.959434 29609 raft_consensus.cc:2243] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.960567 29609 raft_consensus.cc:2272] T ead227dd136a401db0ffb15035d0952f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.963557 29609 tablet_replica.cc:333] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.964406 29609 raft_consensus.cc:2243] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.964958 29609 raft_consensus.cc:2272] T 31b29d7654294465b09126471663431e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.967254 29609 tablet_replica.cc:333] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.967921 29609 raft_consensus.cc:2243] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.969264 29609 raft_consensus.cc:2272] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.972332 29609 tablet_replica.cc:333] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.973167 29609 raft_consensus.cc:2243] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.974351 29609 raft_consensus.cc:2272] T b773e38b369a4da2ba1e065e6565c5c1 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.977272 29609 tablet_replica.cc:333] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.978346 29609 raft_consensus.cc:2243] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:13.979071 29609 raft_consensus.cc:2272] T c54168825dc646d982d2ba4557205159 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:13.982882 29609 tablet_replica.cc:333] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.984028 29609 raft_consensus.cc:2243] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.985425 29609 raft_consensus.cc:2272] T ed34225837124e1b8ac0a237db1f0ead P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:13.988845  3241 consensus_peers.cc:597] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:13.994654 29609 tablet_replica.cc:333] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:13.996068 29609 raft_consensus.cc:2243] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:13.997918 29609 raft_consensus.cc:2272] T 9bb0db37449f4bdeb5c0987dd9d90865 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.001405 29609 tablet_replica.cc:333] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.002858 29609 raft_consensus.cc:2243] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.004261 29609 raft_consensus.cc:2272] T 3c523bd710e24e8bb7476e4e69d4213d P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.008122 29609 tablet_replica.cc:333] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.008982 29609 raft_consensus.cc:2243] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.009616 29609 raft_consensus.cc:2272] T f64d9df087d445d583410b9a3cd7ed19 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.013888  3241 consensus_peers.cc:597] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.016713 29609 tablet_replica.cc:333] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.017843 29609 raft_consensus.cc:2243] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.018535 29609 raft_consensus.cc:2272] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.019275  3166 consensus_peers.cc:597] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.022135 29609 tablet_replica.cc:333] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.022976 29609 raft_consensus.cc:2243] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.023554 29609 raft_consensus.cc:2272] T 401c3e208635420ea50828b07a684567 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.026898 29609 tablet_replica.cc:333] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.027807 29609 raft_consensus.cc:2243] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.028451 29609 raft_consensus.cc:2272] T 1f10a2a7c7054d938f07a61863951def P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.031603 29609 tablet_replica.cc:333] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.032524 29609 raft_consensus.cc:2243] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.033823 29609 raft_consensus.cc:2272] T bbedacd971d04ba59a5f8bbcbf37126e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.036795 29609 tablet_replica.cc:333] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.037530 29609 raft_consensus.cc:2243] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.038081 29609 raft_consensus.cc:2272] T 1a66c9d2932647f78f50e3fe9b152ef0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.041100 29609 tablet_replica.cc:333] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.042035 29609 raft_consensus.cc:2243] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.042601 29609 raft_consensus.cc:2272] T 1499d010b3c3480d9be748a5943d0c21 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.044950 29609 tablet_replica.cc:333] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.045675 29609 raft_consensus.cc:2243] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.046241 29609 raft_consensus.cc:2272] T 52738b922b3c4c1cbbe2390f6b879c49 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.048484 29609 tablet_replica.cc:333] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.049297 29609 raft_consensus.cc:2243] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.049970 29609 raft_consensus.cc:2272] T d26951aa0726479b8d555809a049d925 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.052640 29609 tablet_replica.cc:333] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.053287 29609 raft_consensus.cc:2243] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.054541 29609 raft_consensus.cc:2272] T 43068fdfca3b412f8dce5d7ac88d3be0 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.064604 29609 tablet_replica.cc:333] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.065372 29609 raft_consensus.cc:2243] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.065995 29609 raft_consensus.cc:2272] T b549db2d234b4f4f8cee3dd5878d523d P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.068595 29609 tablet_replica.cc:333] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.069322 29609 raft_consensus.cc:2243] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.069960 29609 raft_consensus.cc:2272] T 02a818fbb8d34fd098340d5f6167e8d1 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.071739  3241 consensus_peers.cc:597] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.072844 29609 tablet_replica.cc:333] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.073516 29609 raft_consensus.cc:2243] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.074048 29609 raft_consensus.cc:2272] T 2ca0e56a228f47efae3b79c83b301878 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.076347 29609 tablet_replica.cc:333] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.076932 29609 raft_consensus.cc:2243] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.077379 29609 raft_consensus.cc:2272] T 4ebfc57c93ee42b7bed740e2958f8419 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.079770 29609 tablet_replica.cc:333] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.080339 29609 raft_consensus.cc:2243] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.080765 29609 raft_consensus.cc:2272] T 41189efb74354067997fff21cfbf01f4 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.083367 29609 tablet_replica.cc:333] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.083959 29609 raft_consensus.cc:2243] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.084761 29609 raft_consensus.cc:2272] T b4bb08278f5a45f7af3e85e7306f7605 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.087280 29609 tablet_replica.cc:333] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.088064 29609 raft_consensus.cc:2243] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.089269 29609 raft_consensus.cc:2272] T bda9cc4c7e654f8d94d79671bcbf148f P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.093534 29609 tablet_replica.cc:333] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.094463 29609 raft_consensus.cc:2243] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.095405 29609 raft_consensus.cc:2272] T f380d7dc4159446e89f77c1d9f91aa6e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.098527 29609 tablet_replica.cc:333] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.099538 29609 raft_consensus.cc:2243] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.100234 29609 raft_consensus.cc:2272] T cff3ec9c718045a9b97d990c642c5f1f P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.103322 29609 tablet_replica.cc:333] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.104144 29609 raft_consensus.cc:2243] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.105315 29609 raft_consensus.cc:2272] T 6d5e0281e90149f1b903270f360d0994 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.108319 29609 tablet_replica.cc:333] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.108940 29609 raft_consensus.cc:2243] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.109429 29609 raft_consensus.cc:2272] T 05a7a6e705524f76936e9871b4a350dd P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.111626 29609 tablet_replica.cc:333] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.112258 29609 raft_consensus.cc:2243] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.112758 29609 raft_consensus.cc:2272] T 764ad628906949f2ae30282799496feb P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.115022 29609 tablet_replica.cc:333] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.115605 29609 raft_consensus.cc:2243] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.116449 29609 raft_consensus.cc:2272] T 2f3cee2b435d4ec5be91bead992f6663 P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.118943 29609 tablet_replica.cc:333] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.119468 29609 raft_consensus.cc:2243] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.120049 29609 raft_consensus.cc:2272] T 3b9dba5e63804370825d907a8132c51a P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.122372 29609 tablet_replica.cc:333] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.123474 29609 raft_consensus.cc:2243] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.123977 29609 raft_consensus.cc:2272] T 9b9543061e96403798babacc8aa31868 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.126858 29609 tablet_replica.cc:333] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.127679 29609 raft_consensus.cc:2243] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.128803 29609 raft_consensus.cc:2272] T beaeb83845184eabb73c7ed4590fa307 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.131915 29609 tablet_replica.cc:333] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.132706 29609 raft_consensus.cc:2243] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.133690 29609 raft_consensus.cc:2272] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.136710 29609 tablet_replica.cc:333] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.137478 29609 raft_consensus.cc:2243] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.138125 29609 raft_consensus.cc:2272] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.140406  3166 consensus_peers.cc:597] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.141062 29609 tablet_replica.cc:333] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.141741 29609 raft_consensus.cc:2243] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.142307 29609 raft_consensus.cc:2272] T 618abe6b52674e39aa10b2e2f7a95977 P 91322fbc5a384d2991766a8b76dc690e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.144874 29609 tablet_replica.cc:333] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.145437 29609 raft_consensus.cc:2243] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.146054 29609 raft_consensus.cc:2272] T a3c4f3bd9c814c4bae322d5e4e11e37f P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.148223 29609 tablet_replica.cc:333] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.148804 29609 raft_consensus.cc:2243] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.149305 29609 raft_consensus.cc:2272] T 97440158a2d84b48946fe629834bfbd5 P 91322fbc5a384d2991766a8b76dc690e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.151508 29609 tablet_replica.cc:333] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e: stopping tablet replica
I20260709 12:25:14.152050 29609 raft_consensus.cc:2243] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.152557 29609 raft_consensus.cc:2272] T 1f5683a9c6a043ba9703ca5df5b58e5e P 91322fbc5a384d2991766a8b76dc690e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.207899  3166 consensus_peers.cc:597] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.209978  3241 consensus_peers.cc:597] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.224000  3241 consensus_peers.cc:597] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.225485  3166 consensus_peers.cc:597] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.228665  3241 consensus_peers.cc:597] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.272167  3241 consensus_peers.cc:597] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.275709  3166 consensus_peers.cc:597] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.298961 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
W20260709 12:25:14.368165  3241 consensus_peers.cc:597] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.378039  3241 consensus_peers.cc:597] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Couldn't send request to peer 91322fbc5a384d2991766a8b76dc690e. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.421020 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
W20260709 12:25:14.463303  3241 consensus_peers.cc:597] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.492450 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:14.493530 29609 tablet_replica.cc:333] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.494704 29609 raft_consensus.cc:2243] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.495867 29609 raft_consensus.cc:2272] T 31b29d7654294465b09126471663431e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.498845 29609 tablet_replica.cc:333] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.499869 29609 raft_consensus.cc:2243] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.501055 29609 raft_consensus.cc:2272] T c38cbb84ab714516acb50aa88c24fab8 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.503830  3241 consensus_peers.cc:597] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.504186 29609 tablet_replica.cc:333] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.505093 29609 raft_consensus.cc:2243] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.505647 29609 raft_consensus.cc:2272] T 352d5275a7ca43abb1b933b90dcb2960 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.508003 29609 tablet_replica.cc:333] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.508810 29609 raft_consensus.cc:2243] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.509374 29609 raft_consensus.cc:2272] T 37fe20097de44ae683647a127a68de29 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.511951 29609 tablet_replica.cc:333] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.512580 29609 raft_consensus.cc:2243] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.513401 29609 raft_consensus.cc:2272] T 290114d0aee44b25b8178f30491c27e2 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.516242 29609 tablet_replica.cc:333] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.517076 29609 raft_consensus.cc:2243] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.518180 29609 raft_consensus.cc:2272] T b03446eaea8f426dae5a2b32c67bb9cf P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.521056 29609 tablet_replica.cc:333] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.521932 29609 raft_consensus.cc:2243] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.522488 29609 raft_consensus.cc:2272] T 43068fdfca3b412f8dce5d7ac88d3be0 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.525305 29609 tablet_replica.cc:333] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.526160 29609 raft_consensus.cc:2243] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.527228 29609 raft_consensus.cc:2272] T 6d3255b68cdc495c9a753494c3f2f2cf P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.529233 29609 tablet_replica.cc:333] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.529927 29609 raft_consensus.cc:2243] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.530735 29609 raft_consensus.cc:2272] T 3c523bd710e24e8bb7476e4e69d4213d P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.532783 29609 tablet_replica.cc:333] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.533427 29609 raft_consensus.cc:2243] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.533948 29609 raft_consensus.cc:2272] T f64d9df087d445d583410b9a3cd7ed19 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.536062 29609 tablet_replica.cc:333] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.536690 29609 raft_consensus.cc:2243] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.537218 29609 raft_consensus.cc:2272] T ed34225837124e1b8ac0a237db1f0ead P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.539913 29609 tablet_replica.cc:333] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.540776 29609 raft_consensus.cc:2243] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:14.541043  3241 consensus_peers.cc:597] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.541376 29609 raft_consensus.cc:2272] T 05a7a6e705524f76936e9871b4a350dd P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.543792 29609 tablet_replica.cc:333] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.544521 29609 raft_consensus.cc:2243] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.545010 29609 raft_consensus.cc:2272] T beaeb83845184eabb73c7ed4590fa307 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.547242 29609 tablet_replica.cc:333] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.547890 29609 raft_consensus.cc:2243] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.548492 29609 raft_consensus.cc:2272] T b6a87c57d96e4b1b9bf92f2c8f31d096 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.550750 29609 tablet_replica.cc:333] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.551400 29609 raft_consensus.cc:2243] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.551898 29609 raft_consensus.cc:2272] T bbedacd971d04ba59a5f8bbcbf37126e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.554114 29609 tablet_replica.cc:333] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.554729 29609 raft_consensus.cc:2243] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.555249 29609 raft_consensus.cc:2272] T 1499d010b3c3480d9be748a5943d0c21 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.557471 29609 tablet_replica.cc:333] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.558171 29609 raft_consensus.cc:2243] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.558651 29609 raft_consensus.cc:2272] T 9bb0db37449f4bdeb5c0987dd9d90865 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.560953 29609 tablet_replica.cc:333] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.561556 29609 raft_consensus.cc:2243] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.562069 29609 raft_consensus.cc:2272] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.564074 29609 tablet_replica.cc:333] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.564671 29609 raft_consensus.cc:2243] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.565551 29609 raft_consensus.cc:2272] T 52738b922b3c4c1cbbe2390f6b879c49 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.568307 29609 tablet_replica.cc:333] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.569002 29609 raft_consensus.cc:2243] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.569525 29609 raft_consensus.cc:2272] T d26951aa0726479b8d555809a049d925 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.571914 29609 tablet_replica.cc:333] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.572546 29609 raft_consensus.cc:2243] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.573076 29609 raft_consensus.cc:2272] T 02a818fbb8d34fd098340d5f6167e8d1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.574473  3241 consensus_peers.cc:597] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.575663 29609 tablet_replica.cc:333] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.576354 29609 raft_consensus.cc:2243] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.577168 29609 raft_consensus.cc:2272] T 2ca0e56a228f47efae3b79c83b301878 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.579602 29609 tablet_replica.cc:333] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.580328 29609 raft_consensus.cc:2243] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.581002 29609 raft_consensus.cc:2272] T 4ebfc57c93ee42b7bed740e2958f8419 P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.583738 29609 tablet_replica.cc:333] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.584407 29609 raft_consensus.cc:2243] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.584810 29609 raft_consensus.cc:2272] T 68f410bf87dc479b968f4908ea4a1b31 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.586964 29609 tablet_replica.cc:333] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.587544 29609 raft_consensus.cc:2243] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.588153 29609 raft_consensus.cc:2272] T 6d5e0281e90149f1b903270f360d0994 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.588105  4336 raft_consensus.cc:493] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.588845  4336 raft_consensus.cc:515] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:14.591342  4336 leader_election.cc:290] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:14.591722 29609 tablet_replica.cc:333] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.592643 29609 raft_consensus.cc:2243] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.593746 29609 raft_consensus.cc:2272] T 0ba3c6335b4349149377369fd75c48fb P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.595604  3240 leader_election.cc:336] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:25:14.596335 29609 tablet_replica.cc:333] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.597289 29609 raft_consensus.cc:2243] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:14.597460  3241 leader_election.cc:336] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111)
I20260709 12:25:14.597910 29609 raft_consensus.cc:2272] T ead227dd136a401db0ffb15035d0952f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.598029  3241 leader_election.cc:304] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:14.598846  4336 raft_consensus.cc:2749] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:14.600513 29609 tablet_replica.cc:333] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.601249 29609 raft_consensus.cc:2243] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.602226 29609 raft_consensus.cc:2272] T ee2205dfdff74e0da375c18cee844a6d P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.604938 29609 tablet_replica.cc:333] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.605700 29609 raft_consensus.cc:2243] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.606321 29609 raft_consensus.cc:2272] T 74198c23b23a4969b625c2245d554fb1 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.609140 29609 tablet_replica.cc:333] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.609915 29609 raft_consensus.cc:2243] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.610939 29609 raft_consensus.cc:2272] T 1437a4a42b8748fc85fd7a3af43a519b P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.613634 29609 tablet_replica.cc:333] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.614231 29609 raft_consensus.cc:2243] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.614699 29609 raft_consensus.cc:2272] T 2f3cee2b435d4ec5be91bead992f6663 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.616987 29609 tablet_replica.cc:333] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.617745 29609 raft_consensus.cc:2243] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.618810 29609 raft_consensus.cc:2272] T 803b9d76331940da95ae7b7083092e04 P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.621860 29609 tablet_replica.cc:333] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.622648 29609 raft_consensus.cc:2243] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.623226 29609 raft_consensus.cc:2272] T 1f5683a9c6a043ba9703ca5df5b58e5e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.626108 29609 tablet_replica.cc:333] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.626844 29609 raft_consensus.cc:2243] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.627862 29609 raft_consensus.cc:2272] T fc4defa68b934bc2ad3ea4eb0d16d97c P a1c10036e0434e268ddde97a8a846b5a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.630554 29609 tablet_replica.cc:333] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.631294 29609 raft_consensus.cc:2243] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.631693 29609 raft_consensus.cc:2272] T a3c4f3bd9c814c4bae322d5e4e11e37f P a1c10036e0434e268ddde97a8a846b5a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.633500 29609 tablet_replica.cc:333] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.634104 29609 raft_consensus.cc:2243] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.634473 29609 raft_consensus.cc:2272] T 1785d60abe3b48a2ab7a4329aec2166a P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.636343 29609 tablet_replica.cc:333] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.636840 29609 raft_consensus.cc:2243] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.637235 29609 raft_consensus.cc:2272] T b4bb08278f5a45f7af3e85e7306f7605 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.637960  4337 raft_consensus.cc:493] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.638429  4337 raft_consensus.cc:515] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } } peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } }
I20260709 12:25:14.639454 29609 tablet_replica.cc:333] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.640249 29609 raft_consensus.cc:2243] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.640300  4337 leader_election.cc:290] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:14.641261 29609 raft_consensus.cc:2272] T 028dc6ae74914f00a3e8defc67d0bad2 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.645229  3165 leader_election.cc:336] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:25:14.646029 29609 tablet_replica.cc:333] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
W20260709 12:25:14.646059  3166 leader_election.cc:336] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111)
I20260709 12:25:14.646953 29609 raft_consensus.cc:2243] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.646900  3166 leader_election.cc:304] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1c10036e0434e268ddde97a8a846b5a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:14.647614 29609 raft_consensus.cc:2272] T bda9cc4c7e654f8d94d79671bcbf148f P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.647774  4337 raft_consensus.cc:2749] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:14.650590 29609 tablet_replica.cc:333] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.651293 29609 raft_consensus.cc:2243] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.651885 29609 raft_consensus.cc:2272] T f380d7dc4159446e89f77c1d9f91aa6e P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.654560 29609 tablet_replica.cc:333] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.655274 29609 raft_consensus.cc:2243] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.655879 29609 raft_consensus.cc:2272] T 401c3e208635420ea50828b07a684567 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.656742  4336 raft_consensus.cc:493] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.657280  4336 raft_consensus.cc:515] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:14.658409 29609 tablet_replica.cc:333] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.659163 29609 raft_consensus.cc:2243] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.659247  4336 leader_election.cc:290] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:14.659768 29609 raft_consensus.cc:2272] T b773e38b369a4da2ba1e065e6565c5c1 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.662837 29609 tablet_replica.cc:333] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.663604 29609 raft_consensus.cc:2243] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:25:14.663583  3240 leader_election.cc:336] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:25:14.664947 29609 raft_consensus.cc:2272] T c54168825dc646d982d2ba4557205159 P a1c10036e0434e268ddde97a8a846b5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.665493  4336 raft_consensus.cc:493] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.666154  4336 raft_consensus.cc:515] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
W20260709 12:25:14.666656  3241 leader_election.cc:336] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111)
I20260709 12:25:14.667169  3241 leader_election.cc:304] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:14.667759 29609 tablet_replica.cc:333] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a: stopping tablet replica
I20260709 12:25:14.667884  4273 raft_consensus.cc:2749] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:14.668560 29609 raft_consensus.cc:2243] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.669160  4336 leader_election.cc:290] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
I20260709 12:25:14.669170 29609 raft_consensus.cc:2272] T 7fa2497fe6414fd5a9682b6fcb1eeea5 P a1c10036e0434e268ddde97a8a846b5a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:14.671386  3241 consensus_peers.cc:597] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.672578  3240 leader_election.cc:336] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:25:14.674304  3241 leader_election.cc:336] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111)
I20260709 12:25:14.674715  3241 leader_election.cc:304] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:14.675531  4301 raft_consensus.cc:2749] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:14.713182  3241 consensus_peers.cc:597] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.742537  3241 consensus_peers.cc:597] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.67:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.747485  3241 consensus_peers.cc:597] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.67:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.750733  3241 consensus_peers.cc:597] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.67:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.752578 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
I20260709 12:25:14.755762  4336 raft_consensus.cc:493] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.756469  4336 raft_consensus.cc:515] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:14.759188  4336 leader_election.cc:290] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
W20260709 12:25:14.767419  3240 leader_election.cc:336] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
W20260709 12:25:14.770963  3241 leader_election.cc:336] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Network error: Client connection negotiation failed: client connection to 127.28.234.67:46515: connect: Connection refused (error 111)
I20260709 12:25:14.771445  3241 leader_election.cc:304] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:25:14.772579  4273 raft_consensus.cc:2749] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:14.810341  3241 consensus_peers.cc:597] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.67:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:14.827154  3241 consensus_peers.cc:597] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a -> Peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Couldn't send request to peer a1c10036e0434e268ddde97a8a846b5a. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.67:46515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:14.840905 29609 tablet_server.cc:179] TabletServer@127.28.234.68:0 shutting down...
I20260709 12:25:14.851823  4336 raft_consensus.cc:493] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.852699  4336 raft_consensus.cc:515] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:14.855510  4336 leader_election.cc:290] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:25:14.860762  3241 leader_election.cc:336] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111)
W20260709 12:25:14.861377  3240 leader_election.cc:336] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:25:14.862493  4336 raft_consensus.cc:493] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.863071  3240 leader_election.cc:304] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:14.864274  4273 raft_consensus.cc:2749] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:14.863772  4336 raft_consensus.cc:515] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c10036e0434e268ddde97a8a846b5a" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 46515 } } peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } }
I20260709 12:25:14.866700  4336 leader_election.cc:290] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515), 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381)
W20260709 12:25:14.872514  3241 leader_election.cc:336] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a1c10036e0434e268ddde97a8a846b5a (127.28.234.67:46515): Network error: Client connection negotiation failed: client connection to 127.28.234.67:46515: connect: Connection refused (error 111)
W20260709 12:25:14.874035  3240 leader_election.cc:336] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:25:14.874392  3240 leader_election.cc:304] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, a1c10036e0434e268ddde97a8a846b5a
I20260709 12:25:14.875010  4336 raft_consensus.cc:2749] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:14.893910 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:14.894799 29609 tablet_replica.cc:333] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.895601 29609 raft_consensus.cc:2243] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.896123 29609 raft_consensus.cc:2272] T 352d5275a7ca43abb1b933b90dcb2960 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.898315 29609 tablet_replica.cc:333] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.898913 29609 raft_consensus.cc:2243] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.899363 29609 raft_consensus.cc:2272] T c38cbb84ab714516acb50aa88c24fab8 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.901958 29609 tablet_replica.cc:333] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.902570 29609 raft_consensus.cc:2243] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.903537 29609 raft_consensus.cc:2272] T 37fe20097de44ae683647a127a68de29 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.906291 29609 tablet_replica.cc:333] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.906853 29609 raft_consensus.cc:2243] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.907265 29609 raft_consensus.cc:2272] T 290114d0aee44b25b8178f30491c27e2 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.909278 29609 tablet_replica.cc:333] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.909909 29609 raft_consensus.cc:2243] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.910291 29609 raft_consensus.cc:2272] T d127a8af49cf4394a1db83d4dcb4cf20 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.912238 29609 tablet_replica.cc:333] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.912814 29609 raft_consensus.cc:2243] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.913565 29609 raft_consensus.cc:2272] T 960c1cb2ab5940509b7b2f09e2ec3df0 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.915624 29609 tablet_replica.cc:333] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.916162 29609 raft_consensus.cc:2243] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.916524 29609 raft_consensus.cc:2272] T 06665f03bd4d4cbba62e3aa2a3ef3ec0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.918429 29609 tablet_replica.cc:333] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.918922 29609 raft_consensus.cc:2243] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.919297 29609 raft_consensus.cc:2272] T 6d3255b68cdc495c9a753494c3f2f2cf P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.921227 29609 tablet_replica.cc:333] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.921839 29609 raft_consensus.cc:2243] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.922245 29609 raft_consensus.cc:2272] T c54168825dc646d982d2ba4557205159 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.924204 29609 tablet_replica.cc:333] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.924710 29609 raft_consensus.cc:2243] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.925114 29609 raft_consensus.cc:2272] T 028dc6ae74914f00a3e8defc67d0bad2 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.927079 29609 tablet_replica.cc:333] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.927558 29609 raft_consensus.cc:2243] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.928345 29609 raft_consensus.cc:2272] T f64d9df087d445d583410b9a3cd7ed19 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.931110 29609 tablet_replica.cc:333] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.931757 29609 raft_consensus.cc:2243] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.932253 29609 raft_consensus.cc:2272] T 6eacdbf96bb44cfeaa489486fbbc3ddf P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.934382 29609 tablet_replica.cc:333] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.935017 29609 raft_consensus.cc:2243] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.935487 29609 raft_consensus.cc:2272] T 41189efb74354067997fff21cfbf01f4 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.937601 29609 tablet_replica.cc:333] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.938264 29609 raft_consensus.cc:2243] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.938762 29609 raft_consensus.cc:2272] T b4bb08278f5a45f7af3e85e7306f7605 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.940927 29609 tablet_replica.cc:333] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.941538 29609 raft_consensus.cc:2243] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.942054 29609 raft_consensus.cc:2272] T 4a5ba9c7ef564ecc9bdd815ade936fb5 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.944221 29609 tablet_replica.cc:333] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.944890 29609 raft_consensus.cc:2243] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.945845 29609 raft_consensus.cc:2272] T 02a818fbb8d34fd098340d5f6167e8d1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.948035 29609 tablet_replica.cc:333] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.948638 29609 raft_consensus.cc:2243] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.949517 29609 raft_consensus.cc:2272] T 4ebfc57c93ee42b7bed740e2958f8419 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.951642 29609 tablet_replica.cc:333] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.952266 29609 raft_consensus.cc:2243] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.953118 29609 raft_consensus.cc:2272] T 68f410bf87dc479b968f4908ea4a1b31 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.956046 29609 tablet_replica.cc:333] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.956892 29609 raft_consensus.cc:2243] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.957898  4336 raft_consensus.cc:493] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7691286241bb4eec9fd1a29b7e102d3b)
I20260709 12:25:14.958107 29609 raft_consensus.cc:2272] T d26951aa0726479b8d555809a049d925 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.958642  4336 raft_consensus.cc:515] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10d6c936aa794194a9f8ff7e5d48950a" member_type: VOTER last_known_addr { host: "127.28.234.68" port: 46779 } } peers { permanent_uuid: "7691286241bb4eec9fd1a29b7e102d3b" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 45381 } } peers { permanent_uuid: "91322fbc5a384d2991766a8b76dc690e" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 46749 } }
I20260709 12:25:14.961354 29609 tablet_replica.cc:333] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.962527 29609 raft_consensus.cc:2243] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.963267 29609 raft_consensus.cc:2272] T b03446eaea8f426dae5a2b32c67bb9cf P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.961503  4336 leader_election.cc:290] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381), 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749)
W20260709 12:25:14.965817  3240 leader_election.cc:336] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7691286241bb4eec9fd1a29b7e102d3b (127.28.234.65:45381): Network error: Client connection negotiation failed: client connection to 127.28.234.65:45381: connect: Connection refused (error 111)
I20260709 12:25:14.966339 29609 tablet_replica.cc:333] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.967294 29609 raft_consensus.cc:2243] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:14.967434  3241 leader_election.cc:336] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 91322fbc5a384d2991766a8b76dc690e (127.28.234.66:46749): Network error: Client connection negotiation failed: client connection to 127.28.234.66:46749: connect: Connection refused (error 111)
I20260709 12:25:14.967948 29609 raft_consensus.cc:2272] T 43068fdfca3b412f8dce5d7ac88d3be0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.967945  3241 leader_election.cc:304] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 10d6c936aa794194a9f8ff7e5d48950a; no voters: 7691286241bb4eec9fd1a29b7e102d3b, 91322fbc5a384d2991766a8b76dc690e
I20260709 12:25:14.968802  4336 raft_consensus.cc:2749] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:14.971122 29609 tablet_replica.cc:333] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.971874 29609 raft_consensus.cc:2243] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.972404 29609 raft_consensus.cc:2272] T b549db2d234b4f4f8cee3dd5878d523d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.974645 29609 tablet_replica.cc:333] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.975302 29609 raft_consensus.cc:2243] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.976178 29609 raft_consensus.cc:2272] T b6a87c57d96e4b1b9bf92f2c8f31d096 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.978431 29609 tablet_replica.cc:333] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.979039 29609 raft_consensus.cc:2243] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.979534 29609 raft_consensus.cc:2272] T bbedacd971d04ba59a5f8bbcbf37126e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.981842 29609 tablet_replica.cc:333] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.982450 29609 raft_consensus.cc:2243] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.983297 29609 raft_consensus.cc:2272] T 1499d010b3c3480d9be748a5943d0c21 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.985348 29609 tablet_replica.cc:333] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.986073 29609 raft_consensus.cc:2243] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:14.986907 29609 raft_consensus.cc:2272] T 1a66c9d2932647f78f50e3fe9b152ef0 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.988965 29609 tablet_replica.cc:333] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.989586 29609 raft_consensus.cc:2243] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.990131 29609 raft_consensus.cc:2272] T 0a07fb075c4f4f7bb852d8e9a6aeeafc P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.992411 29609 tablet_replica.cc:333] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.993254 29609 raft_consensus.cc:2243] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.994087 29609 raft_consensus.cc:2272] T cff3ec9c718045a9b97d990c642c5f1f P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.996208 29609 tablet_replica.cc:333] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.996826 29609 raft_consensus.cc:2243] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:14.997325 29609 raft_consensus.cc:2272] T 6d5e0281e90149f1b903270f360d0994 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:14.999387 29609 tablet_replica.cc:333] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:14.999951 29609 raft_consensus.cc:2243] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.000487 29609 raft_consensus.cc:2272] T 1437a4a42b8748fc85fd7a3af43a519b P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.002578 29609 tablet_replica.cc:333] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.003155 29609 raft_consensus.cc:2243] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.003684 29609 raft_consensus.cc:2272] T 764ad628906949f2ae30282799496feb P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.005669 29609 tablet_replica.cc:333] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.006306 29609 raft_consensus.cc:2243] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.007153 29609 raft_consensus.cc:2272] T 3b9dba5e63804370825d907a8132c51a P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.009102 29609 tablet_replica.cc:333] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.009678 29609 raft_consensus.cc:2243] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.010188 29609 raft_consensus.cc:2272] T 803b9d76331940da95ae7b7083092e04 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.012295 29609 tablet_replica.cc:333] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.012862 29609 raft_consensus.cc:2243] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.013350 29609 raft_consensus.cc:2272] T 9b9543061e96403798babacc8aa31868 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.015403 29609 tablet_replica.cc:333] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.015972 29609 raft_consensus.cc:2243] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.016402 29609 raft_consensus.cc:2272] T 0ba3c6335b4349149377369fd75c48fb P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.018399 29609 tablet_replica.cc:333] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.018930 29609 raft_consensus.cc:2243] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.019362 29609 raft_consensus.cc:2272] T ee2205dfdff74e0da375c18cee844a6d P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.021284 29609 tablet_replica.cc:333] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.021908 29609 raft_consensus.cc:2243] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.022764 29609 raft_consensus.cc:2272] T 74198c23b23a4969b625c2245d554fb1 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.024910 29609 tablet_replica.cc:333] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.025570 29609 raft_consensus.cc:2243] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.026068 29609 raft_consensus.cc:2272] T 97440158a2d84b48946fe629834bfbd5 P 10d6c936aa794194a9f8ff7e5d48950a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.028093 29609 tablet_replica.cc:333] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.028633 29609 raft_consensus.cc:2243] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.029472 29609 raft_consensus.cc:2272] T 1f5683a9c6a043ba9703ca5df5b58e5e P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.031679 29609 tablet_replica.cc:333] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.032258 29609 raft_consensus.cc:2243] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.033066 29609 raft_consensus.cc:2272] T 1f10a2a7c7054d938f07a61863951def P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.035028 29609 tablet_replica.cc:333] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.035573 29609 raft_consensus.cc:2243] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.036379 29609 raft_consensus.cc:2272] T 401c3e208635420ea50828b07a684567 P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.038417 29609 tablet_replica.cc:333] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.038976 29609 raft_consensus.cc:2243] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.039427 29609 raft_consensus.cc:2272] T 618abe6b52674e39aa10b2e2f7a95977 P 10d6c936aa794194a9f8ff7e5d48950a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.041332 29609 tablet_replica.cc:333] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.041953 29609 raft_consensus.cc:2243] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:15.042526 29609 raft_consensus.cc:2272] T fc4defa68b934bc2ad3ea4eb0d16d97c P 10d6c936aa794194a9f8ff7e5d48950a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.044879 29609 tablet_replica.cc:333] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a: stopping tablet replica
I20260709 12:25:15.045536 29609 raft_consensus.cc:2243] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.046474 29609 raft_consensus.cc:2272] T 1785d60abe3b48a2ab7a4329aec2166a P 10d6c936aa794194a9f8ff7e5d48950a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.116489 29609 tablet_server.cc:196] TabletServer@127.28.234.68:0 shutdown complete.
I20260709 12:25:15.182343 29609 master.cc:562] Master@127.28.234.126:41381 shutting down...
I20260709 12:25:15.218859 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:15.219590 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:15.219978 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3db579d643fa4bf58f30252950d9fff4: stopping tablet replica
I20260709 12:25:15.244799 29609 master.cc:584] Master@127.28.234.126:41381 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35708 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:25:15.347684 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:46607
I20260709 12:25:15.349058 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.356392  4344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.356472  4345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.357244  4347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.357568 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:15.358942 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:15.359148 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.359280 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599915359267 us; error 0 us; skew 500 ppm
I20260709 12:25:15.359859 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.362725 29609 webserver.cc:533] Webserver started at http://127.28.234.126:45405/ using document root <none> and password file <none>
I20260709 12:25:15.363278 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.363471 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.363725 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.364961 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "05406edf1a9a4ee7b6cc2ef75a662114"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.370081 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:25:15.374315  4352 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.375244 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:15.375607 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "05406edf1a9a4ee7b6cc2ef75a662114"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.375941 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.394104 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.395484 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.437345 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:46607
I20260709 12:25:15.437482  4403 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:46607 every 8 connection(s)
I20260709 12:25:15.441444  4404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:15.452874  4404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114: Bootstrap starting.
I20260709 12:25:15.458120  4404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:15.463030  4404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114: No bootstrap required, opened a new log
I20260709 12:25:15.465384  4404 raft_consensus.cc:359] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" member_type: VOTER }
I20260709 12:25:15.465880  4404 raft_consensus.cc:385] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:15.466157  4404 raft_consensus.cc:740] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05406edf1a9a4ee7b6cc2ef75a662114, State: Initialized, Role: FOLLOWER
I20260709 12:25:15.466838  4404 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" member_type: VOTER }
I20260709 12:25:15.467324  4404 raft_consensus.cc:399] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:15.467562  4404 raft_consensus.cc:493] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:15.467839  4404 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:15.472879  4404 raft_consensus.cc:515] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" member_type: VOTER }
I20260709 12:25:15.473477  4404 leader_election.cc:304] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05406edf1a9a4ee7b6cc2ef75a662114; no voters: 
I20260709 12:25:15.474771  4404 leader_election.cc:290] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:15.475309  4407 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:15.477016  4407 raft_consensus.cc:697] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 1 LEADER]: Becoming Leader. State: Replica: 05406edf1a9a4ee7b6cc2ef75a662114, State: Running, Role: LEADER
I20260709 12:25:15.477952  4404 sys_catalog.cc:565] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:15.477866  4407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" member_type: VOTER }
I20260709 12:25:15.483650  4408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" member_type: VOTER } }
I20260709 12:25:15.483596  4409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05406edf1a9a4ee7b6cc2ef75a662114. Latest consensus state: current_term: 1 leader_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05406edf1a9a4ee7b6cc2ef75a662114" member_type: VOTER } }
I20260709 12:25:15.484395  4408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:15.484457  4409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:15.490845  4415 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:15.498979  4415 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:15.500129 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:15.508587  4415 catalog_manager.cc:1383] Generated new cluster ID: 1a3611a180124f4a9d4c489419cc27e2
I20260709 12:25:15.508886  4415 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:15.534726  4415 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:15.536151  4415 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:15.558260  4415 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114: Generated new TSK 0
I20260709 12:25:15.559008  4415 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:15.567703 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.574257  4425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.575307  4426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.578207 29609 server_base.cc:1061] running on GCE node
W20260709 12:25:15.578548  4428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.579928 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:15.580210 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.580444 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599915580426 us; error 0 us; skew 500 ppm
I20260709 12:25:15.581141 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.583901 29609 webserver.cc:533] Webserver started at http://127.28.234.65:41323/ using document root <none> and password file <none>
I20260709 12:25:15.584434 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.584643 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.584954 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.586200 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "1440e7f24a4e48d58a8f81a037570527"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.590906 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:15.594748  4433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.595778 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:15.596119 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "1440e7f24a4e48d58a8f81a037570527"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.596444 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.617362 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.618769 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.620337 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:15.622826 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:15.623075 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.623344 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:15.623548 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.667475 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:43807
I20260709 12:25:15.667601  4496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:43807 every 8 connection(s)
I20260709 12:25:15.672322 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.680850  4501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.682806  4502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.685225  4504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.686151 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:15.687377 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:15.687620 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.687806 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599915687789 us; error 0 us; skew 500 ppm
I20260709 12:25:15.688522 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.691689 29609 webserver.cc:533] Webserver started at http://127.28.234.66:44425/ using document root <none> and password file <none>
I20260709 12:25:15.692305 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.692514 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.692557  4497 heartbeater.cc:344] Connected to a master server at 127.28.234.126:46607
I20260709 12:25:15.692811 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.693068  4497 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:15.693962  4497 heartbeater.cc:507] Master 127.28.234.126:46607 requested a full tablet report, sending...
I20260709 12:25:15.694350 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "6392254d269f48ee9bc65d7adc2c0534"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.696471  4369 ts_manager.cc:194] Registered new tserver with Master: 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807)
I20260709 12:25:15.699460  4369 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60074
I20260709 12:25:15.701234 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:15.705425  4509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.706482 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:15.706776 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "6392254d269f48ee9bc65d7adc2c0534"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.707054 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.731639 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.732878 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.734352 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:15.736738 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:15.736939 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.737262 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:15.737412 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.780884 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:43767
I20260709 12:25:15.781098  4571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:43767 every 8 connection(s)
I20260709 12:25:15.786051 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:15.793741  4575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.795722  4576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:15.797506  4578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:15.799038 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:15.800184 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:15.800438  4572 heartbeater.cc:344] Connected to a master server at 127.28.234.126:46607
W20260709 12:25:15.800485 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:15.800895  4572 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:15.801071 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599915801050 us; error 0 us; skew 500 ppm
I20260709 12:25:15.801968 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:15.801995  4572 heartbeater.cc:507] Master 127.28.234.126:46607 requested a full tablet report, sending...
I20260709 12:25:15.804417  4369 ts_manager.cc:194] Registered new tserver with Master: 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:15.805017 29609 webserver.cc:533] Webserver started at http://127.28.234.67:37957/ using document root <none> and password file <none>
I20260709 12:25:15.805723 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:15.806118 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:15.806439 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:15.806535  4369 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60078
I20260709 12:25:15.807875 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.812773 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:15.816753  4583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.817917 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:15.818284 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:15.818634 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:15.867388 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:15.868844 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:15.870536 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:15.873351 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:15.873634 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.873940 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:15.874146 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:15.922101 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:36575
I20260709 12:25:15.922227  4646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:36575 every 8 connection(s)
I20260709 12:25:15.937121  4647 heartbeater.cc:344] Connected to a master server at 127.28.234.126:46607
I20260709 12:25:15.937614  4647 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:15.938436  4647 heartbeater.cc:507] Master 127.28.234.126:46607 requested a full tablet report, sending...
I20260709 12:25:15.940531  4369 ts_manager.cc:194] Registered new tserver with Master: f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:15.940901 29609 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015153368s
I20260709 12:25:15.942118  4369 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60084
I20260709 12:25:15.968724  4369 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60098:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:15.971781  4369 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:16.056919  4612 tablet_service.cc:1511] Processing CreateTablet for tablet 8d17bb33e6344515bdeadda20055c045 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:16.058589  4612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d17bb33e6344515bdeadda20055c045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.060645  4461 tablet_service.cc:1511] Processing CreateTablet for tablet 8d17bb33e6344515bdeadda20055c045 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:16.063007  4460 tablet_service.cc:1511] Processing CreateTablet for tablet 4061bc1dbda74c398992b0e4d528c6df (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:16.063360  4611 tablet_service.cc:1511] Processing CreateTablet for tablet 4061bc1dbda74c398992b0e4d528c6df (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:16.064607  4460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4061bc1dbda74c398992b0e4d528c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.064690  4611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4061bc1dbda74c398992b0e4d528c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.067073  4609 tablet_service.cc:1511] Processing CreateTablet for tablet eee1758f1e8040c293e49bfb1f667876 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:16.068555  4609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee1758f1e8040c293e49bfb1f667876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.071105  4459 tablet_service.cc:1511] Processing CreateTablet for tablet eee1758f1e8040c293e49bfb1f667876 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:16.072649  4459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee1758f1e8040c293e49bfb1f667876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.078274  4608 tablet_service.cc:1511] Processing CreateTablet for tablet 7a17eb7fb56b4f839afff697843897df (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:16.079800  4608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a17eb7fb56b4f839afff697843897df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.080209  4461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d17bb33e6344515bdeadda20055c045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.084465  4458 tablet_service.cc:1511] Processing CreateTablet for tablet 7a17eb7fb56b4f839afff697843897df (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:16.087387  4458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a17eb7fb56b4f839afff697843897df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.087489  4457 tablet_service.cc:1511] Processing CreateTablet for tablet 82678d4345f64b08a7e2eb58c65991ab (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:16.088954  4457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82678d4345f64b08a7e2eb58c65991ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.090770  4456 tablet_service.cc:1511] Processing CreateTablet for tablet b130f7cba62744ddb1cf397bc1ca618b (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:16.092329  4456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b130f7cba62744ddb1cf397bc1ca618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.096078  4607 tablet_service.cc:1511] Processing CreateTablet for tablet 82678d4345f64b08a7e2eb58c65991ab (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:16.097616  4607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82678d4345f64b08a7e2eb58c65991ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.095968  4455 tablet_service.cc:1511] Processing CreateTablet for tablet ce7b29df0cd9473ea013371dd2fc3594 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:16.099278  4455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7b29df0cd9473ea013371dd2fc3594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.115343  4454 tablet_service.cc:1511] Processing CreateTablet for tablet c0a27e919498471bb6b7f768675d8d0f (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:16.116892  4454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a27e919498471bb6b7f768675d8d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.119692  4453 tablet_service.cc:1511] Processing CreateTablet for tablet 12eab72b403a40b3bace93029de61600 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:16.121205  4453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12eab72b403a40b3bace93029de61600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.131421  4452 tablet_service.cc:1511] Processing CreateTablet for tablet 225a61ac61804a5284fa71f945f0ca44 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:16.133015  4452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225a61ac61804a5284fa71f945f0ca44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.156471  4663 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.158627  4608 tablet_service.cc:1511] Processing CreateTablet for tablet b130f7cba62744ddb1cf397bc1ca618b (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:16.160688  4608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b130f7cba62744ddb1cf397bc1ca618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.163478  4606 tablet_service.cc:1511] Processing CreateTablet for tablet ce7b29df0cd9473ea013371dd2fc3594 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:16.166477  4606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7b29df0cd9473ea013371dd2fc3594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.167057  4662 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.175863  4605 tablet_service.cc:1511] Processing CreateTablet for tablet 12eab72b403a40b3bace93029de61600 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:16.177373  4605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12eab72b403a40b3bace93029de61600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.179620  4604 tablet_service.cc:1511] Processing CreateTablet for tablet 225a61ac61804a5284fa71f945f0ca44 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:16.180958  4537 tablet_service.cc:1511] Processing CreateTablet for tablet 8d17bb33e6344515bdeadda20055c045 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:16.182480  4537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d17bb33e6344515bdeadda20055c045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.184405  4604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225a61ac61804a5284fa71f945f0ca44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.191673  4536 tablet_service.cc:1511] Processing CreateTablet for tablet 4061bc1dbda74c398992b0e4d528c6df (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:16.192945  4663 tablet_bootstrap.cc:654] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.193293  4536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4061bc1dbda74c398992b0e4d528c6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.196084  4662 tablet_bootstrap.cc:654] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.211481  4535 tablet_service.cc:1511] Processing CreateTablet for tablet eee1758f1e8040c293e49bfb1f667876 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:16.213022  4535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eee1758f1e8040c293e49bfb1f667876. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.216653  4612 tablet_service.cc:1511] Processing CreateTablet for tablet c0a27e919498471bb6b7f768675d8d0f (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:16.216835  4534 tablet_service.cc:1511] Processing CreateTablet for tablet 7a17eb7fb56b4f839afff697843897df (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:16.218477  4534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a17eb7fb56b4f839afff697843897df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.231160  4533 tablet_service.cc:1511] Processing CreateTablet for tablet 82678d4345f64b08a7e2eb58c65991ab (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:16.232738  4533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82678d4345f64b08a7e2eb58c65991ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.218436  4612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a27e919498471bb6b7f768675d8d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.260874  4532 tablet_service.cc:1511] Processing CreateTablet for tablet b130f7cba62744ddb1cf397bc1ca618b (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:16.264103  4531 tablet_service.cc:1511] Processing CreateTablet for tablet ce7b29df0cd9473ea013371dd2fc3594 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:16.267211  4530 tablet_service.cc:1511] Processing CreateTablet for tablet c0a27e919498471bb6b7f768675d8d0f (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:16.271163  4529 tablet_service.cc:1511] Processing CreateTablet for tablet 12eab72b403a40b3bace93029de61600 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:16.272852  4532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b130f7cba62744ddb1cf397bc1ca618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.274521  4531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce7b29df0cd9473ea013371dd2fc3594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.277422  4528 tablet_service.cc:1511] Processing CreateTablet for tablet 225a61ac61804a5284fa71f945f0ca44 (DEFAULT_TABLE table=test-workload [id=5bcd6857e3814f868d23a9a8b805d94e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:16.278942  4528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225a61ac61804a5284fa71f945f0ca44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.282101  4662 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.282281  4530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a27e919498471bb6b7f768675d8d0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.282672  4662 ts_tablet_manager.cc:1403] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.116s	user 0.022s	sys 0.043s
I20260709 12:25:16.283231  4529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12eab72b403a40b3bace93029de61600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:16.286019  4662 raft_consensus.cc:359] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:16.286794  4662 raft_consensus.cc:385] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.287096  4662 raft_consensus.cc:740] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.286055  4663 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.288352  4663 ts_tablet_manager.cc:1403] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.003s
I20260709 12:25:16.287879  4662 consensus_queue.cc:260] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:16.344771  4663 raft_consensus.cc:359] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.351586  4663 raft_consensus.cc:385] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.353514  4663 raft_consensus.cc:740] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.354226  4666 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:16.359797  4662 ts_tablet_manager.cc:1434] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.077s	user 0.028s	sys 0.039s
I20260709 12:25:16.360909  4647 heartbeater.cc:499] Master 127.28.234.126:46607 was elected leader, sending a full tablet report...
I20260709 12:25:16.361848  4662 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.362051  4663 consensus_queue.cc:260] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.369036  4662 tablet_bootstrap.cc:654] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.371951  4497 heartbeater.cc:499] Master 127.28.234.126:46607 was elected leader, sending a full tablet report...
I20260709 12:25:16.373021  4663 ts_tablet_manager.cc:1434] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.004s
I20260709 12:25:16.360234  4666 tablet_bootstrap.cc:654] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.374260  4663 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.381469  4663 tablet_bootstrap.cc:654] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.396328  4666 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:16.396915  4666 ts_tablet_manager.cc:1403] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 12:25:16.399281  4663 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.399809  4662 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.400023  4663 ts_tablet_manager.cc:1403] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 12:25:16.400452  4662 ts_tablet_manager.cc:1403] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.012s
I20260709 12:25:16.400269  4666 raft_consensus.cc:359] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:16.401139  4666 raft_consensus.cc:385] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.401487  4666 raft_consensus.cc:740] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.402524  4666 consensus_queue.cc:260] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:16.404454  4662 raft_consensus.cc:359] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.406807  4662 raft_consensus.cc:385] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.407246  4662 raft_consensus.cc:740] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.405925  4663 raft_consensus.cc:359] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.408387  4572 heartbeater.cc:499] Master 127.28.234.126:46607 was elected leader, sending a full tablet report...
I20260709 12:25:16.408741  4666 ts_tablet_manager.cc:1434] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 12:25:16.408341  4662 consensus_queue.cc:260] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.410063  4666 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:16.408337  4663 raft_consensus.cc:385] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.411111  4663 raft_consensus.cc:740] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.411757  4662 ts_tablet_manager.cc:1434] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.009s
I20260709 12:25:16.411938  4663 consensus_queue.cc:260] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.412999  4662 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.414654  4663 ts_tablet_manager.cc:1434] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:25:16.415736  4663 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.420704  4662 tablet_bootstrap.cc:654] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:16.422230  4498 tablet.cc:2406] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:16.422674  4663 tablet_bootstrap.cc:654] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.431972  4666 tablet_bootstrap.cc:654] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.432274  4662 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.432821  4662 ts_tablet_manager.cc:1403] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:25:16.436975  4662 raft_consensus.cc:359] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.438045  4662 raft_consensus.cc:385] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.438428  4662 raft_consensus.cc:740] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.439690  4662 consensus_queue.cc:260] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.442773  4662 ts_tablet_manager.cc:1434] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 12:25:16.443907  4662 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.448452  4666 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:16.449148  4666 ts_tablet_manager.cc:1403] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.003s
I20260709 12:25:16.450894  4662 tablet_bootstrap.cc:654] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.452039  4663 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.452683  4663 ts_tablet_manager.cc:1403] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.016s
I20260709 12:25:16.452847  4666 raft_consensus.cc:359] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.453691  4666 raft_consensus.cc:385] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.454157  4666 raft_consensus.cc:740] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.455364  4666 consensus_queue.cc:260] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.456135  4663 raft_consensus.cc:359] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.457083  4663 raft_consensus.cc:385] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.457469  4663 raft_consensus.cc:740] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.458484  4663 consensus_queue.cc:260] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.458953  4666 ts_tablet_manager.cc:1434] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:25:16.462746  4666 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:16.465912  4663 ts_tablet_manager.cc:1434] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:25:16.467172  4663 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.473831  4663 tablet_bootstrap.cc:654] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.474442  4666 tablet_bootstrap.cc:654] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.475874  4662 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.477347  4662 ts_tablet_manager.cc:1403] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.000s
I20260709 12:25:16.482244  4662 raft_consensus.cc:359] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.483326  4662 raft_consensus.cc:385] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.483713  4662 raft_consensus.cc:740] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.484403  4663 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.484990  4663 ts_tablet_manager.cc:1403] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:25:16.484822  4662 consensus_queue.cc:260] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.487797  4662 ts_tablet_manager.cc:1434] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:25:16.488374  4663 raft_consensus.cc:359] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.488867  4662 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.489218  4663 raft_consensus.cc:385] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.489617  4663 raft_consensus.cc:740] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.490278  4666 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:16.490895  4666 ts_tablet_manager.cc:1403] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.008s
I20260709 12:25:16.490775  4663 consensus_queue.cc:260] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
W20260709 12:25:16.491480  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:16.494343  4666 raft_consensus.cc:359] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.495173  4666 raft_consensus.cc:385] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.495477  4666 raft_consensus.cc:740] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.496447  4663 ts_tablet_manager.cc:1434] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.008s
I20260709 12:25:16.496284  4666 consensus_queue.cc:260] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.497669  4663 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.498803  4666 ts_tablet_manager.cc:1434] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:16.501137  4662 tablet_bootstrap.cc:654] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.507181  4668 raft_consensus.cc:493] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.507771  4668 raft_consensus.cc:515] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.511869  4666 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:16.516003  4668 leader_election.cc:290] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.518045  4663 tablet_bootstrap.cc:654] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.521036  4666 tablet_bootstrap.cc:654] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.522382  4672 raft_consensus.cc:493] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.523048  4672 raft_consensus.cc:515] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:16.526033  4667 raft_consensus.cc:493] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.526633  4667 raft_consensus.cc:515] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.527212  4672 leader_election.cc:290] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.542486  4668 raft_consensus.cc:493] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.543264  4668 raft_consensus.cc:515] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.547633  4668 leader_election.cc:290] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.550972  4667 leader_election.cc:290] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:16.551793  4662 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.552526  4662 ts_tablet_manager.cc:1403] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.004s
I20260709 12:25:16.553151  4666 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:16.553828  4666 ts_tablet_manager.cc:1403] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.008s
I20260709 12:25:16.554390  4672 raft_consensus.cc:493] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.555114  4672 raft_consensus.cc:515] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.558096  4672 leader_election.cc:290] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.567863  4662 raft_consensus.cc:359] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.568811  4662 raft_consensus.cc:385] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.569152  4662 raft_consensus.cc:740] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.569595  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7b29df0cd9473ea013371dd2fc3594" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.570556  4666 raft_consensus.cc:359] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.571453  4666 raft_consensus.cc:385] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.571761  4666 raft_consensus.cc:740] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.572674  4666 consensus_queue.cc:260] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.573868  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.574644  4547 raft_consensus.cc:2468] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 0.
W20260709 12:25:16.576545  4435 leader_election.cc:343] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.575912  4663 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.577401  4435 leader_election.cc:304] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:16.577587  4663 ts_tablet_manager.cc:1403] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.013s
I20260709 12:25:16.578399  4668 raft_consensus.cc:2804] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.578867  4668 raft_consensus.cc:493] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.579233  4668 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.582134  4662 consensus_queue.cc:260] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.585098  4662 ts_tablet_manager.cc:1434] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:25:16.587415  4662 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.581336  4663 raft_consensus.cc:359] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.589574  4663 raft_consensus.cc:385] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.589982  4663 raft_consensus.cc:740] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.590870  4663 consensus_queue.cc:260] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.591516  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.590628  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.593894  4666 ts_tablet_manager.cc:1434] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:25:16.593701  4622 raft_consensus.cc:2468] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 0.
W20260709 12:25:16.595194  4512 leader_election.cc:343] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.603101  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7b29df0cd9473ea013371dd2fc3594" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.603211  4512 leader_election.cc:304] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:16.604674  4672 raft_consensus.cc:2804] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.605233  4672 raft_consensus.cc:493] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.605718  4672 raft_consensus.cc:3060] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.613582  4472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:16.613735  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
W20260709 12:25:16.615680  4585 leader_election.cc:343] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.599618  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
W20260709 12:25:16.604929  4436 leader_election.cc:343] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.616202  4663 ts_tablet_manager.cc:1434] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.038s	user 0.016s	sys 0.014s
I20260709 12:25:16.616545  4436 leader_election.cc:304] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527; no voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:16.617581  4663 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
W20260709 12:25:16.617933  4436 leader_election.cc:343] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:16.618052  4510 leader_election.cc:343] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.615525  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
W20260709 12:25:16.620486  4510 leader_election.cc:343] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.620971  4510 leader_election.cc:304] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534; no voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:16.623245  4691 raft_consensus.cc:2749] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.631405  4666 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:16.634037  4663 tablet_bootstrap.cc:654] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.634586  4672 raft_consensus.cc:515] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:16.636945  4672 leader_election.cc:290] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.637620  4672 raft_consensus.cc:2749] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.638489  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:16.639158  4621 raft_consensus.cc:3060] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.639290  4662 tablet_bootstrap.cc:654] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.640211  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
W20260709 12:25:16.641963  4510 leader_election.cc:343] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.647967  4621 raft_consensus.cc:2468] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:16.649535  4512 leader_election.cc:304] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:16.650601  4672 raft_consensus.cc:2804] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.651365  4672 raft_consensus.cc:697] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:16.652174  4672 consensus_queue.cc:237] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:16.653127  4666 tablet_bootstrap.cc:654] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.653813  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:16.599238  4668 raft_consensus.cc:515] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
W20260709 12:25:16.655647  4584 leader_election.cc:343] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.656169  4584 leader_election.cc:304] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:16.653899  4662 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.656826  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:16.657331  4662 ts_tablet_manager.cc:1403] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.002s
I20260709 12:25:16.657483  4547 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.658830  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:16.654078  4663 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.659888  4663 ts_tablet_manager.cc:1403] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.015s
W20260709 12:25:16.661232  4436 leader_election.cc:343] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.661928  4667 raft_consensus.cc:2749] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.663380  4691 raft_consensus.cc:493] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.663952  4691 raft_consensus.cc:515] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.665844  4663 raft_consensus.cc:359] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.666410  4691 leader_election.cc:290] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.663456  4662 raft_consensus.cc:359] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.667074  4662 raft_consensus.cc:385] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.667429  4662 raft_consensus.cc:740] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.668336  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.668258  4662 consensus_queue.cc:260] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
W20260709 12:25:16.670029  4435 leader_election.cc:343] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.670673  4662 ts_tablet_manager.cc:1434] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:25:16.671111  4663 raft_consensus.cc:385] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.671485  4663 raft_consensus.cc:740] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.656741  4668 leader_election.cc:290] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Requested vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.672290  4663 consensus_queue.cc:260] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.674753  4663 ts_tablet_manager.cc:1434] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:16.675804  4663 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.678573  4662 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.682507  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.683609  4621 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 0.
I20260709 12:25:16.685988  4436 leader_election.cc:304] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:16.687295  4668 raft_consensus.cc:2804] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.687769  4668 raft_consensus.cc:493] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.688156  4668 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.691248  4663 tablet_bootstrap.cc:654] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.694389  4662 tablet_bootstrap.cc:654] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.702358  4547 raft_consensus.cc:2468] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 1.
I20260709 12:25:16.703740  4435 leader_election.cc:304] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:16.704526  4691 raft_consensus.cc:2804] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.716746  4691 raft_consensus.cc:697] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Becoming Leader. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Running, Role: LEADER
I20260709 12:25:16.717834  4691 consensus_queue.cc:237] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.722203  4368 catalog_manager.cc:5697] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.730195  4668 raft_consensus.cc:515] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.734586  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
W20260709 12:25:16.736511  4435 leader_election.cc:343] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.741070  4662 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.741926  4662 ts_tablet_manager.cc:1403] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.020s
I20260709 12:25:16.749359  4663 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.750284  4663 ts_tablet_manager.cc:1403] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.017s
I20260709 12:25:16.751060  4662 raft_consensus.cc:359] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.753461  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:16.753186  4668 leader_election.cc:290] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Requested vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.754182  4621 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.753737  4663 raft_consensus.cc:359] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.754978  4663 raft_consensus.cc:385] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.755486  4663 raft_consensus.cc:740] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.756656  4369 catalog_manager.cc:5697] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "1440e7f24a4e48d58a8f81a037570527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.756781  4663 consensus_queue.cc:260] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.760262  4663 ts_tablet_manager.cc:1434] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:25:16.761503  4666 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:16.761773  4663 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.762209  4666 ts_tablet_manager.cc:1403] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.137s	user 0.036s	sys 0.068s
I20260709 12:25:16.762066  4621 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 1.
I20260709 12:25:16.763471  4436 leader_election.cc:304] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:16.765261  4668 raft_consensus.cc:2804] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.753684  4662 raft_consensus.cc:385] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.765919  4691 raft_consensus.cc:493] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.766760  4668 raft_consensus.cc:697] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Becoming Leader. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Running, Role: LEADER
I20260709 12:25:16.767539  4666 raft_consensus.cc:359] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.766101  4662 raft_consensus.cc:740] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.768393  4666 raft_consensus.cc:385] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.766649  4691 raft_consensus.cc:515] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.768801  4666 raft_consensus.cc:740] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.769922  4666 consensus_queue.cc:260] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.770670  4663 tablet_bootstrap.cc:654] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.770889  4691 leader_election.cc:290] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.772348  4662 consensus_queue.cc:260] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.772619  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a27e919498471bb6b7f768675d8d0f" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.772609  4666 ts_tablet_manager.cc:1434] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:25:16.767999  4668 consensus_queue.cc:237] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.772972  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a27e919498471bb6b7f768675d8d0f" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.777606  4666 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
W20260709 12:25:16.774973  4436 leader_election.cc:343] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.786479  4672 raft_consensus.cc:493] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:16.787245  4435 leader_election.cc:343] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.787883  4435 leader_election.cc:304] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527; no voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:16.776743  4662 ts_tablet_manager.cc:1434] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 12:25:16.787097  4672 raft_consensus.cc:515] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.793741  4662 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.795593  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:16.795841  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.796376  4667 raft_consensus.cc:493] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.796952  4667 raft_consensus.cc:515] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
W20260709 12:25:16.797434  4510 leader_election.cc:343] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.797999  4621 raft_consensus.cc:2468] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 0.
I20260709 12:25:16.795639  4672 leader_election.cc:290] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.799306  4667 leader_election.cc:290] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:16.789240  4666 tablet_bootstrap.cc:654] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.802371  4512 leader_election.cc:304] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:16.803702  4672 raft_consensus.cc:2804] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.804118  4672 raft_consensus.cc:493] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.804454  4672 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.805269  4662 tablet_bootstrap.cc:654] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.806742  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
W20260709 12:25:16.808215  4584 leader_election.cc:343] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.808548  4691 raft_consensus.cc:2749] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.808842  4667 raft_consensus.cc:493] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.801692  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.809844  4667 raft_consensus.cc:515] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.813318  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:16.814188  4471 raft_consensus.cc:2468] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 0.
I20260709 12:25:16.814462  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.814831  4672 raft_consensus.cc:515] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.816074  4546 raft_consensus.cc:2393] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f87057a82bcc4e7a8e219ee4be812cf5 in current term 1: Already voted for candidate 6392254d269f48ee9bc65d7adc2c0534 in this term.
W20260709 12:25:16.816112  4585 leader_election.cc:343] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.816874  4584 leader_election.cc:304] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:16.816867  4667 leader_election.cc:290] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:16.821732  4585 leader_election.cc:304] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:16.822499  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
W20260709 12:25:16.824843  4510 leader_election.cc:343] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.818552  4667 raft_consensus.cc:2804] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.826263  4667 raft_consensus.cc:493] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.826776  4667 raft_consensus.cc:3060] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.828969  4672 leader_election.cc:290] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.830333  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:16.831019  4621 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.839089  4621 raft_consensus.cc:2468] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:16.840420  4512 leader_election.cc:304] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:16.841230  4672 raft_consensus.cc:2804] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.842101  4672 raft_consensus.cc:697] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:16.843108  4672 consensus_queue.cc:237] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.843767  4668 raft_consensus.cc:493] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.844357  4668 raft_consensus.cc:515] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.848120  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
W20260709 12:25:16.850095  4435 leader_election.cc:343] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.851644  4663 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.852429  4663 ts_tablet_manager.cc:1403] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.014s
I20260709 12:25:16.845579  4368 catalog_manager.cc:5697] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "1440e7f24a4e48d58a8f81a037570527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.856448  4663 raft_consensus.cc:359] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.857496  4663 raft_consensus.cc:385] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.861826  4662 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
W20260709 12:25:16.862149  4584 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:43807, user_credentials={real_user=slave}} blocked reactor thread for 46041.2us
I20260709 12:25:16.863505  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.864526  4666 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:16.865041  4666 ts_tablet_manager.cc:1403] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.088s	user 0.006s	sys 0.014s
W20260709 12:25:16.865557  4436 leader_election.cc:343] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.866117  4436 leader_election.cc:304] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527; no voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:16.867039  4691 raft_consensus.cc:2749] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.862439  4662 ts_tablet_manager.cc:1403] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.011s
I20260709 12:25:16.862807  4668 leader_election.cc:290] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.861866  4663 raft_consensus.cc:740] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.868209  4666 raft_consensus.cc:359] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.870898  4666 raft_consensus.cc:385] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.870239  4663 consensus_queue.cc:260] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.871232  4666 raft_consensus.cc:740] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.871570  4662 raft_consensus.cc:359] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.872315  4662 raft_consensus.cc:385] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.872076  4666 consensus_queue.cc:260] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.872598  4662 raft_consensus.cc:740] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.873215  4663 ts_tablet_manager.cc:1434] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:25:16.873453  4662 consensus_queue.cc:260] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.875527  4663 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.874506  4666 ts_tablet_manager.cc:1434] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:16.878863  4666 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:16.877550  4708 raft_consensus.cc:2749] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:16.887744  4662 ts_tablet_manager.cc:1434] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 12:25:16.888790  4666 tablet_bootstrap.cc:654] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.888875  4662 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
I20260709 12:25:16.895819  4667 raft_consensus.cc:515] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.900923  4663 tablet_bootstrap.cc:654] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.902168  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:16.905730  4546 raft_consensus.cc:3060] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.902452  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:16.909190  4471 raft_consensus.cc:3060] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.912781  4666 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:16.913870  4666 ts_tablet_manager.cc:1403] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.016s
I20260709 12:25:16.917564  4471 raft_consensus.cc:2468] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 1.
I20260709 12:25:16.919034  4584 leader_election.cc:304] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:16.920126  4710 raft_consensus.cc:2804] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.902920  4667 leader_election.cc:290] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:16.904623  4662 tablet_bootstrap.cc:654] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.921617  4666 raft_consensus.cc:359] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.922053  4546 raft_consensus.cc:2468] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 1.
I20260709 12:25:16.922528  4666 raft_consensus.cc:385] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.922930  4666 raft_consensus.cc:740] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.923178  4663 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:16.923683  4663 ts_tablet_manager.cc:1403] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.048s	user 0.003s	sys 0.022s
I20260709 12:25:16.907327  4368 catalog_manager.cc:5697] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:16.923704  4666 consensus_queue.cc:260] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.920701  4710 raft_consensus.cc:697] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:16.926118  4710 consensus_queue.cc:237] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.926645  4666 ts_tablet_manager.cc:1434] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:25:16.926736  4663 raft_consensus.cc:359] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.927570  4663 raft_consensus.cc:385] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.927824  4663 raft_consensus.cc:740] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.928663  4668 raft_consensus.cc:493] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.928548  4663 consensus_queue.cc:260] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.939260  4662 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:16.939155  4668 raft_consensus.cc:515] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.940065  4662 ts_tablet_manager.cc:1403] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 12:25:16.941524  4668 leader_election.cc:290] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.928225  4666 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:16.943279  4662 raft_consensus.cc:359] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.944262  4662 raft_consensus.cc:385] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:16.944614  4662 raft_consensus.cc:740] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:16.929200  4667 raft_consensus.cc:493] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.945901  4667 raft_consensus.cc:515] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.946158  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.946938  4621 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 0.
I20260709 12:25:16.948283  4436 leader_election.cc:304] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:16.949294  4666 tablet_bootstrap.cc:654] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.949542  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.950093  4668 raft_consensus.cc:2804] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.949987  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.950577  4668 raft_consensus.cc:493] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.952077  4672 raft_consensus.cc:493] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.951333  4667 leader_election.cc:290] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:16.951814  4662 consensus_queue.cc:260] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.952867  4672 raft_consensus.cc:515] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.953097  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:16.953928  4471 raft_consensus.cc:2468] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 0.
I20260709 12:25:16.955193  4672 leader_election.cc:290] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.951865  4663 ts_tablet_manager.cc:1434] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.007s
I20260709 12:25:16.956135  4472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a27e919498471bb6b7f768675d8d0f" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:16.956763  4663 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:16.957087  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a27e919498471bb6b7f768675d8d0f" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.957788  4621 raft_consensus.cc:2468] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 0.
I20260709 12:25:16.958081  4369 catalog_manager.cc:5697] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:16.959178  4512 leader_election.cc:304] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:16.950245  4546 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 0.
I20260709 12:25:16.955307  4662 ts_tablet_manager.cc:1434] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:25:16.956779  4472 raft_consensus.cc:2468] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 0.
I20260709 12:25:16.960858  4662 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5: Bootstrap starting.
W20260709 12:25:16.961024  4585 leader_election.cc:343] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:16.961830  4672 raft_consensus.cc:2804] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.962270  4672 raft_consensus.cc:493] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.962641  4672 raft_consensus.cc:3060] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.968019  4584 leader_election.cc:304] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:16.969400  4667 raft_consensus.cc:2804] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:16.952153  4668 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.969862  4667 raft_consensus.cc:493] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.970269  4667 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.970783  4662 tablet_bootstrap.cc:654] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.972635  4672 raft_consensus.cc:515] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.973524  4663 tablet_bootstrap.cc:654] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:16.975759  4472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a27e919498471bb6b7f768675d8d0f" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:16.976557  4472 raft_consensus.cc:3060] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.979075  4668 raft_consensus.cc:515] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.982411  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:16.983541  4546 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.985313  4472 raft_consensus.cc:2468] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:16.986272  4691 raft_consensus.cc:493] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.988072  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:16.988756  4622 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.988490  4691 raft_consensus.cc:515] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.990921  4691 leader_election.cc:290] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:16.987594  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a27e919498471bb6b7f768675d8d0f" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:16.991618  4621 raft_consensus.cc:3060] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:16.992708  4667 raft_consensus.cc:515] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:16.995756  4620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:16.996753  4620 raft_consensus.cc:2393] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1440e7f24a4e48d58a8f81a037570527 in current term 1: Already voted for candidate 6392254d269f48ee9bc65d7adc2c0534 in this term.
I20260709 12:25:16.997318  4622 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 1.
I20260709 12:25:16.998835  4547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:16.988128  4672 leader_election.cc:290] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:17.006264  4666 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:17.005333  4621 raft_consensus.cc:2468] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:17.006697  4435 leader_election.cc:304] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527; no voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:17.006886  4666 ts_tablet_manager.cc:1403] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.005s
I20260709 12:25:17.007032  4510 leader_election.cc:304] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:16.997864  4668 leader_election.cc:290] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Requested vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:17.002494  4545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:17.008642  4668 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:17.009598  4585 leader_election.cc:343] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:17.009609  4436 leader_election.cc:304] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:17.010361  4666 raft_consensus.cc:359] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.010710  4691 raft_consensus.cc:2804] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:16.999298  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:17.011260  4666 raft_consensus.cc:385] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.011535  4471 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.011693  4666 raft_consensus.cc:740] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.012701  4666 consensus_queue.cc:260] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.015350  4666 ts_tablet_manager.cc:1434] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:17.016474  4666 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:17.018245  4668 raft_consensus.cc:2749] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.003322  4667 leader_election.cc:290] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:17.010771  4672 raft_consensus.cc:2804] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.019505  4672 raft_consensus.cc:697] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:17.018787  4691 raft_consensus.cc:697] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Becoming Leader. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Running, Role: LEADER
I20260709 12:25:17.021301  4471 raft_consensus.cc:2468] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 1.
I20260709 12:25:17.021090  4691 consensus_queue.cc:237] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.005333  4546 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 1.
I20260709 12:25:17.022347  4666 tablet_bootstrap.cc:654] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.022646  4584 leader_election.cc:304] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:17.023609  4667 raft_consensus.cc:2804] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.023605  4672 consensus_queue.cc:237] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.024366  4667 raft_consensus.cc:697] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:17.025363  4667 consensus_queue.cc:237] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.028702  4666 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:17.029382  4666 ts_tablet_manager.cc:1403] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:25:17.030246  4663 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: No bootstrap required, opened a new log
I20260709 12:25:17.030823  4663 ts_tablet_manager.cc:1403] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.005s
I20260709 12:25:17.032524  4666 raft_consensus.cc:359] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.033389  4666 raft_consensus.cc:385] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.033775  4666 raft_consensus.cc:740] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.033581  4663 raft_consensus.cc:359] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:17.034338  4663 raft_consensus.cc:385] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.034628  4663 raft_consensus.cc:740] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.034740  4666 consensus_queue.cc:260] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.035346  4663 consensus_queue.cc:260] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:17.037475  4663 ts_tablet_manager.cc:1434] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:17.037601  4666 ts_tablet_manager.cc:1434] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:17.041177  4666 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534: Bootstrap starting.
I20260709 12:25:17.042317  4662 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5: No bootstrap required, opened a new log
I20260709 12:25:17.042865  4662 ts_tablet_manager.cc:1403] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.004s
I20260709 12:25:17.045921  4662 raft_consensus.cc:359] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.046654  4662 raft_consensus.cc:385] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.046953  4662 raft_consensus.cc:740] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.047127  4692 raft_consensus.cc:493] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.047746  4662 consensus_queue.cc:260] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.047755  4692 raft_consensus.cc:515] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.050194  4662 ts_tablet_manager.cc:1434] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:17.050576  4692 leader_election.cc:290] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:17.050856  4666 tablet_bootstrap.cc:654] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:17.051311  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:17.055621  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:17.056838  4622 raft_consensus.cc:2393] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6392254d269f48ee9bc65d7adc2c0534 in current term 1: Already voted for candidate 1440e7f24a4e48d58a8f81a037570527 in this term.
I20260709 12:25:17.059003  4512 leader_election.cc:304] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534; no voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:17.060784  4692 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.060623  4368 catalog_manager.cc:5697] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.074285  4692 raft_consensus.cc:2749] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.076761  4691 raft_consensus.cc:493] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.077564  4691 raft_consensus.cc:515] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:17.084894  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:17.086223  4369 catalog_manager.cc:5697] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "1440e7f24a4e48d58a8f81a037570527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.086228  4622 raft_consensus.cc:2393] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1440e7f24a4e48d58a8f81a037570527 in current term 1: Already voted for candidate 6392254d269f48ee9bc65d7adc2c0534 in this term.
I20260709 12:25:17.099123  4691 leader_election.cc:290] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:17.099855  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:17.101743  4435 leader_election.cc:304] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527; no voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:17.102792  4691 raft_consensus.cc:3060] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.106051  4366 catalog_manager.cc:5697] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.109854  4691 raft_consensus.cc:2749] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.111578  4667 raft_consensus.cc:493] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.112274  4666 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534: No bootstrap required, opened a new log
I20260709 12:25:17.113049  4666 ts_tablet_manager.cc:1403] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534: Time spent bootstrapping tablet: real 0.072s	user 0.019s	sys 0.035s
I20260709 12:25:17.112875  4667 raft_consensus.cc:515] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.113121  4692 consensus_queue.cc:1048] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.116329  4666 raft_consensus.cc:359] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.117062  4666 raft_consensus.cc:385] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:17.117071  4667 leader_election.cc:290] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:17.117435  4666 raft_consensus.cc:740] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Initialized, Role: FOLLOWER
I20260709 12:25:17.118247  4666 consensus_queue.cc:260] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.119488  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:17.120575  4666 ts_tablet_manager.cc:1434] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:17.121140  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:17.122057  4546 raft_consensus.cc:2393] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f87057a82bcc4e7a8e219ee4be812cf5 in current term 1: Already voted for candidate 1440e7f24a4e48d58a8f81a037570527 in this term.
I20260709 12:25:17.124365  4585 leader_election.cc:304] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:17.126585  4710 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.128114  4708 raft_consensus.cc:493] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.128659  4708 raft_consensus.cc:515] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.130983  4708 leader_election.cc:290] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:17.132674  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7b29df0cd9473ea013371dd2fc3594" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:17.133406  4471 raft_consensus.cc:2468] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 0.
I20260709 12:25:17.134867  4584 leader_election.cc:304] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:17.134956  4710 raft_consensus.cc:2749] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.136082  4710 raft_consensus.cc:2804] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.136462  4710 raft_consensus.cc:493] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.136791  4710 raft_consensus.cc:3060] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.137147  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7b29df0cd9473ea013371dd2fc3594" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:17.137903  4546 raft_consensus.cc:2468] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 0.
I20260709 12:25:17.143173  4710 raft_consensus.cc:515] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.146672  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7b29df0cd9473ea013371dd2fc3594" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:17.147326  4471 raft_consensus.cc:3060] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.147428  4710 leader_election.cc:290] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:17.149215  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce7b29df0cd9473ea013371dd2fc3594" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:17.150414  4546 raft_consensus.cc:3060] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.158601  4692 consensus_queue.cc:1048] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.159080  4471 raft_consensus.cc:2468] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 1.
I20260709 12:25:17.161015  4584 leader_election.cc:304] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:17.161993  4710 raft_consensus.cc:2804] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.162575  4710 raft_consensus.cc:697] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:17.162721  4546 raft_consensus.cc:2468] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 1.
I20260709 12:25:17.163518  4710 consensus_queue.cc:237] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.166785  4691 raft_consensus.cc:493] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.167380  4691 raft_consensus.cc:515] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.170555  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:17.171427  4546 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 0.
I20260709 12:25:17.172435  4691 leader_election.cc:290] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:17.174304  4435 leader_election.cc:304] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:17.174365  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:17.175419  4691 raft_consensus.cc:2804] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:17.175312  4622 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 0.
I20260709 12:25:17.175987  4691 raft_consensus.cc:493] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.176448  4691 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.185117  4691 raft_consensus.cc:515] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.188288  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:17.189015  4546 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.190405  4691 leader_election.cc:290] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Requested vote from peers 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:17.187556  4368 catalog_manager.cc:5697] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.193027  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "1440e7f24a4e48d58a8f81a037570527" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:17.196102  4622 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.196493  4546 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 1.
I20260709 12:25:17.197849  4435 leader_election.cc:304] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:17.198720  4691 raft_consensus.cc:2804] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:17.199327  4691 raft_consensus.cc:697] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Becoming Leader. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Running, Role: LEADER
I20260709 12:25:17.200223  4691 consensus_queue.cc:237] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.206341  4622 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1440e7f24a4e48d58a8f81a037570527 in term 1.
I20260709 12:25:17.209249  4366 catalog_manager.cc:5697] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "1440e7f24a4e48d58a8f81a037570527" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.233871  4691 consensus_queue.cc:1048] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.239218  4672 consensus_queue.cc:1048] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.246165  4691 consensus_queue.cc:1048] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.263923  4726 consensus_queue.cc:1048] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.269380  4691 consensus_queue.cc:1048] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.283058  4668 consensus_queue.cc:1048] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.300168  4726 raft_consensus.cc:493] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.300845  4726 raft_consensus.cc:515] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:17.303625  4726 leader_election.cc:290] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:17.304134  4471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1440e7f24a4e48d58a8f81a037570527" is_pre_election: true
I20260709 12:25:17.304235  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:17.305053  4471 raft_consensus.cc:2393] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6392254d269f48ee9bc65d7adc2c0534 in current term 1: Already voted for candidate f87057a82bcc4e7a8e219ee4be812cf5 in this term.
I20260709 12:25:17.306140  4510 leader_election.cc:304] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534; no voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:17.306921  4726 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:17.312803  4726 raft_consensus.cc:2749] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:17.323292 29609 ts_manager.cc:295] Set tserver state for 1440e7f24a4e48d58a8f81a037570527 to MAINTENANCE_MODE
I20260709 12:25:17.324200 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
I20260709 12:25:17.346058 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:17.346961 29609 tablet_replica.cc:333] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.347911 29609 raft_consensus.cc:2243] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:17.348726 29609 raft_consensus.cc:2272] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.351967 29609 tablet_replica.cc:333] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.352555 29609 raft_consensus.cc:2243] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:17.352938 29609 raft_consensus.cc:2272] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.354807 29609 tablet_replica.cc:333] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.355324 29609 raft_consensus.cc:2243] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:17.355710 29609 raft_consensus.cc:2272] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.358196 29609 tablet_replica.cc:333] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.358773 29609 raft_consensus.cc:2243] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:17.359127 29609 raft_consensus.cc:2272] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.360996 29609 tablet_replica.cc:333] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.361526 29609 raft_consensus.cc:2243] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:17.362289 29609 pending_rounds.cc:70] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Trying to abort 1 pending ops.
I20260709 12:25:17.362447 29609 pending_rounds.cc:77] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625260141727744 op_type: NO_OP noop_request { }
I20260709 12:25:17.362725 29609 raft_consensus.cc:2889] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:17.362952 29609 raft_consensus.cc:2272] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.365056 29609 tablet_replica.cc:333] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.365571 29609 raft_consensus.cc:2243] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:17.366217 29609 pending_rounds.cc:70] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Trying to abort 1 pending ops.
I20260709 12:25:17.366398 29609 pending_rounds.cc:77] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625260862128128 op_type: NO_OP noop_request { }
I20260709 12:25:17.366631 29609 raft_consensus.cc:2889] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:17.366852 29609 raft_consensus.cc:2272] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.368870 29609 tablet_replica.cc:333] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.369405 29609 raft_consensus.cc:2243] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:17.370363 29609 raft_consensus.cc:2272] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.373150 29609 tablet_replica.cc:333] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.373725 29609 raft_consensus.cc:2243] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:17.374182 29609 raft_consensus.cc:2272] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.373980  4710 consensus_queue.cc:1048] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:17.376245 29609 tablet_replica.cc:333] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.377059 29609 raft_consensus.cc:2243] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:17.378239 29609 raft_consensus.cc:2272] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:17.380927 29609 tablet_replica.cc:333] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: stopping tablet replica
I20260709 12:25:17.381630 29609 raft_consensus.cc:2243] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:17.382104 29609 raft_consensus.cc:2272] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:17.390462  4584 consensus_peers.cc:597] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.417599 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
W20260709 12:25:17.492558  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:17.496925  4510 consensus_peers.cc:597] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.542094  4726 consensus_queue.cc:1048] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:17.553807  4667 consensus_queue.cc:1048] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:17.566352  4584 consensus_peers.cc:597] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:17.566926  4584 consensus_peers.cc:597] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:17.737794  4510 consensus_peers.cc:597] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:17.763082  4510 consensus_peers.cc:597] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:17.774173  4667 consensus_queue.cc:1048] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:18.448194  4584 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111) [suppressed 143 similar messages]
W20260709 12:25:18.493734  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:18.749049  4747 raft_consensus.cc:493] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1440e7f24a4e48d58a8f81a037570527)
I20260709 12:25:18.749663  4747 raft_consensus.cc:515] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.752028  4747 leader_election.cc:290] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:18.753208  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:18.753933  4622 raft_consensus.cc:2468] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:18.754463  4746 raft_consensus.cc:493] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1440e7f24a4e48d58a8f81a037570527)
I20260709 12:25:18.754966  4746 raft_consensus.cc:515] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
W20260709 12:25:18.756515  4510 leader_election.cc:336] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:18.757269  4746 leader_election.cc:290] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:18.757815  4512 leader_election.cc:304] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:18.758394  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6392254d269f48ee9bc65d7adc2c0534" is_pre_election: true
I20260709 12:25:18.758896  4747 raft_consensus.cc:2804] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:18.759312  4747 raft_consensus.cc:493] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1440e7f24a4e48d58a8f81a037570527)
I20260709 12:25:18.759702  4747 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:18.761328  4584 leader_election.cc:336] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:18.768409  4747 raft_consensus.cc:515] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.769950  4546 raft_consensus.cc:2393] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f87057a82bcc4e7a8e219ee4be812cf5 in current term 2: Already voted for candidate 6392254d269f48ee9bc65d7adc2c0534 in this term.
I20260709 12:25:18.770865  4747 leader_election.cc:290] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:18.771879  4585 leader_election.cc:304] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:18.772354  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:18.772833  4746 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:18.775460  4510 leader_election.cc:336] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:18.779772  4746 raft_consensus.cc:2749] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:18.781172  4747 raft_consensus.cc:493] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.781780  4749 raft_consensus.cc:493] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1440e7f24a4e48d58a8f81a037570527)
I20260709 12:25:18.781733  4747 raft_consensus.cc:515] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.782385  4749 raft_consensus.cc:515] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.784515  4749 leader_election.cc:290] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:18.785682  4621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:18.785878  4747 leader_election.cc:290] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:18.786141  4620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:18.786549  4621 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:18.786985  4620 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:18.788242  4512 leader_election.cc:304] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:18.789275  4512 leader_election.cc:304] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:18.790269  4749 raft_consensus.cc:2804] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:18.790408  4622 raft_consensus.cc:2468] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:18.790688  4749 raft_consensus.cc:493] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1440e7f24a4e48d58a8f81a037570527)
I20260709 12:25:18.791152  4749 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.789095  4747 raft_consensus.cc:2804] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:18.792009  4747 raft_consensus.cc:493] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.792487  4747 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:18.792563  4510 leader_election.cc:336] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
W20260709 12:25:18.793578  4510 leader_election.cc:336] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:18.795688  4512 leader_election.cc:304] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:18.797712  4750 raft_consensus.cc:2804] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.799054  4750 raft_consensus.cc:697] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:18.799817  4749 raft_consensus.cc:515] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.800098  4750 consensus_queue.cc:237] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.802098  4747 raft_consensus.cc:515] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.803083  4749 leader_election.cc:290] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:18.804024  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:18.804713  4622 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:18.806156  4620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:18.806888  4620 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:18.810611  4510 leader_election.cc:336] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:18.810870  4368 catalog_manager.cc:5697] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 1 to 2, leader changed from 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:18.815030  4510 leader_election.cc:336] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:18.815938  4747 leader_election.cc:290] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:18.816284  4620 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:18.815837  4622 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:18.817854  4512 leader_election.cc:304] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:18.818751  4747 raft_consensus.cc:2804] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.819265  4747 raft_consensus.cc:697] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:18.819334  4512 leader_election.cc:304] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:18.820976  4750 raft_consensus.cc:2804] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:18.821599  4750 raft_consensus.cc:697] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:18.820178  4747 consensus_queue.cc:237] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.822613  4750 consensus_queue.cc:237] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:18.839254  4368 catalog_manager.cc:5697] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 1 to 2, leader changed from 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.840838  4368 catalog_manager.cc:5697] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 1 to 2, leader changed from 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:19.192927  4622 raft_consensus.cc:1275] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:19.194417  4750 consensus_queue.cc:1048] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:19.215010  4510 consensus_peers.cc:597] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.253165  4622 raft_consensus.cc:1275] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:19.254554  4750 consensus_queue.cc:1048] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:19.255620  4510 consensus_peers.cc:597] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.317305  4622 raft_consensus.cc:1275] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:19.318796  4750 consensus_queue.cc:1048] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:19.321050  4510 consensus_peers.cc:597] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.373422  4747 raft_consensus.cc:493] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.374157  4747 raft_consensus.cc:515] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:19.376101  4747 leader_election.cc:290] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:19.377442  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" is_pre_election: true
I20260709 12:25:19.378337  4622 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 1.
I20260709 12:25:19.379464  4512 leader_election.cc:304] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:19.380393  4747 raft_consensus.cc:2804] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:25:19.380663  4510 leader_election.cc:336] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:19.380824  4747 raft_consensus.cc:493] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.381335  4747 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:19.387555  4747 raft_consensus.cc:515] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:19.389927  4747 leader_election.cc:290] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:19.391484  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:19.392190  4622 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:25:19.394315  4510 leader_election.cc:336] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111)
I20260709 12:25:19.399153  4622 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:19.400449  4512 leader_election.cc:304] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6392254d269f48ee9bc65d7adc2c0534, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 1440e7f24a4e48d58a8f81a037570527
I20260709 12:25:19.401206  4747 raft_consensus.cc:2804] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:19.401743  4747 raft_consensus.cc:697] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:19.402634  4747 consensus_queue.cc:237] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:19.411558  4366 catalog_manager.cc:5697] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 1 to 2, leader changed from 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:19.494952  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:19.769610  4510 consensus_peers.cc:597] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.857824  4510 consensus_peers.cc:597] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:19.928475  4622 raft_consensus.cc:1275] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:19.930215  4747 consensus_queue.cc:1048] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:19.982434  4584 consensus_peers.cc:597] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:19.987736  4584 consensus_peers.cc:597] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:20.012859  4584 consensus_peers.cc:597] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:20.185592  4510 consensus_peers.cc:597] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:20.208992  4510 consensus_peers.cc:597] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:20.495973  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:21.364673  4510 consensus_peers.cc:597] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.497028  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:25:21.748303  4510 consensus_peers.cc:597] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:21.915364  4510 consensus_peers.cc:597] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:25:22.259955  4584 consensus_peers.cc:597] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:22.386231  4510 consensus_peers.cc:597] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:25:22.413556  4510 consensus_peers.cc:597] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:25:22.438576 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:22.446558  4773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.447292  4774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:22.448928  4776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:22.452255 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:22.453925 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:22.454234 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:22.454453 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599922454435 us; error 0 us; skew 500 ppm
I20260709 12:25:22.455060 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:22.458468 29609 webserver.cc:533] Webserver started at http://127.28.234.65:41323/ using document root <none> and password file <none>
I20260709 12:25:22.459090 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:22.459303 29609 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:25:22.463786 29609 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 12:25:22.468417  4781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:22.469310 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:22.469658 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "1440e7f24a4e48d58a8f81a037570527"
format_stamp: "Formatted at 2026-07-09 12:25:15 on dist-test-slave-8c39"
I20260709 12:25:22.470242 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:22.491048 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:22.492468 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:22.494336 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:25:22.498545  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:22.498811  4788 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:25:22.547899  4510 consensus_peers.cc:597] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.567667 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:25:22.568053 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.071s	user 0.000s	sys 0.004s
I20260709 12:25:22.568308 29609 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 12:25:22.574656  4584 consensus_peers.cc:597] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.575848  4788 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.593448  4788 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.594352  4788 tablet_bootstrap.cc:492] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.594978  4788 ts_tablet_manager.cc:1403] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:25:22.597884  4788 raft_consensus.cc:359] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:22.599002  4788 raft_consensus.cc:740] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.599896  4788 consensus_queue.cc:260] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:22.602869  4788 ts_tablet_manager.cc:1434] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:25:22.603655  4788 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.617991  4788 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.618865  4788 tablet_bootstrap.cc:492] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.619477  4788 ts_tablet_manager.cc:1403] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:25:22.621943  4788 raft_consensus.cc:359] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.622509  4788 raft_consensus.cc:740] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.623185  4788 consensus_queue.cc:260] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.624884  4788 ts_tablet_manager.cc:1434] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:22.625624  4788 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.626235 29609 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:25:22.626606 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.058s	user 0.058s	sys 0.000s
I20260709 12:25:22.641484  4788 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.642517  4788 tablet_bootstrap.cc:492] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.643332  4788 ts_tablet_manager.cc:1403] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
W20260709 12:25:22.643621  4584 consensus_peers.cc:597] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:25:22.645799  4788 raft_consensus.cc:359] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.646569  4788 raft_consensus.cc:740] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.647378  4788 consensus_queue.cc:260] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.649989  4788 ts_tablet_manager.cc:1434] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:22.651077  4788 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.666687  4788 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:25:22.667712  4788 tablet_bootstrap.cc:492] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.668308  4788 ts_tablet_manager.cc:1403] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.006s
I20260709 12:25:22.670928  4788 raft_consensus.cc:359] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.671901  4788 raft_consensus.cc:740] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.672734  4788 consensus_queue.cc:260] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.675652  4788 ts_tablet_manager.cc:1434] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:25:22.676858  4788 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.695115 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:43807
I20260709 12:25:22.695326  4852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:43807 every 8 connection(s)
I20260709 12:25:22.696455  4788 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.697566  4788 tablet_bootstrap.cc:492] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.698344  4788 ts_tablet_manager.cc:1403] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.000s
I20260709 12:25:22.701781 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.701850  4788 raft_consensus.cc:359] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.702785  4788 raft_consensus.cc:740] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.703755  4788 consensus_queue.cc:260] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.705698  4788 ts_tablet_manager.cc:1434] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:22.706733  4788 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.732164  4788 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:25:22.732999  4788 tablet_bootstrap.cc:492] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.733544  4788 ts_tablet_manager.cc:1403] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.008s
I20260709 12:25:22.736166  4788 raft_consensus.cc:359] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.737186  4788 raft_consensus.cc:740] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.738116  4788 consensus_queue.cc:260] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.739604  4546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12eab72b403a40b3bace93029de61600"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
mode: GRACEFUL
new_leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:44084
I20260709 12:25:22.740312  4853 heartbeater.cc:344] Connected to a master server at 127.28.234.126:46607
I20260709 12:25:22.740479  4788 ts_tablet_manager.cc:1434] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:25:22.740602  4546 raft_consensus.cc:606] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Received request to transfer leadership to TS f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:22.740990  4853 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:22.741690  4788 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.742249  4853 heartbeater.cc:507] Master 127.28.234.126:46607 requested a full tablet report, sending...
I20260709 12:25:22.744028  4546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
mode: GRACEFUL
new_leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:44084
I20260709 12:25:22.744658  4546 raft_consensus.cc:606] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Received request to transfer leadership to TS f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:22.747588  4546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
mode: GRACEFUL
new_leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:44084
I20260709 12:25:22.748610  4546 raft_consensus.cc:606] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Received request to transfer leadership to TS f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:22.750170 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:22.750928 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:22.750867  4366 ts_manager.cc:194] Re-registered known tserver with Master: 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807)
I20260709 12:25:22.752066 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.760183  4788 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.761379  4788 tablet_bootstrap.cc:492] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.762185  4788 ts_tablet_manager.cc:1403] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:25:22.765209  4788 raft_consensus.cc:359] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.766078  4788 raft_consensus.cc:740] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.766993  4366 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47768
I20260709 12:25:22.766834  4788 consensus_queue.cc:260] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.768949  4788 ts_tablet_manager.cc:1434] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:22.769883  4788 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.771418  4853 heartbeater.cc:499] Master 127.28.234.126:46607 was elected leader, sending a full tablet report...
I20260709 12:25:22.786799  4788 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.787650  4788 tablet_bootstrap.cc:492] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.788296  4788 ts_tablet_manager.cc:1403] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:25:22.790786  4788 raft_consensus.cc:359] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.791546  4788 raft_consensus.cc:740] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.792375  4788 consensus_queue.cc:260] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.794369  4788 ts_tablet_manager.cc:1434] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:22.795658  4788 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.809906  4788 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.810745  4788 tablet_bootstrap.cc:492] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.811470  4788 ts_tablet_manager.cc:1403] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:25:22.813618  4788 raft_consensus.cc:359] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.814538  4788 raft_consensus.cc:740] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.815201  4788 consensus_queue.cc:260] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.817448  4788 ts_tablet_manager.cc:1434] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:22.818418  4788 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Bootstrap starting.
I20260709 12:25:22.833017  4788 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:22.833689  4788 tablet_bootstrap.cc:492] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Bootstrap complete.
I20260709 12:25:22.834345  4788 ts_tablet_manager.cc:1403] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.007s
I20260709 12:25:22.836306  4788 raft_consensus.cc:359] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.836797  4788 raft_consensus.cc:740] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1440e7f24a4e48d58a8f81a037570527, State: Initialized, Role: FOLLOWER
I20260709 12:25:22.837440  4788 consensus_queue.cc:260] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:22.839147  4788 ts_tablet_manager.cc:1434] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:22.909168  4826 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.923624  4769 raft_consensus.cc:993] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534: : Instructing follower f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:22.924721  4868 raft_consensus.cc:1081] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Signalling peer f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:22.927320  4622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:41042
I20260709 12:25:22.928347  4622 raft_consensus.cc:493] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:22.928889  4622 raft_consensus.cc:3060] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.937302  4622 raft_consensus.cc:515] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:22.939342  4622 leader_election.cc:290] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:22.940328  4826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:22.940580  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d17bb33e6344515bdeadda20055c045" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:22.941334  4826 raft_consensus.cc:3060] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.941442  4546 raft_consensus.cc:3055] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:22.942013  4546 raft_consensus.cc:740] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:22.942909  4546 consensus_queue.cc:260] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:22.944196  4546 raft_consensus.cc:3060] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.948318  4826 raft_consensus.cc:2468] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 2.
I20260709 12:25:22.949937  4584 leader_election.cc:304] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:22.951139  4746 raft_consensus.cc:2804] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:22.952116  4546 raft_consensus.cc:2468] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 2.
I20260709 12:25:22.952520  4746 raft_consensus.cc:697] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:22.953927  4746 consensus_queue.cc:237] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } }
I20260709 12:25:22.958307  4826 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.963682  4366 catalog_manager.cc:5697] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 1 to 2, leader changed from 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66) to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.967481  4826 pending_rounds.cc:85] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Aborting all ops after (but not including) 0
I20260709 12:25:22.968001  4826 pending_rounds.cc:107] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:25:22.968362  4826 raft_consensus.cc:2889] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:22.982659  4826 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:22.991721  4826 pending_rounds.cc:85] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Aborting all ops after (but not including) 0
I20260709 12:25:22.992154  4826 pending_rounds.cc:107] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:25:22.992573  4826 raft_consensus.cc:2889] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:23.018512  4869 raft_consensus.cc:993] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534: : Instructing follower f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:23.019058  4869 raft_consensus.cc:1081] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Signalling peer f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:23.020797  4622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:41042
I20260709 12:25:23.021409  4622 raft_consensus.cc:493] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.021703  4622 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:23.027261  4622 raft_consensus.cc:515] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.028925  4622 leader_election.cc:290] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:23.030058  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:23.030058  4826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:23.031056  4546 raft_consensus.cc:3055] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:23.031224  4826 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:25:23.031354  4546 raft_consensus.cc:740] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:23.032459  4546 consensus_queue.cc:260] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.033588  4546 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:23.037882  4826 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:23.039232  4584 leader_election.cc:304] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:23.040122  4746 raft_consensus.cc:2804] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:23.040588  4746 raft_consensus.cc:697] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:23.041021  4546 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:23.041477  4746 consensus_queue.cc:237] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.050099  4368 catalog_manager.cc:5697] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 2 to 3, leader changed from 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66) to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.214006  4769 raft_consensus.cc:993] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534: : Instructing follower f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:23.214622  4769 raft_consensus.cc:1081] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Signalling peer f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:23.216398  4622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12eab72b403a40b3bace93029de61600"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:41042
I20260709 12:25:23.216936  4622 raft_consensus.cc:493] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.217263  4622 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:23.224316  4622 raft_consensus.cc:515] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.226308  4622 leader_election.cc:290] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:23.227346  4826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:23.227634  4546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12eab72b403a40b3bace93029de61600" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:23.228120  4826 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:23.228226  4546 raft_consensus.cc:3055] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:23.228672  4546 raft_consensus.cc:740] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:23.229841  4546 consensus_queue.cc:260] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.231392  4546 raft_consensus.cc:3060] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:23.237028  4826 raft_consensus.cc:2468] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:23.238708  4584 leader_election.cc:304] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:23.240044  4746 raft_consensus.cc:2804] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:23.240839  4746 raft_consensus.cc:697] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:23.240852  4546 raft_consensus.cc:2468] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:23.242551  4746 consensus_queue.cc:237] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.253953  4368 catalog_manager.cc:5697] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 2 to 3, leader changed from 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66) to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:23.337006  4826 raft_consensus.cc:1275] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.338900  4746 consensus_queue.cc:1048] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:23.351768  4546 raft_consensus.cc:1275] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:23.353622  4885 consensus_queue.cc:1048] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:23.499835  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:23.535018  4826 raft_consensus.cc:1275] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:23.536523  4885 consensus_queue.cc:1048] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:23.548744  4546 raft_consensus.cc:1275] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:23.551604  4889 consensus_queue.cc:1048] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:23.710994  4826 raft_consensus.cc:1275] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:23.712453  4889 consensus_queue.cc:1048] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:23.720793  4546 raft_consensus.cc:1275] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:23.723030  4870 consensus_queue.cc:1048] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:23.766239 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.785445  4622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
mode: GRACEFUL
new_leader_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:49420
I20260709 12:25:23.785992  4622 raft_consensus.cc:606] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Received request to transfer leadership to TS 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:23.788865  4622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
mode: GRACEFUL
new_leader_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:49420
I20260709 12:25:23.789535  4622 raft_consensus.cc:606] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Received request to transfer leadership to TS 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:23.790856 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:23.791510 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.792200 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.794483  4885 raft_consensus.cc:993] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5: : Instructing follower 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:23.795071  4870 raft_consensus.cc:1081] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Signalling peer 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:23.796892  4546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:25:23.797498  4546 raft_consensus.cc:493] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.797863  4546 raft_consensus.cc:3060] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.803643  4546 raft_consensus.cc:515] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.805317  4546 leader_election.cc:290] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:23.806384  4826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:23.806561  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4061bc1dbda74c398992b0e4d528c6df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:23.807144  4826 raft_consensus.cc:3060] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.807222  4622 raft_consensus.cc:3055] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:23.807703  4622 raft_consensus.cc:740] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:23.808456  4622 consensus_queue.cc:260] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.809643  4622 raft_consensus.cc:3060] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:23.814154  4826 raft_consensus.cc:2468] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:23.815122  4825 raft_consensus.cc:1240] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Rejecting Update request from peer f87057a82bcc4e7a8e219ee4be812cf5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:23.815672  4510 leader_election.cc:304] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:23.815810  4622 raft_consensus.cc:2468] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:23.816901  4869 raft_consensus.cc:2804] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:23.817469  4869 raft_consensus.cc:697] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:23.818535  4869 consensus_queue.cc:237] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:23.826567  4368 catalog_manager.cc:5697] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 1 to 2, leader changed from f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.161640  4885 raft_consensus.cc:993] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5: : Instructing follower 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:24.162271  4746 raft_consensus.cc:1081] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Signalling peer 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:24.164306  4545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:25:24.164953  4545 raft_consensus.cc:493] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.165369  4545 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.172006  4545 raft_consensus.cc:515] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:24.174203  4545 leader_election.cc:290] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 4 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:24.175011  4825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:24.175330  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82678d4345f64b08a7e2eb58c65991ab" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:24.175716  4825 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.175911  4622 raft_consensus.cc:3055] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:24.176303  4622 raft_consensus.cc:740] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:24.176931  4622 consensus_queue.cc:260] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:24.178026  4622 raft_consensus.cc:3060] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.184216  4825 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 4.
I20260709 12:25:24.185606  4510 leader_election.cc:304] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:24.185720  4622 raft_consensus.cc:2468] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 4.
I20260709 12:25:24.186400  4769 raft_consensus.cc:2804] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:24.186944  4769 raft_consensus.cc:697] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 4 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:24.187723  4769 consensus_queue.cc:237] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:24.194844  4368 catalog_manager.cc:5697] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 3 to 4, leader changed from f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 4 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.226002  4825 raft_consensus.cc:1275] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.227497  4869 consensus_queue.cc:1048] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.241531  4622 raft_consensus.cc:1275] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.243072  4869 consensus_queue.cc:1048] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:24.501022  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:24.586407  4825 raft_consensus.cc:1275] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 4 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:24.588040  4869 consensus_queue.cc:1048] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:24.597631  4622 raft_consensus.cc:1275] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 4 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:24.599195  4868 consensus_queue.cc:1048] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:24.800693 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:24.808327  4545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
mode: GRACEFUL
new_leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:44084
I20260709 12:25:24.808909  4545 raft_consensus.cc:606] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Received request to transfer leadership to TS f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:24.812143  4545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
mode: GRACEFUL
new_leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:44084
I20260709 12:25:24.812708  4545 raft_consensus.cc:606] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Received request to transfer leadership to TS f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:24.814062 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:24.814604 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:24.815325 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:24.818492  4769 raft_consensus.cc:993] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534: : Instructing follower f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:24.819046  4868 raft_consensus.cc:1081] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Signalling peer f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:24.821012  4622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:41042
I20260709 12:25:24.821589  4622 raft_consensus.cc:493] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.821977  4622 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.827304  4622 raft_consensus.cc:515] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:24.828709  4622 leader_election.cc:290] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:24.830047  4545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:24.830029  4825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:24.830796  4545 raft_consensus.cc:3055] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:24.830883  4825 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.831166  4545 raft_consensus.cc:740] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:24.832053  4545 consensus_queue.cc:260] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:24.833110  4545 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.837390  4825 raft_consensus.cc:2468] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 2.
I20260709 12:25:24.838483  4545 raft_consensus.cc:2468] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 2.
I20260709 12:25:24.838869  4584 leader_election.cc:304] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:24.839849  4746 raft_consensus.cc:2804] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:24.840808  4746 raft_consensus.cc:697] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:24.841576  4746 consensus_queue.cc:237] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:24.849637  4368 catalog_manager.cc:5697] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 1 to 2, leader changed from 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66) to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 2 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.102772  4769 raft_consensus.cc:993] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534: : Instructing follower f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:25.103261  4868 raft_consensus.cc:1081] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Signalling peer f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:25.104914  4622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:41042
I20260709 12:25:25.105460  4622 raft_consensus.cc:493] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.105758  4622 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.110759  4622 raft_consensus.cc:515] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:25.112919  4622 leader_election.cc:290] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:25.114154  4825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:25.114651  4545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eee1758f1e8040c293e49bfb1f667876" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:25.114989  4825 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.115377  4545 raft_consensus.cc:3055] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:25.115744  4545 raft_consensus.cc:740] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:25.116771  4545 consensus_queue.cc:260] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:25.118232  4545 raft_consensus.cc:3060] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.123684  4825 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:25.125330  4584 leader_election.cc:304] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:25.126451  4906 raft_consensus.cc:2804] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:25.126658  4545 raft_consensus.cc:2468] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:25.127128  4906 raft_consensus.cc:697] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:25.128311  4906 consensus_queue.cc:237] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:25.135691  4368 catalog_manager.cc:5697] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 2 to 3, leader changed from 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66) to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.324369  4545 raft_consensus.cc:1275] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.326068  4746 consensus_queue.cc:1048] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.339267  4825 raft_consensus.cc:1275] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:25.340927  4746 consensus_queue.cc:1048] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:25.502242  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:25.674449  4824 raft_consensus.cc:1275] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:25.676132  4906 consensus_queue.cc:1048] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.686276  4545 raft_consensus.cc:1275] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:25.688290  4746 consensus_queue.cc:1048] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:25.824808 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:25.833328  4622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
mode: GRACEFUL
new_leader_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:49420
I20260709 12:25:25.833911  4622 raft_consensus.cc:606] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Received request to transfer leadership to TS 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:25.836874  4622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
mode: GRACEFUL
new_leader_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:49420
I20260709 12:25:25.837440  4622 raft_consensus.cc:606] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 LEADER]: Received request to transfer leadership to TS 6392254d269f48ee9bc65d7adc2c0534
I20260709 12:25:25.838498 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:25.839026 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:25.839663 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:25.969585  4746 raft_consensus.cc:993] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5: : Instructing follower 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:25.970151  4920 raft_consensus.cc:1081] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Signalling peer 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:25.972056  4545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:25:25.972702  4545 raft_consensus.cc:493] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.973065  4545 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.980795  4545 raft_consensus.cc:515] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:25.982829  4545 leader_election.cc:290] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:25.983952  4824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:25.984053  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:25.984906  4824 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.984963  4622 raft_consensus.cc:3055] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:25.985452  4622 raft_consensus.cc:740] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:25.986449  4622 consensus_queue.cc:260] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:25.987810  4622 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.993659  4824 raft_consensus.cc:2468] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:25.995057  4510 leader_election.cc:304] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:25.995227  4622 raft_consensus.cc:2468] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 2.
I20260709 12:25:25.995990  4869 raft_consensus.cc:2804] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:25.996610  4869 raft_consensus.cc:697] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:25.997602  4869 consensus_queue.cc:237] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.007654  4368 catalog_manager.cc:5697] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 1 to 2, leader changed from f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.227139  4746 raft_consensus.cc:993] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5: : Instructing follower 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:26.227634  4746 raft_consensus.cc:1081] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 LEADER]: Signalling peer 6392254d269f48ee9bc65d7adc2c0534 to start an election
I20260709 12:25:26.229319  4545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
 from {username='slave'} at 127.0.0.1:56940
I20260709 12:25:26.229840  4545 raft_consensus.cc:493] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.230115  4545 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.235808  4545 raft_consensus.cc:515] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.237450  4545 leader_election.cc:290] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 3 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67:36575)
I20260709 12:25:26.238656  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
I20260709 12:25:26.238480  4824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a17eb7fb56b4f839afff697843897df" candidate_uuid: "6392254d269f48ee9bc65d7adc2c0534" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:26.239255  4622 raft_consensus.cc:3055] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:26.239321  4824 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.239670  4622 raft_consensus.cc:740] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:26.240460  4622 consensus_queue.cc:260] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.241652  4622 raft_consensus.cc:3060] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.247258  4824 raft_consensus.cc:2468] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 3.
I20260709 12:25:26.248941  4510 leader_election.cc:304] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, 6392254d269f48ee9bc65d7adc2c0534; no voters: 
I20260709 12:25:26.248939  4622 raft_consensus.cc:2468] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6392254d269f48ee9bc65d7adc2c0534 in term 3.
I20260709 12:25:26.249915  4869 raft_consensus.cc:2804] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:26.250523  4869 raft_consensus.cc:697] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 3 LEADER]: Becoming Leader. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:26.251246  4869 consensus_queue.cc:237] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.257863  4368 catalog_manager.cc:5697] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 reported cstate change: term changed from 2 to 3, leader changed from f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67) to 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66). New cstate: current_term: 3 leader_uuid: "6392254d269f48ee9bc65d7adc2c0534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.444458  4622 raft_consensus.cc:1275] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.446085  4869 consensus_queue.cc:1048] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.459244  4824 raft_consensus.cc:1275] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.462046  4929 consensus_queue.cc:1048] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:26.503446  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:26.639789  4824 raft_consensus.cc:1275] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:26.641299  4929 consensus_queue.cc:1048] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:26.650636  4622 raft_consensus.cc:1275] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Refusing update from remote peer 6392254d269f48ee9bc65d7adc2c0534: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:26.652868  4929 consensus_queue.cc:1048] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:26.846244 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.853783  4545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
mode: GRACEFUL
new_leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:44084
I20260709 12:25:26.854534  4545 raft_consensus.cc:606] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Received request to transfer leadership to TS f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:26.857542  4545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b"
dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
mode: GRACEFUL
new_leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:44084
I20260709 12:25:26.858156  4545 raft_consensus.cc:606] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Received request to transfer leadership to TS f87057a82bcc4e7a8e219ee4be812cf5
I20260709 12:25:26.859543 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:26.860028 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:26.860581 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.897727  4869 raft_consensus.cc:993] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534: : Instructing follower f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:26.898339  4929 raft_consensus.cc:1081] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Signalling peer f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:26.900002  4622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:41042
I20260709 12:25:26.900629  4622 raft_consensus.cc:493] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.901003  4622 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.907222  4622 raft_consensus.cc:515] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.909080  4622 leader_election.cc:290] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:26.910022  4824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:26.910324  4545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b130f7cba62744ddb1cf397bc1ca618b" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:26.910892  4824 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.911128  4545 raft_consensus.cc:3055] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:26.911564  4545 raft_consensus.cc:740] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:26.912432  4545 consensus_queue.cc:260] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.913556  4545 raft_consensus.cc:3060] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.917624  4824 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:26.919251  4584 leader_election.cc:304] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:26.920111  4746 raft_consensus.cc:2804] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:26.920171  4545 raft_consensus.cc:2468] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:26.921358  4746 raft_consensus.cc:697] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:26.922400  4746 consensus_queue.cc:237] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.929898  4366 catalog_manager.cc:5697] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 2 to 3, leader changed from 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66) to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.958232  4869 raft_consensus.cc:993] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534: : Instructing follower f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:26.958781  4929 raft_consensus.cc:1081] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Signalling peer f87057a82bcc4e7a8e219ee4be812cf5 to start an election
I20260709 12:25:26.961091  4622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44"
dest_uuid: "f87057a82bcc4e7a8e219ee4be812cf5"
 from {username='slave'} at 127.0.0.1:41042
I20260709 12:25:26.961588  4622 raft_consensus.cc:493] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.961905  4622 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.967178  4622 raft_consensus.cc:515] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.968869  4622 leader_election.cc:290] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Requested vote from peers 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807), 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767)
I20260709 12:25:26.970026  4824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1440e7f24a4e48d58a8f81a037570527"
I20260709 12:25:26.970129  4545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225a61ac61804a5284fa71f945f0ca44" candidate_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6392254d269f48ee9bc65d7adc2c0534"
I20260709 12:25:26.970955  4824 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.971035  4545 raft_consensus.cc:3055] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:26.971526  4545 raft_consensus.cc:740] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6392254d269f48ee9bc65d7adc2c0534, State: Running, Role: LEADER
I20260709 12:25:26.972434  4545 consensus_queue.cc:260] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.973811  4545 raft_consensus.cc:3060] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.979171  4824 raft_consensus.cc:2468] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:26.980520  4584 leader_election.cc:304] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1440e7f24a4e48d58a8f81a037570527, f87057a82bcc4e7a8e219ee4be812cf5; no voters: 
I20260709 12:25:26.981089  4545 raft_consensus.cc:2468] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f87057a82bcc4e7a8e219ee4be812cf5 in term 3.
I20260709 12:25:26.981374  4746 raft_consensus.cc:2804] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:26.981971  4746 raft_consensus.cc:697] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Becoming Leader. State: Replica: f87057a82bcc4e7a8e219ee4be812cf5, State: Running, Role: LEADER
I20260709 12:25:26.982740  4746 consensus_queue.cc:237] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } }
I20260709 12:25:26.988824  4366 catalog_manager.cc:5697] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 reported cstate change: term changed from 2 to 3, leader changed from 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66) to f87057a82bcc4e7a8e219ee4be812cf5 (127.28.234.67). New cstate: current_term: 3 leader_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f87057a82bcc4e7a8e219ee4be812cf5" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 36575 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.355485  4545 raft_consensus.cc:1275] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:27.356976  4746 consensus_queue.cc:1048] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.368227  4824 raft_consensus.cc:1275] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:25:27.369987  4943 consensus_queue.cc:1048] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:27.438277  4545 raft_consensus.cc:1275] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.439806  4943 consensus_queue.cc:1048] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6392254d269f48ee9bc65d7adc2c0534" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 43767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:27.451395  4824 raft_consensus.cc:1275] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Refusing update from remote peer f87057a82bcc4e7a8e219ee4be812cf5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.452836  4943 consensus_queue.cc:1048] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1440e7f24a4e48d58a8f81a037570527" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:27.504623  4417 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:25:27.868217 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:27.899991 29609 tablet_server.cc:179] TabletServer@127.28.234.65:43807 shutting down...
I20260709 12:25:27.922417 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:27.923204 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.924198 29609 raft_consensus.cc:2243] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.924793 29609 raft_consensus.cc:2272] T c0a27e919498471bb6b7f768675d8d0f P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:27.927508  4584 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 89 similar messages]
I20260709 12:25:27.927726 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.928783 29609 raft_consensus.cc:2243] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.929414 29609 raft_consensus.cc:2272] T 4061bc1dbda74c398992b0e4d528c6df P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:27.930685  4584 consensus_peers.cc:597] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:27.931661 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.932343 29609 raft_consensus.cc:2243] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.932801 29609 raft_consensus.cc:2272] T eee1758f1e8040c293e49bfb1f667876 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:27.934814 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.935374 29609 raft_consensus.cc:2243] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.935818 29609 raft_consensus.cc:2272] T 12eab72b403a40b3bace93029de61600 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:27.937695 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.938347 29609 raft_consensus.cc:2243] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.938764 29609 raft_consensus.cc:2272] T b130f7cba62744ddb1cf397bc1ca618b P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:27.941071 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.941648 29609 raft_consensus.cc:2243] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.942167 29609 raft_consensus.cc:2272] T 82678d4345f64b08a7e2eb58c65991ab P 1440e7f24a4e48d58a8f81a037570527 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:27.943943 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.944478 29609 raft_consensus.cc:2243] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.944886 29609 raft_consensus.cc:2272] T ce7b29df0cd9473ea013371dd2fc3594 P 1440e7f24a4e48d58a8f81a037570527 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:27.947054 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.947892 29609 raft_consensus.cc:2243] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.948307 29609 raft_consensus.cc:2272] T 7a17eb7fb56b4f839afff697843897df P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:27.950142 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.950587 29609 raft_consensus.cc:2243] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.950969 29609 raft_consensus.cc:2272] T 225a61ac61804a5284fa71f945f0ca44 P 1440e7f24a4e48d58a8f81a037570527 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:27.953313 29609 tablet_replica.cc:333] stopping tablet replica
I20260709 12:25:27.953852 29609 raft_consensus.cc:2243] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:27.954236 29609 raft_consensus.cc:2272] T 8d17bb33e6344515bdeadda20055c045 P 1440e7f24a4e48d58a8f81a037570527 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:27.961131  4584 consensus_peers.cc:597] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:27.986534 29609 tablet_server.cc:196] TabletServer@127.28.234.65:43807 shutdown complete.
I20260709 12:25:28.009534 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
W20260709 12:25:28.017550  4584 consensus_peers.cc:597] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 1440e7f24a4e48d58a8f81a037570527 (127.28.234.65:43807): Couldn't send request to peer 1440e7f24a4e48d58a8f81a037570527. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:28.040643 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:28.041534 29609 tablet_replica.cc:333] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.042876 29609 raft_consensus.cc:2243] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.043991 29609 raft_consensus.cc:2272] T c0a27e919498471bb6b7f768675d8d0f P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.046720 29609 tablet_replica.cc:333] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.047413 29609 raft_consensus.cc:2243] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.048272 29609 raft_consensus.cc:2272] T 4061bc1dbda74c398992b0e4d528c6df P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.050550 29609 tablet_replica.cc:333] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.051170 29609 raft_consensus.cc:2243] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.051709 29609 raft_consensus.cc:2272] T ce7b29df0cd9473ea013371dd2fc3594 P 6392254d269f48ee9bc65d7adc2c0534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.054045 29609 tablet_replica.cc:333] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.054965 29609 raft_consensus.cc:2243] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.055748 29609 raft_consensus.cc:2272] T 82678d4345f64b08a7e2eb58c65991ab P 6392254d269f48ee9bc65d7adc2c0534 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.058354 29609 tablet_replica.cc:333] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.058946 29609 raft_consensus.cc:2243] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.059418 29609 raft_consensus.cc:2272] T b130f7cba62744ddb1cf397bc1ca618b P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.063259 29609 tablet_replica.cc:333] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.063911 29609 raft_consensus.cc:2243] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.064420 29609 raft_consensus.cc:2272] T eee1758f1e8040c293e49bfb1f667876 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.067510 29609 tablet_replica.cc:333] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.068421 29609 raft_consensus.cc:2243] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:28.068715  4585 consensus_peers.cc:597] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 -> Peer 6392254d269f48ee9bc65d7adc2c0534 (127.28.234.66:43767): Couldn't send request to peer 6392254d269f48ee9bc65d7adc2c0534. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:28.068964 29609 raft_consensus.cc:2272] T 12eab72b403a40b3bace93029de61600 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.071580 29609 tablet_replica.cc:333] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.072239 29609 raft_consensus.cc:2243] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.073134 29609 raft_consensus.cc:2272] T 7a17eb7fb56b4f839afff697843897df P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.075681 29609 tablet_replica.cc:333] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.076323 29609 raft_consensus.cc:2243] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.077032 29609 raft_consensus.cc:2272] T 225a61ac61804a5284fa71f945f0ca44 P 6392254d269f48ee9bc65d7adc2c0534 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.079821 29609 tablet_replica.cc:333] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534: stopping tablet replica
I20260709 12:25:28.080687 29609 raft_consensus.cc:2243] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.081189 29609 raft_consensus.cc:2272] T 8d17bb33e6344515bdeadda20055c045 P 6392254d269f48ee9bc65d7adc2c0534 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.115119 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
I20260709 12:25:28.142925 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
I20260709 12:25:28.172257 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:28.173121 29609 tablet_replica.cc:333] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.173902 29609 raft_consensus.cc:2243] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.174443 29609 raft_consensus.cc:2272] T c0a27e919498471bb6b7f768675d8d0f P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.176817 29609 tablet_replica.cc:333] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.177417 29609 raft_consensus.cc:2243] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.178426 29609 raft_consensus.cc:2272] T ce7b29df0cd9473ea013371dd2fc3594 P f87057a82bcc4e7a8e219ee4be812cf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.180794 29609 tablet_replica.cc:333] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.181396 29609 raft_consensus.cc:2243] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.181927 29609 raft_consensus.cc:2272] T 82678d4345f64b08a7e2eb58c65991ab P f87057a82bcc4e7a8e219ee4be812cf5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.184068 29609 tablet_replica.cc:333] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.184705 29609 raft_consensus.cc:2243] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.185149 29609 raft_consensus.cc:2272] T 4061bc1dbda74c398992b0e4d528c6df P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.187330 29609 tablet_replica.cc:333] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.187870 29609 raft_consensus.cc:2243] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.188686 29609 raft_consensus.cc:2272] T 12eab72b403a40b3bace93029de61600 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.191042 29609 tablet_replica.cc:333] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.191592 29609 raft_consensus.cc:2243] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.192399 29609 raft_consensus.cc:2272] T eee1758f1e8040c293e49bfb1f667876 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.194679 29609 tablet_replica.cc:333] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.195266 29609 raft_consensus.cc:2243] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.196079 29609 raft_consensus.cc:2272] T b130f7cba62744ddb1cf397bc1ca618b P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.199095 29609 tablet_replica.cc:333] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.199720 29609 raft_consensus.cc:2243] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:28.200241 29609 raft_consensus.cc:2272] T 7a17eb7fb56b4f839afff697843897df P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.202873 29609 tablet_replica.cc:333] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.203501 29609 raft_consensus.cc:2243] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.204457 29609 raft_consensus.cc:2272] T 225a61ac61804a5284fa71f945f0ca44 P f87057a82bcc4e7a8e219ee4be812cf5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.207903 29609 tablet_replica.cc:333] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5: stopping tablet replica
I20260709 12:25:28.208451 29609 raft_consensus.cc:2243] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.209295 29609 raft_consensus.cc:2272] T 8d17bb33e6344515bdeadda20055c045 P f87057a82bcc4e7a8e219ee4be812cf5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.244524 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
I20260709 12:25:28.271045 29609 master.cc:562] Master@127.28.234.126:46607 shutting down...
I20260709 12:25:28.304226 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:28.304896 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:28.305307 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P 05406edf1a9a4ee7b6cc2ef75a662114: stopping tablet replica
I20260709 12:25:28.327323 29609 master.cc:584] Master@127.28.234.126:46607 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13032 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:25:28.380115 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:41707
I20260709 12:25:28.381330 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:28.387914  4956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.388018  4957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.389256  4959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.391136 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:28.392267 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:28.392542 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:28.392683 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599928392669 us; error 0 us; skew 500 ppm
I20260709 12:25:28.393255 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:28.396544 29609 webserver.cc:533] Webserver started at http://127.28.234.126:38535/ using document root <none> and password file <none>
I20260709 12:25:28.397353 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:28.397569 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:28.398128 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:28.399482 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "e10cda867e2b46aaba5a5e21d820c2ae"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.404510 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:28.408454  4964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.409335 29609 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:28.409695 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "e10cda867e2b46aaba5a5e21d820c2ae"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.410105 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:28.435180 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:28.436601 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:28.482532 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:41707
I20260709 12:25:28.482643  5016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:41707 every 8 connection(s)
I20260709 12:25:28.486912  5017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:28.502264  5017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae: Bootstrap starting.
I20260709 12:25:28.508020  5017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:28.513341  5017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae: No bootstrap required, opened a new log
I20260709 12:25:28.516892  5017 raft_consensus.cc:359] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" member_type: VOTER }
I20260709 12:25:28.517611  5017 raft_consensus.cc:385] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:28.518020  5017 raft_consensus.cc:740] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10cda867e2b46aaba5a5e21d820c2ae, State: Initialized, Role: FOLLOWER
I20260709 12:25:28.518756  5017 consensus_queue.cc:260] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" member_type: VOTER }
I20260709 12:25:28.519261  5017 raft_consensus.cc:399] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:28.519492  5017 raft_consensus.cc:493] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:28.519806  5017 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:28.525695  5017 raft_consensus.cc:515] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" member_type: VOTER }
I20260709 12:25:28.526578  5017 leader_election.cc:304] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e10cda867e2b46aaba5a5e21d820c2ae; no voters: 
I20260709 12:25:28.528031  5017 leader_election.cc:290] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:28.528510  5020 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:28.530325  5020 raft_consensus.cc:697] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 1 LEADER]: Becoming Leader. State: Replica: e10cda867e2b46aaba5a5e21d820c2ae, State: Running, Role: LEADER
I20260709 12:25:28.531157  5020 consensus_queue.cc:237] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" member_type: VOTER }
I20260709 12:25:28.531631  5017 sys_catalog.cc:565] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:28.537356  5022 sys_catalog.cc:455] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader e10cda867e2b46aaba5a5e21d820c2ae. Latest consensus state: current_term: 1 leader_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" member_type: VOTER } }
I20260709 12:25:28.537919  5021 sys_catalog.cc:455] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e10cda867e2b46aaba5a5e21d820c2ae" member_type: VOTER } }
I20260709 12:25:28.539165  5021 sys_catalog.cc:458] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:28.538551  5022 sys_catalog.cc:458] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:28.542361  5027 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:28.547672  5027 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:28.553347 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:28.558697  5027 catalog_manager.cc:1383] Generated new cluster ID: bdb30cc7721d4c8da73d9c33c111ade7
I20260709 12:25:28.559092  5027 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:28.592408  5027 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:28.594123  5027 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:28.625669  5027 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae: Generated new TSK 0
I20260709 12:25:28.626425  5027 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:28.688699 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:28.696100  5038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.697104  5039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.698817  5041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.699744 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:28.700742 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:28.701072 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:28.701267 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599928701243 us; error 0 us; skew 500 ppm
I20260709 12:25:28.701927 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:28.704711 29609 webserver.cc:533] Webserver started at http://127.28.234.65:41485/ using document root <none> and password file <none>
I20260709 12:25:28.705283 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:28.705509 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:28.705873 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:28.707073 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "b5ca2033876d426c86790927615960f7"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.712263 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:28.716666  5046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.717789 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:25:28.718207 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "b5ca2033876d426c86790927615960f7"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.718484 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:28.746703 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:28.748328 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:28.750183 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:28.752916 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:28.753345 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.753648 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:28.753871 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:25:28.806855 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:36413
I20260709 12:25:28.807147  5108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:36413 every 8 connection(s)
I20260709 12:25:28.812134 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:28.819765  5113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.821251  5114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.825369 29609 server_base.cc:1061] running on GCE node
W20260709 12:25:28.826432  5116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.827572 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:28.827832 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:28.828133 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599928828116 us; error 0 us; skew 500 ppm
I20260709 12:25:28.828830 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:28.832293 29609 webserver.cc:533] Webserver started at http://127.28.234.66:35343/ using document root <none> and password file <none>
I20260709 12:25:28.832877 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:28.833123 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:28.833469 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:28.833421  5109 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41707
I20260709 12:25:28.834287  5109 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:28.835269  5109 heartbeater.cc:507] Master 127.28.234.126:41707 requested a full tablet report, sending...
I20260709 12:25:28.835373 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "f046be59c08042b5a4c52f31593aaf9c"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.838083  4981 ts_manager.cc:194] Registered new tserver with Master: b5ca2033876d426c86790927615960f7 (127.28.234.65:36413)
I20260709 12:25:28.840241  4981 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59898
I20260709 12:25:28.841073 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:25:28.845382  5121 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.846442 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:28.846922 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "f046be59c08042b5a4c52f31593aaf9c"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.847365 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:28.877519 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:28.878955 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:28.880582 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:28.883013 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:28.883267 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.883584 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:28.883776 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.932978 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:41105
I20260709 12:25:28.933190  5184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:41105 every 8 connection(s)
I20260709 12:25:28.940042 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:28.949487  5188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:28.952997  5189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.953275  5185 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41707
I20260709 12:25:28.953847  5185 heartbeater.cc:461] Registering TS with master...
W20260709 12:25:28.954864  5191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:28.954891  5185 heartbeater.cc:507] Master 127.28.234.126:41707 requested a full tablet report, sending...
I20260709 12:25:28.956108 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:28.957858 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:28.957984  4981 ts_manager.cc:194] Registered new tserver with Master: f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105)
W20260709 12:25:28.958156 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:28.958485 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599928958457 us; error 0 us; skew 500 ppm
I20260709 12:25:28.959336 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:28.959997  4981 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59900
I20260709 12:25:28.962679 29609 webserver.cc:533] Webserver started at http://127.28.234.67:42443/ using document root <none> and password file <none>
I20260709 12:25:28.963318 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:28.963549 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:28.963826 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:28.964977 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "615728d432164b8b8d17360bb57d21d6"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.969877 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:28.973659  5196 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:28.974668 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:25:28.975018 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "615728d432164b8b8d17360bb57d21d6"
format_stamp: "Formatted at 2026-07-09 12:25:28 on dist-test-slave-8c39"
I20260709 12:25:28.975345 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:28.994498 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:28.995940 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:28.997651 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:29.001031 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:29.001478 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.001837 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:29.002056 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:29.047729 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:42101
I20260709 12:25:29.047886  5258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:42101 every 8 connection(s)
I20260709 12:25:29.063966  5259 heartbeater.cc:344] Connected to a master server at 127.28.234.126:41707
I20260709 12:25:29.064563  5259 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:29.065570  5259 heartbeater.cc:507] Master 127.28.234.126:41707 requested a full tablet report, sending...
I20260709 12:25:29.068434  4981 ts_manager.cc:194] Registered new tserver with Master: 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:29.068830 29609 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017639984s
I20260709 12:25:29.070657  4981 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59908
I20260709 12:25:29.098973  4981 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59922:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:29.101265  4981 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:29.185595  5148 tablet_service.cc:1511] Processing CreateTablet for tablet d95f59458aa546ba8e6a3176aa5923df (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53625c967f9c40cc98c171c20b3a41a5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:29.185348  5149 tablet_service.cc:1511] Processing CreateTablet for tablet 3a680434799241e389ec3788deb13027 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53625c967f9c40cc98c171c20b3a41a5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:29.187407  5148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95f59458aa546ba8e6a3176aa5923df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.189364  5149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a680434799241e389ec3788deb13027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.191594  5074 tablet_service.cc:1511] Processing CreateTablet for tablet 3a680434799241e389ec3788deb13027 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53625c967f9c40cc98c171c20b3a41a5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:29.191892  5073 tablet_service.cc:1511] Processing CreateTablet for tablet d95f59458aa546ba8e6a3176aa5923df (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53625c967f9c40cc98c171c20b3a41a5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:29.193120  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a680434799241e389ec3788deb13027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.194939  5223 tablet_service.cc:1511] Processing CreateTablet for tablet d95f59458aa546ba8e6a3176aa5923df (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53625c967f9c40cc98c171c20b3a41a5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:29.195677  5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95f59458aa546ba8e6a3176aa5923df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.196446  5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d95f59458aa546ba8e6a3176aa5923df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.194973  5224 tablet_service.cc:1511] Processing CreateTablet for tablet 3a680434799241e389ec3788deb13027 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=53625c967f9c40cc98c171c20b3a41a5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:29.202176  5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a680434799241e389ec3788deb13027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.248287  5275 tablet_bootstrap.cc:492] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7: Bootstrap starting.
I20260709 12:25:29.251343  5274 tablet_bootstrap.cc:492] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6: Bootstrap starting.
I20260709 12:25:29.257416  5275 tablet_bootstrap.cc:654] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.259262  5274 tablet_bootstrap.cc:654] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.270977  5275 tablet_bootstrap.cc:492] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7: No bootstrap required, opened a new log
I20260709 12:25:29.271678  5275 ts_tablet_manager.cc:1403] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 12:25:29.274207  5274 tablet_bootstrap.cc:492] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6: No bootstrap required, opened a new log
I20260709 12:25:29.275025  5274 ts_tablet_manager.cc:1403] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 12:25:29.275139  5275 raft_consensus.cc:359] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.276006  5275 raft_consensus.cc:385] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.275974  5278 tablet_bootstrap.cc:492] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c: Bootstrap starting.
I20260709 12:25:29.276382  5275 raft_consensus.cc:740] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ca2033876d426c86790927615960f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.277428  5275 consensus_queue.cc:260] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.279058  5274 raft_consensus.cc:359] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.280237  5274 raft_consensus.cc:385] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.280637  5274 raft_consensus.cc:740] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615728d432164b8b8d17360bb57d21d6, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.280777  5109 heartbeater.cc:499] Master 127.28.234.126:41707 was elected leader, sending a full tablet report...
I20260709 12:25:29.281520  5275 ts_tablet_manager.cc:1434] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:25:29.282123  5274 consensus_queue.cc:260] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.282671  5275 tablet_bootstrap.cc:492] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7: Bootstrap starting.
I20260709 12:25:29.287552  5278 tablet_bootstrap.cc:654] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.290525  5275 tablet_bootstrap.cc:654] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.298277  5259 heartbeater.cc:499] Master 127.28.234.126:41707 was elected leader, sending a full tablet report...
I20260709 12:25:29.301555  5274 ts_tablet_manager.cc:1434] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 12:25:29.303495  5274 tablet_bootstrap.cc:492] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6: Bootstrap starting.
I20260709 12:25:29.310460  5278 tablet_bootstrap.cc:492] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c: No bootstrap required, opened a new log
I20260709 12:25:29.311179  5278 ts_tablet_manager.cc:1403] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.004s
I20260709 12:25:29.315101  5278 raft_consensus.cc:359] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.315974  5278 raft_consensus.cc:385] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.316306  5278 raft_consensus.cc:740] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f046be59c08042b5a4c52f31593aaf9c, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.317108  5274 tablet_bootstrap.cc:654] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.317140  5278 consensus_queue.cc:260] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.321815  5275 tablet_bootstrap.cc:492] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7: No bootstrap required, opened a new log
I20260709 12:25:29.323015  5275 ts_tablet_manager.cc:1403] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.021s
I20260709 12:25:29.327327  5185 heartbeater.cc:499] Master 127.28.234.126:41707 was elected leader, sending a full tablet report...
I20260709 12:25:29.327894  5278 ts_tablet_manager.cc:1434] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.009s
I20260709 12:25:29.328893  5278 tablet_bootstrap.cc:492] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c: Bootstrap starting.
I20260709 12:25:29.334664  5274 tablet_bootstrap.cc:492] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6: No bootstrap required, opened a new log
I20260709 12:25:29.335337  5274 ts_tablet_manager.cc:1403] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.008s
I20260709 12:25:29.335273  5275 raft_consensus.cc:359] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.336251  5275 raft_consensus.cc:385] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.336614  5275 raft_consensus.cc:740] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ca2033876d426c86790927615960f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.337779  5275 consensus_queue.cc:260] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.339793  5274 raft_consensus.cc:359] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.340723  5274 raft_consensus.cc:385] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.341336  5274 raft_consensus.cc:740] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615728d432164b8b8d17360bb57d21d6, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.341782  5278 tablet_bootstrap.cc:654] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.342682  5274 consensus_queue.cc:260] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.346000  5274 ts_tablet_manager.cc:1434] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:25:29.348071  5275 ts_tablet_manager.cc:1434] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.004s
I20260709 12:25:29.352398  5278 tablet_bootstrap.cc:492] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c: No bootstrap required, opened a new log
I20260709 12:25:29.353333  5278 ts_tablet_manager.cc:1403] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.008s
I20260709 12:25:29.355690  5280 raft_consensus.cc:493] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.356287  5279 raft_consensus.cc:493] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.356856  5279 raft_consensus.cc:515] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.357417  5278 raft_consensus.cc:359] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.358479  5278 raft_consensus.cc:385] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.358806  5278 raft_consensus.cc:740] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f046be59c08042b5a4c52f31593aaf9c, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.359877  5278 consensus_queue.cc:260] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.356325  5280 raft_consensus.cc:515] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.363471  5278 ts_tablet_manager.cc:1434] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.003s
I20260709 12:25:29.364241  5279 leader_election.cc:290] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105), 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:29.370149  5280 leader_election.cc:290] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5ca2033876d426c86790927615960f7 (127.28.234.65:36413), f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105)
I20260709 12:25:29.388566  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a680434799241e389ec3788deb13027" candidate_uuid: "615728d432164b8b8d17360bb57d21d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ca2033876d426c86790927615960f7" is_pre_election: true
I20260709 12:25:29.389530  5084 raft_consensus.cc:2468] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615728d432164b8b8d17360bb57d21d6 in term 0.
I20260709 12:25:29.390954  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95f59458aa546ba8e6a3176aa5923df" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c" is_pre_election: true
I20260709 12:25:29.391122  5197 leader_election.cc:304] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615728d432164b8b8d17360bb57d21d6, b5ca2033876d426c86790927615960f7; no voters: 
I20260709 12:25:29.391842  5160 raft_consensus.cc:2468] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 0.
I20260709 12:25:29.393198  5280 raft_consensus.cc:2804] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.393673  5280 raft_consensus.cc:493] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.394052  5280 raft_consensus.cc:3060] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.398144  5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95f59458aa546ba8e6a3176aa5923df" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615728d432164b8b8d17360bb57d21d6" is_pre_election: true
I20260709 12:25:29.399428  5234 raft_consensus.cc:2468] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 0.
I20260709 12:25:29.399797  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a680434799241e389ec3788deb13027" candidate_uuid: "615728d432164b8b8d17360bb57d21d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c" is_pre_election: true
I20260709 12:25:29.401104  5050 leader_election.cc:304] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5ca2033876d426c86790927615960f7, f046be59c08042b5a4c52f31593aaf9c; no voters: 
I20260709 12:25:29.402578  5160 raft_consensus.cc:2468] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 615728d432164b8b8d17360bb57d21d6 in term 0.
I20260709 12:25:29.405426  5279 raft_consensus.cc:2804] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.406343  5279 raft_consensus.cc:493] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.406909  5279 raft_consensus.cc:3060] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.412284  5280 raft_consensus.cc:515] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.416626  5280 leader_election.cc:290] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [CANDIDATE]: Term 1 election: Requested vote from peers b5ca2033876d426c86790927615960f7 (127.28.234.65:36413), f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105)
I20260709 12:25:29.416847  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a680434799241e389ec3788deb13027" candidate_uuid: "615728d432164b8b8d17360bb57d21d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ca2033876d426c86790927615960f7"
I20260709 12:25:29.417625  5160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a680434799241e389ec3788deb13027" candidate_uuid: "615728d432164b8b8d17360bb57d21d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c"
I20260709 12:25:29.417701  5084 raft_consensus.cc:3060] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.418383  5160 raft_consensus.cc:3060] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.419809  5279 raft_consensus.cc:515] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.424114  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95f59458aa546ba8e6a3176aa5923df" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c"
I20260709 12:25:29.424789  5279 leader_election.cc:290] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 election: Requested vote from peers f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105), 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:29.425405  5158 raft_consensus.cc:3060] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.424168  5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d95f59458aa546ba8e6a3176aa5923df" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615728d432164b8b8d17360bb57d21d6"
I20260709 12:25:29.427292  5234 raft_consensus.cc:3060] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.429551  5160 raft_consensus.cc:2468] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615728d432164b8b8d17360bb57d21d6 in term 1.
I20260709 12:25:29.429550  5084 raft_consensus.cc:2468] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 615728d432164b8b8d17360bb57d21d6 in term 1.
I20260709 12:25:29.431594  5200 leader_election.cc:304] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615728d432164b8b8d17360bb57d21d6, f046be59c08042b5a4c52f31593aaf9c; no voters: 
I20260709 12:25:29.432695  5280 raft_consensus.cc:2804] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.434211  5280 raft_consensus.cc:697] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 1 LEADER]: Becoming Leader. State: Replica: 615728d432164b8b8d17360bb57d21d6, State: Running, Role: LEADER
I20260709 12:25:29.435226  5280 consensus_queue.cc:237] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.436905  5234 raft_consensus.cc:2468] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 1.
I20260709 12:25:29.438796  5049 leader_election.cc:304] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615728d432164b8b8d17360bb57d21d6, b5ca2033876d426c86790927615960f7; no voters: 
I20260709 12:25:29.440256  5279 raft_consensus.cc:2804] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.440979  5158 raft_consensus.cc:2468] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 1.
I20260709 12:25:29.444169  5279 raft_consensus.cc:697] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Becoming Leader. State: Replica: b5ca2033876d426c86790927615960f7, State: Running, Role: LEADER
I20260709 12:25:29.445293  5279 consensus_queue.cc:237] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.448747  4978 catalog_manager.cc:5697] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 615728d432164b8b8d17360bb57d21d6 (127.28.234.67). New cstate: current_term: 1 leader_uuid: "615728d432164b8b8d17360bb57d21d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:29.457665  4979 catalog_manager.cc:5697] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ca2033876d426c86790927615960f7 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "b5ca2033876d426c86790927615960f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.539671  4979 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41098:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:29.542753  4979 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:29.574553  5073 tablet_service.cc:1511] Processing CreateTablet for tablet 04ea62d3314c417b9715282c83a7df3d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=110854dd85fe4cb2a6a7fe9a8df7f94a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:29.576031  5073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ea62d3314c417b9715282c83a7df3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.575431  5148 tablet_service.cc:1511] Processing CreateTablet for tablet 04ea62d3314c417b9715282c83a7df3d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=110854dd85fe4cb2a6a7fe9a8df7f94a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:29.577296  5148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ea62d3314c417b9715282c83a7df3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.577732  5223 tablet_service.cc:1511] Processing CreateTablet for tablet 04ea62d3314c417b9715282c83a7df3d (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=110854dd85fe4cb2a6a7fe9a8df7f94a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:25:29.579154  5223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04ea62d3314c417b9715282c83a7df3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.581215  5074 tablet_service.cc:1511] Processing CreateTablet for tablet cff06e8662144c25b385fa7ff761ebb3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=110854dd85fe4cb2a6a7fe9a8df7f94a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:29.582609  5074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff06e8662144c25b385fa7ff761ebb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.587061  5149 tablet_service.cc:1511] Processing CreateTablet for tablet cff06e8662144c25b385fa7ff761ebb3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=110854dd85fe4cb2a6a7fe9a8df7f94a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:29.588577  5149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff06e8662144c25b385fa7ff761ebb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.592399  5224 tablet_service.cc:1511] Processing CreateTablet for tablet cff06e8662144c25b385fa7ff761ebb3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=110854dd85fe4cb2a6a7fe9a8df7f94a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:25:29.594599  5224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cff06e8662144c25b385fa7ff761ebb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:29.596488  5275 tablet_bootstrap.cc:492] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: Bootstrap starting.
I20260709 12:25:29.603909  5275 tablet_bootstrap.cc:654] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.612547  5275 tablet_bootstrap.cc:492] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: No bootstrap required, opened a new log
I20260709 12:25:29.613234  5275 ts_tablet_manager.cc:1403] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 12:25:29.616915  5275 raft_consensus.cc:359] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.617792  5275 raft_consensus.cc:385] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.618206  5275 raft_consensus.cc:740] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ca2033876d426c86790927615960f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.619155  5275 consensus_queue.cc:260] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.620244  5278 tablet_bootstrap.cc:492] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: Bootstrap starting.
I20260709 12:25:29.623718  5275 ts_tablet_manager.cc:1434] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:25:29.625217  5275 tablet_bootstrap.cc:492] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7: Bootstrap starting.
I20260709 12:25:29.628633  5278 tablet_bootstrap.cc:654] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.633188  5274 tablet_bootstrap.cc:492] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6: Bootstrap starting.
I20260709 12:25:29.639123  5275 tablet_bootstrap.cc:654] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.641177  5274 tablet_bootstrap.cc:654] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.643348  5278 tablet_bootstrap.cc:492] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: No bootstrap required, opened a new log
I20260709 12:25:29.644086  5278 ts_tablet_manager.cc:1403] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.012s
I20260709 12:25:29.647913  5278 raft_consensus.cc:359] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.648435  5274 tablet_bootstrap.cc:492] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6: No bootstrap required, opened a new log
I20260709 12:25:29.648676  5275 tablet_bootstrap.cc:492] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7: No bootstrap required, opened a new log
I20260709 12:25:29.648686  5278 raft_consensus.cc:385] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.649093  5274 ts_tablet_manager.cc:1403] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 12:25:29.649266  5275 ts_tablet_manager.cc:1403] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.009s
I20260709 12:25:29.649472  5278 raft_consensus.cc:740] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f046be59c08042b5a4c52f31593aaf9c, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.650570  5278 consensus_queue.cc:260] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.652606  5278 ts_tablet_manager.cc:1434] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:29.652427  5274 raft_consensus.cc:359] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.653286  5274 raft_consensus.cc:385] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.653604  5274 raft_consensus.cc:740] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615728d432164b8b8d17360bb57d21d6, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.653862  5278 tablet_bootstrap.cc:492] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c: Bootstrap starting.
I20260709 12:25:29.654507  5274 consensus_queue.cc:260] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.654663  5275 raft_consensus.cc:359] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.655530  5275 raft_consensus.cc:385] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.655857  5275 raft_consensus.cc:740] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ca2033876d426c86790927615960f7, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.657007  5274 ts_tablet_manager.cc:1434] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:29.658143  5274 tablet_bootstrap.cc:492] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6: Bootstrap starting.
I20260709 12:25:29.656769  5275 consensus_queue.cc:260] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.666752  5278 tablet_bootstrap.cc:654] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.666971  5274 tablet_bootstrap.cc:654] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:29.669893  5279 raft_consensus.cc:493] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.670605  5279 raft_consensus.cc:515] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.675546  5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615728d432164b8b8d17360bb57d21d6" is_pre_election: true
I20260709 12:25:29.676481  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c" is_pre_election: true
I20260709 12:25:29.679054  5279 leader_election.cc:290] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105), 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:29.676544  5234 raft_consensus.cc:2468] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 0.
I20260709 12:25:29.681486  5049 leader_election.cc:304] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615728d432164b8b8d17360bb57d21d6, b5ca2033876d426c86790927615960f7; no voters: 
I20260709 12:25:29.677587  5158 raft_consensus.cc:2468] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 0.
I20260709 12:25:29.683120  5279 raft_consensus.cc:2804] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.684535  5279 raft_consensus.cc:493] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.685179  5279 raft_consensus.cc:3060] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.700498  5275 ts_tablet_manager.cc:1434] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.004s
I20260709 12:25:29.702811  5274 tablet_bootstrap.cc:492] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6: No bootstrap required, opened a new log
I20260709 12:25:29.703555  5274 ts_tablet_manager.cc:1403] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.016s
I20260709 12:25:29.704931  5278 tablet_bootstrap.cc:492] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c: No bootstrap required, opened a new log
I20260709 12:25:29.705570  5278 ts_tablet_manager.cc:1403] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.031s
I20260709 12:25:29.706204  5274 raft_consensus.cc:359] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.706878  5274 raft_consensus.cc:385] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.707149  5274 raft_consensus.cc:740] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 615728d432164b8b8d17360bb57d21d6, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.707203  5279 raft_consensus.cc:515] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.707916  5274 consensus_queue.cc:260] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.710223  5274 ts_tablet_manager.cc:1434] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:25:29.711220  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c"
I20260709 12:25:29.711089  5278 raft_consensus.cc:359] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.711962  5158 raft_consensus.cc:3060] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.712008  5278 raft_consensus.cc:385] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:29.712595  5278 raft_consensus.cc:740] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f046be59c08042b5a4c52f31593aaf9c, State: Initialized, Role: FOLLOWER
I20260709 12:25:29.713785  5278 consensus_queue.cc:260] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.715931  5278 ts_tablet_manager.cc:1434] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:29.719005  5279 leader_election.cc:290] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 election: Requested vote from peers f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105), 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:29.720657  5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615728d432164b8b8d17360bb57d21d6"
I20260709 12:25:29.721364  5234 raft_consensus.cc:3060] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.729140  5234 raft_consensus.cc:2468] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 1.
I20260709 12:25:29.729838  5158 raft_consensus.cc:2468] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 1.
I20260709 12:25:29.730334  5049 leader_election.cc:304] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 615728d432164b8b8d17360bb57d21d6, b5ca2033876d426c86790927615960f7; no voters: 
I20260709 12:25:29.731384  5279 raft_consensus.cc:2804] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.731818  5279 raft_consensus.cc:697] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Becoming Leader. State: Replica: b5ca2033876d426c86790927615960f7, State: Running, Role: LEADER
I20260709 12:25:29.732632  5279 consensus_queue.cc:237] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.739991  4978 catalog_manager.cc:5697] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ca2033876d426c86790927615960f7 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "b5ca2033876d426c86790927615960f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.828639  5280 consensus_queue.cc:1048] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:29.846385  5290 consensus_queue.cc:1048] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:29.907051  5279 raft_consensus.cc:493] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.907603  5279 raft_consensus.cc:515] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.909551  5279 leader_election.cc:290] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105), 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:29.910509  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ea62d3314c417b9715282c83a7df3d" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c" is_pre_election: true
I20260709 12:25:29.910712  5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ea62d3314c417b9715282c83a7df3d" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615728d432164b8b8d17360bb57d21d6" is_pre_election: true
I20260709 12:25:29.911213  5158 raft_consensus.cc:2468] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 0.
I20260709 12:25:29.911626  5234 raft_consensus.cc:2468] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 0.
I20260709 12:25:29.912647  5050 leader_election.cc:304] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5ca2033876d426c86790927615960f7, f046be59c08042b5a4c52f31593aaf9c; no voters: 
I20260709 12:25:29.913465  5279 raft_consensus.cc:2804] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:29.913870  5279 raft_consensus.cc:493] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.914116  5279 raft_consensus.cc:3060] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.920399  5279 raft_consensus.cc:515] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.922549  5279 leader_election.cc:290] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 election: Requested vote from peers f046be59c08042b5a4c52f31593aaf9c (127.28.234.66:41105), 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:29.923477  5158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ea62d3314c417b9715282c83a7df3d" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f046be59c08042b5a4c52f31593aaf9c"
I20260709 12:25:29.923717  5234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04ea62d3314c417b9715282c83a7df3d" candidate_uuid: "b5ca2033876d426c86790927615960f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "615728d432164b8b8d17360bb57d21d6"
I20260709 12:25:29.924358  5234 raft_consensus.cc:3060] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.924441  5158 raft_consensus.cc:3060] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:29.930891  5158 raft_consensus.cc:2468] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 1.
I20260709 12:25:29.931576  5234 raft_consensus.cc:2468] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ca2033876d426c86790927615960f7 in term 1.
I20260709 12:25:29.932143  5050 leader_election.cc:304] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5ca2033876d426c86790927615960f7, f046be59c08042b5a4c52f31593aaf9c; no voters: 
I20260709 12:25:29.933148  5279 raft_consensus.cc:2804] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:29.933615  5279 raft_consensus.cc:697] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Becoming Leader. State: Replica: b5ca2033876d426c86790927615960f7, State: Running, Role: LEADER
I20260709 12:25:29.934396  5279 consensus_queue.cc:237] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:29.942880  4978 catalog_manager.cc:5697] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ca2033876d426c86790927615960f7 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "b5ca2033876d426c86790927615960f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:30.004804  5279 consensus_queue.cc:1048] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:30.017905  5233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a680434799241e389ec3788deb13027"
dest_uuid: "615728d432164b8b8d17360bb57d21d6"
mode: GRACEFUL
new_leader_uuid: "b5ca2033876d426c86790927615960f7"
 from {username='slave'} at 127.0.0.1:35188
I20260709 12:25:30.018643  5233 raft_consensus.cc:606] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 1 LEADER]: Received request to transfer leadership to TS b5ca2033876d426c86790927615960f7
I20260709 12:25:30.020057  5292 consensus_queue.cc:1048] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:30.043154  5084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d95f59458aa546ba8e6a3176aa5923df"
dest_uuid: "b5ca2033876d426c86790927615960f7"
mode: GRACEFUL
new_leader_uuid: "615728d432164b8b8d17360bb57d21d6"
 from {username='slave'} at 127.0.0.1:54034
I20260709 12:25:30.043809  5084 raft_consensus.cc:606] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Received request to transfer leadership to TS 615728d432164b8b8d17360bb57d21d6
I20260709 12:25:30.077684 29609 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:25:30.079522 29609 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:25:30.079967 29609 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:25:30.092214  5084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3"
dest_uuid: "b5ca2033876d426c86790927615960f7"
mode: GRACEFUL
new_leader_uuid: "f046be59c08042b5a4c52f31593aaf9c"
 from {username='slave'} at 127.0.0.1:54036
I20260709 12:25:30.092746  5084 raft_consensus.cc:606] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Received request to transfer leadership to TS f046be59c08042b5a4c52f31593aaf9c
I20260709 12:25:30.093958 29609 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:25:30.198457  5279 consensus_queue.cc:1048] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:30.207340  5317 raft_consensus.cc:993] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7: : Instructing follower f046be59c08042b5a4c52f31593aaf9c to start an election
I20260709 12:25:30.208112  5292 raft_consensus.cc:1081] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Signalling peer f046be59c08042b5a4c52f31593aaf9c to start an election
I20260709 12:25:30.214622  5292 consensus_queue.cc:1048] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:30.214818  5160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3"
dest_uuid: "f046be59c08042b5a4c52f31593aaf9c"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:25:30.215695  5160 raft_consensus.cc:493] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:30.216112  5160 raft_consensus.cc:3060] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:30.224203  5160 raft_consensus.cc:515] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:30.238296  5160 leader_election.cc:290] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [CANDIDATE]: Term 2 election: Requested vote from peers b5ca2033876d426c86790927615960f7 (127.28.234.65:36413), 615728d432164b8b8d17360bb57d21d6 (127.28.234.67:42101)
I20260709 12:25:30.244585  5084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3" candidate_uuid: "f046be59c08042b5a4c52f31593aaf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ca2033876d426c86790927615960f7"
I20260709 12:25:30.245294  5084 raft_consensus.cc:3055] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:30.245651  5084 raft_consensus.cc:740] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5ca2033876d426c86790927615960f7, State: Running, Role: LEADER
I20260709 12:25:30.246625  5084 consensus_queue.cc:260] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:30.247797  5084 raft_consensus.cc:3060] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:30.250388  5233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cff06e8662144c25b385fa7ff761ebb3" candidate_uuid: "f046be59c08042b5a4c52f31593aaf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "615728d432164b8b8d17360bb57d21d6"
I20260709 12:25:30.251149  5233 raft_consensus.cc:3060] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:30.255931  5084 raft_consensus.cc:2468] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f046be59c08042b5a4c52f31593aaf9c in term 2.
I20260709 12:25:30.257350  5122 leader_election.cc:304] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5ca2033876d426c86790927615960f7, f046be59c08042b5a4c52f31593aaf9c; no voters: 
I20260709 12:25:30.258230  5283 raft_consensus.cc:2804] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:30.259341  5283 raft_consensus.cc:697] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 2 LEADER]: Becoming Leader. State: Replica: f046be59c08042b5a4c52f31593aaf9c, State: Running, Role: LEADER
I20260709 12:25:30.259545  5233 raft_consensus.cc:2468] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f046be59c08042b5a4c52f31593aaf9c in term 2.
I20260709 12:25:30.260285  5283 consensus_queue.cc:237] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } }
I20260709 12:25:30.267861  4981 catalog_manager.cc:5697] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c reported cstate change: term changed from 1 to 2, leader changed from b5ca2033876d426c86790927615960f7 (127.28.234.65) to f046be59c08042b5a4c52f31593aaf9c (127.28.234.66). New cstate: current_term: 2 leader_uuid: "f046be59c08042b5a4c52f31593aaf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5ca2033876d426c86790927615960f7" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 36413 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f046be59c08042b5a4c52f31593aaf9c" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "615728d432164b8b8d17360bb57d21d6" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 42101 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:30.324229 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
I20260709 12:25:30.350723 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:30.351533 29609 tablet_replica.cc:333] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7: stopping tablet replica
I20260709 12:25:30.352504 29609 raft_consensus.cc:2243] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.353045 29609 raft_consensus.cc:2272] T cff06e8662144c25b385fa7ff761ebb3 P b5ca2033876d426c86790927615960f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.355894 29609 tablet_replica.cc:333] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: stopping tablet replica
I20260709 12:25:30.356492 29609 raft_consensus.cc:2243] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.357197 29609 pending_rounds.cc:70] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: Trying to abort 1 pending ops.
I20260709 12:25:30.357474 29609 pending_rounds.cc:77] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625313018351616 op_type: NO_OP noop_request { }
I20260709 12:25:30.357872 29609 raft_consensus.cc:2889] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:30.358222 29609 raft_consensus.cc:2272] T 04ea62d3314c417b9715282c83a7df3d P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.361611 29609 tablet_replica.cc:333] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7: stopping tablet replica
I20260709 12:25:30.362222 29609 raft_consensus.cc:2243] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.363052 29609 raft_consensus.cc:2272] T d95f59458aa546ba8e6a3176aa5923df P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.365336 29609 tablet_replica.cc:333] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7: stopping tablet replica
I20260709 12:25:30.365958 29609 raft_consensus.cc:2243] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.366407 29609 raft_consensus.cc:2272] T 3a680434799241e389ec3788deb13027 P b5ca2033876d426c86790927615960f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.392186 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
I20260709 12:25:30.405835 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
I20260709 12:25:30.429090 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:30.429946 29609 tablet_replica.cc:333] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c: stopping tablet replica
I20260709 12:25:30.430665 29609 raft_consensus.cc:2243] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.431203 29609 raft_consensus.cc:2272] T 04ea62d3314c417b9715282c83a7df3d P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:30.433403  5197 consensus_peers.cc:597] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 -> Peer b5ca2033876d426c86790927615960f7 (127.28.234.65:36413): Couldn't send request to peer b5ca2033876d426c86790927615960f7. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:36413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:30.433954 29609 tablet_replica.cc:333] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: stopping tablet replica
I20260709 12:25:30.434670 29609 raft_consensus.cc:2243] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.435334 29609 pending_rounds.cc:70] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: Trying to abort 1 pending ops.
I20260709 12:25:30.435521 29609 pending_rounds.cc:77] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625314355605504 op_type: NO_OP noop_request { }
I20260709 12:25:30.435773 29609 raft_consensus.cc:2889] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:25:30.436034 29609 raft_consensus.cc:2272] T cff06e8662144c25b385fa7ff761ebb3 P f046be59c08042b5a4c52f31593aaf9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.438657 29609 tablet_replica.cc:333] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c: stopping tablet replica
I20260709 12:25:30.439358 29609 raft_consensus.cc:2243] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.439854 29609 raft_consensus.cc:2272] T d95f59458aa546ba8e6a3176aa5923df P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.443013 29609 tablet_replica.cc:333] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c: stopping tablet replica
I20260709 12:25:30.443543 29609 raft_consensus.cc:2243] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.443976 29609 raft_consensus.cc:2272] T 3a680434799241e389ec3788deb13027 P f046be59c08042b5a4c52f31593aaf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.470897 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
I20260709 12:25:30.485420 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
I20260709 12:25:30.505256 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:30.506117 29609 tablet_replica.cc:333] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6: stopping tablet replica
I20260709 12:25:30.506744 29609 raft_consensus.cc:2243] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.507225 29609 raft_consensus.cc:2272] T 04ea62d3314c417b9715282c83a7df3d P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.509330 29609 tablet_replica.cc:333] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6: stopping tablet replica
I20260709 12:25:30.509997 29609 raft_consensus.cc:2243] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.510447 29609 raft_consensus.cc:2272] T cff06e8662144c25b385fa7ff761ebb3 P 615728d432164b8b8d17360bb57d21d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.513187 29609 tablet_replica.cc:333] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6: stopping tablet replica
I20260709 12:25:30.513697 29609 raft_consensus.cc:2243] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.514647 29609 raft_consensus.cc:2272] T 3a680434799241e389ec3788deb13027 P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.517066 29609 tablet_replica.cc:333] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6: stopping tablet replica
I20260709 12:25:30.517529 29609 raft_consensus.cc:2243] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:30.518003 29609 raft_consensus.cc:2272] T d95f59458aa546ba8e6a3176aa5923df P 615728d432164b8b8d17360bb57d21d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.543049 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
I20260709 12:25:30.558662 29609 master.cc:562] Master@127.28.234.126:41707 shutting down...
I20260709 12:25:30.577456 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:30.578145 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:30.578691 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P e10cda867e2b46aaba5a5e21d820c2ae: stopping tablet replica
I20260709 12:25:30.600771 29609 master.cc:584] Master@127.28.234.126:41707 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2252 ms)
[----------] 6 tests from LeaderRebalancerTest (295861 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:25:30.632902 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:40709
I20260709 12:25:30.634166 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:30.639986  5330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:30.640108  5331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:30.641677  5333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:30.642975 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:30.644095 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:30.644348 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:30.644552 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599930644532 us; error 0 us; skew 500 ppm
I20260709 12:25:30.645296 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:30.648022 29609 webserver.cc:533] Webserver started at http://127.28.234.126:44179/ using document root <none> and password file <none>
I20260709 12:25:30.648608 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:30.648851 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:30.649159 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:30.650473 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "92afaf84023c499a9805d666fba8aac7"
format_stamp: "Formatted at 2026-07-09 12:25:30 on dist-test-slave-8c39"
I20260709 12:25:30.656255 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 12:25:30.659970  5338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:30.661087 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:30.661384 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "92afaf84023c499a9805d666fba8aac7"
format_stamp: "Formatted at 2026-07-09 12:25:30 on dist-test-slave-8c39"
I20260709 12:25:30.661679 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:30.676546 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:30.677637 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:30.720463 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:40709
I20260709 12:25:30.720589  5389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:40709 every 8 connection(s)
I20260709 12:25:30.725150  5390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:30.738677  5390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7: Bootstrap starting.
I20260709 12:25:30.744170  5390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:30.748847  5390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7: No bootstrap required, opened a new log
I20260709 12:25:30.751238  5390 raft_consensus.cc:359] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92afaf84023c499a9805d666fba8aac7" member_type: VOTER }
I20260709 12:25:30.751653  5390 raft_consensus.cc:385] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:30.751947  5390 raft_consensus.cc:740] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92afaf84023c499a9805d666fba8aac7, State: Initialized, Role: FOLLOWER
I20260709 12:25:30.752595  5390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92afaf84023c499a9805d666fba8aac7" member_type: VOTER }
I20260709 12:25:30.753072  5390 raft_consensus.cc:399] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:30.753348  5390 raft_consensus.cc:493] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:30.753649  5390 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:30.761693  5390 raft_consensus.cc:515] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92afaf84023c499a9805d666fba8aac7" member_type: VOTER }
I20260709 12:25:30.762378  5390 leader_election.cc:304] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92afaf84023c499a9805d666fba8aac7; no voters: 
I20260709 12:25:30.763885  5390 leader_election.cc:290] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:30.764268  5393 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:30.765836  5393 raft_consensus.cc:697] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 1 LEADER]: Becoming Leader. State: Replica: 92afaf84023c499a9805d666fba8aac7, State: Running, Role: LEADER
I20260709 12:25:30.766610  5393 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92afaf84023c499a9805d666fba8aac7" member_type: VOTER }
I20260709 12:25:30.767006  5390 sys_catalog.cc:565] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:30.769701  5394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92afaf84023c499a9805d666fba8aac7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92afaf84023c499a9805d666fba8aac7" member_type: VOTER } }
I20260709 12:25:30.769719  5395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92afaf84023c499a9805d666fba8aac7. Latest consensus state: current_term: 1 leader_uuid: "92afaf84023c499a9805d666fba8aac7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92afaf84023c499a9805d666fba8aac7" member_type: VOTER } }
I20260709 12:25:30.770510  5394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:30.770521  5395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:30.777495  5398 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:30.786206  5398 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:30.787477 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:30.796926  5398 catalog_manager.cc:1383] Generated new cluster ID: 5f462b857f8c47c0ab2ed10076bd6884
I20260709 12:25:30.797252  5398 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:30.825276  5398 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:30.826982  5398 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:30.846493  5398 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7: Generated new TSK 0
I20260709 12:25:30.847333  5398 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:30.854588 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:30.861909  5411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:30.863497  5412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:30.867122  5414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:30.867178 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:30.868593 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:30.868835 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:30.869205 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599930869174 us; error 0 us; skew 500 ppm
I20260709 12:25:30.869890 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:30.872797 29609 webserver.cc:533] Webserver started at http://127.28.234.65:42711/ using document root <none> and password file <none>
I20260709 12:25:30.873356 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:30.873584 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:30.873950 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:30.875172 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "52f6deb1e451449982a9496ac99ddb32"
format_stamp: "Formatted at 2026-07-09 12:25:30 on dist-test-slave-8c39"
I20260709 12:25:30.880415 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:30.884368  5419 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:30.885373 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:30.885848 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "52f6deb1e451449982a9496ac99ddb32"
format_stamp: "Formatted at 2026-07-09 12:25:30 on dist-test-slave-8c39"
I20260709 12:25:30.886142 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:30.915367 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:30.916538 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:30.918063 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:30.920632 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:30.920845 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:30.921075 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:30.921255 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:30.969952 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:33881
I20260709 12:25:30.970098  5482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:33881 every 8 connection(s)
I20260709 12:25:30.975663 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:30.984544  5487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:30.985965  5488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:30.988255 29609 server_base.cc:1061] running on GCE node
W20260709 12:25:30.990207  5490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:30.990768  5483 heartbeater.cc:344] Connected to a master server at 127.28.234.126:40709
I20260709 12:25:30.991283  5483 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:30.991432 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:30.991778 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:30.991962 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599930991947 us; error 0 us; skew 500 ppm
I20260709 12:25:30.992416  5483 heartbeater.cc:507] Master 127.28.234.126:40709 requested a full tablet report, sending...
I20260709 12:25:30.992695 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:30.995409  5355 ts_manager.cc:194] Registered new tserver with Master: 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881)
I20260709 12:25:30.996352 29609 webserver.cc:533] Webserver started at http://127.28.234.66:44245/ using document root <none> and password file <none>
I20260709 12:25:30.997232 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:30.997505 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:30.997887 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:30.998436  5355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57218
I20260709 12:25:30.999581 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
format_stamp: "Formatted at 2026-07-09 12:25:30 on dist-test-slave-8c39"
I20260709 12:25:31.005306 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.005s
I20260709 12:25:31.009379  5495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:31.010818 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:25:31.011252 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
format_stamp: "Formatted at 2026-07-09 12:25:30 on dist-test-slave-8c39"
I20260709 12:25:31.011600 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:31.033702 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:31.035104 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:31.036762 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:31.039453 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:31.039724 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:31.040045 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:31.040269 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:31.088312 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:40507
I20260709 12:25:31.088415  5557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:40507 every 8 connection(s)
I20260709 12:25:31.093495 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:31.101989  5561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:31.103186  5562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:31.107278  5564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:31.107513  5558 heartbeater.cc:344] Connected to a master server at 127.28.234.126:40709
I20260709 12:25:31.107839 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:31.108098  5558 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:31.109102 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:31.109148  5558 heartbeater.cc:507] Master 127.28.234.126:40709 requested a full tablet report, sending...
W20260709 12:25:31.109483 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:31.109715 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599931109694 us; error 0 us; skew 500 ppm
I20260709 12:25:31.110523 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:31.112192  5355 ts_manager.cc:194] Registered new tserver with Master: 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:31.113925 29609 webserver.cc:533] Webserver started at http://127.28.234.67:36029/ using document root <none> and password file <none>
I20260709 12:25:31.114687  5355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57224
I20260709 12:25:31.114862 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:31.115309 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:31.115695 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:31.117308 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "30d0815aa09840b3a5457d9de2b0e19c"
format_stamp: "Formatted at 2026-07-09 12:25:31 on dist-test-slave-8c39"
I20260709 12:25:31.122571 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:31.126703  5569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:31.127673 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:25:31.128079 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "30d0815aa09840b3a5457d9de2b0e19c"
format_stamp: "Formatted at 2026-07-09 12:25:31 on dist-test-slave-8c39"
I20260709 12:25:31.128379 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:31.145709 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:31.147042 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:31.148720 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:31.151400 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:31.151643 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:31.151971 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:31.152153 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:31.198033 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:45293
I20260709 12:25:31.198218  5631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:45293 every 8 connection(s)
I20260709 12:25:31.213814  5632 heartbeater.cc:344] Connected to a master server at 127.28.234.126:40709
I20260709 12:25:31.214362  5632 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:31.215302  5632 heartbeater.cc:507] Master 127.28.234.126:40709 requested a full tablet report, sending...
I20260709 12:25:31.217710  5355 ts_manager.cc:194] Registered new tserver with Master: 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:31.218492 29609 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01660292s
I20260709 12:25:31.219424  5355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57226
I20260709 12:25:31.246840  5355 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57228:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:31.250003  5355 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:31.322882  5522 tablet_service.cc:1511] Processing CreateTablet for tablet 7957372b6d5542a68131ad43f61517ed (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:31.323290  5523 tablet_service.cc:1511] Processing CreateTablet for tablet 17b9eb9d1e9a4e2ba998cfdcf3ac648e (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:31.324492  5522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7957372b6d5542a68131ad43f61517ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.325234  5523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b9eb9d1e9a4e2ba998cfdcf3ac648e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.326774  5521 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2a0ad0a57d49eda00600a43d2dbfe2 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:31.328536  5521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2a0ad0a57d49eda00600a43d2dbfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.332166  5520 tablet_service.cc:1511] Processing CreateTablet for tablet e2d216217c964b919ef4bd4a0ba34ba9 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:31.333711  5520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d216217c964b919ef4bd4a0ba34ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.337587  5519 tablet_service.cc:1511] Processing CreateTablet for tablet 5fedaf4fb4f0418ababe85ed2553bf34 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:31.339258  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fedaf4fb4f0418ababe85ed2553bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.340327  5518 tablet_service.cc:1511] Processing CreateTablet for tablet 877002e003da46fd833919b7b57ba1f4 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:31.341866  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877002e003da46fd833919b7b57ba1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.344141  5447 tablet_service.cc:1511] Processing CreateTablet for tablet 17b9eb9d1e9a4e2ba998cfdcf3ac648e (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:31.346035  5447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b9eb9d1e9a4e2ba998cfdcf3ac648e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.349180  5446 tablet_service.cc:1511] Processing CreateTablet for tablet 7957372b6d5542a68131ad43f61517ed (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:31.351051  5446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7957372b6d5542a68131ad43f61517ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.355573  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2a0ad0a57d49eda00600a43d2dbfe2 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:31.357555  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2a0ad0a57d49eda00600a43d2dbfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.361024  5444 tablet_service.cc:1511] Processing CreateTablet for tablet e2d216217c964b919ef4bd4a0ba34ba9 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:31.363243  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d216217c964b919ef4bd4a0ba34ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.368374  5517 tablet_service.cc:1511] Processing CreateTablet for tablet bfb82a3bf6a540179033575f9887dae2 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:31.370262  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb82a3bf6a540179033575f9887dae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.374619  5516 tablet_service.cc:1511] Processing CreateTablet for tablet ac87e6e2662846f6bf75d974ba3a21b3 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:31.375156  5443 tablet_service.cc:1511] Processing CreateTablet for tablet 5fedaf4fb4f0418ababe85ed2553bf34 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:31.376259  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac87e6e2662846f6bf75d974ba3a21b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.376691  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fedaf4fb4f0418ababe85ed2553bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.379383  5442 tablet_service.cc:1511] Processing CreateTablet for tablet 877002e003da46fd833919b7b57ba1f4 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:31.380718  5515 tablet_service.cc:1511] Processing CreateTablet for tablet b049956c58af4c579dad64d304c90dd0 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:31.382248  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b049956c58af4c579dad64d304c90dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.386305  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877002e003da46fd833919b7b57ba1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.391722  5441 tablet_service.cc:1511] Processing CreateTablet for tablet bfb82a3bf6a540179033575f9887dae2 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:31.394577  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb82a3bf6a540179033575f9887dae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.397588  5440 tablet_service.cc:1511] Processing CreateTablet for tablet ac87e6e2662846f6bf75d974ba3a21b3 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:31.399478  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac87e6e2662846f6bf75d974ba3a21b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.451915  5439 tablet_service.cc:1511] Processing CreateTablet for tablet b049956c58af4c579dad64d304c90dd0 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:31.454226  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b049956c58af4c579dad64d304c90dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.459949  5597 tablet_service.cc:1511] Processing CreateTablet for tablet 17b9eb9d1e9a4e2ba998cfdcf3ac648e (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:31.462882  5596 tablet_service.cc:1511] Processing CreateTablet for tablet 7957372b6d5542a68131ad43f61517ed (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:31.464634  5589 tablet_service.cc:1511] Processing CreateTablet for tablet b049956c58af4c579dad64d304c90dd0 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:31.462699  5590 tablet_service.cc:1511] Processing CreateTablet for tablet ac87e6e2662846f6bf75d974ba3a21b3 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:31.465234  5595 tablet_service.cc:1511] Processing CreateTablet for tablet 8d2a0ad0a57d49eda00600a43d2dbfe2 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:31.466993  5594 tablet_service.cc:1511] Processing CreateTablet for tablet e2d216217c964b919ef4bd4a0ba34ba9 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:31.469502  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 5fedaf4fb4f0418ababe85ed2553bf34 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:31.472221  5592 tablet_service.cc:1511] Processing CreateTablet for tablet 877002e003da46fd833919b7b57ba1f4 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:31.474913  5591 tablet_service.cc:1511] Processing CreateTablet for tablet bfb82a3bf6a540179033575f9887dae2 (DEFAULT_TABLE table=test-workload [id=284229ef6f6c4d1d85fe48df60f3c577]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:31.461591  5597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b9eb9d1e9a4e2ba998cfdcf3ac648e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.477499  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac87e6e2662846f6bf75d974ba3a21b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.478349  5595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d2a0ad0a57d49eda00600a43d2dbfe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.478999  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b049956c58af4c579dad64d304c90dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.481362  5596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7957372b6d5542a68131ad43f61517ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.488799  5647 tablet_bootstrap.cc:492] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:31.486670  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb82a3bf6a540179033575f9887dae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.491336  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d216217c964b919ef4bd4a0ba34ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.492137  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 877002e003da46fd833919b7b57ba1f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.495097  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fedaf4fb4f0418ababe85ed2553bf34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:31.537212  5647 tablet_bootstrap.cc:654] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.573063  5648 tablet_bootstrap.cc:492] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:31.574429  5649 tablet_bootstrap.cc:492] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:31.589318  5648 tablet_bootstrap.cc:654] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.589833  5649 tablet_bootstrap.cc:654] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.599862  5647 tablet_bootstrap.cc:492] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:31.600402  5647 ts_tablet_manager.cc:1403] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.112s	user 0.008s	sys 0.009s
I20260709 12:25:31.604727  5647 raft_consensus.cc:359] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.605512  5647 raft_consensus.cc:385] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.605885  5647 raft_consensus.cc:740] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.606938  5647 consensus_queue.cc:260] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.607501  5648 tablet_bootstrap.cc:492] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:31.607535  5649 tablet_bootstrap.cc:492] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:31.608246  5648 ts_tablet_manager.cc:1403] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.000s
I20260709 12:25:31.608384  5649 ts_tablet_manager.cc:1403] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 12:25:31.609390  5558 heartbeater.cc:499] Master 127.28.234.126:40709 was elected leader, sending a full tablet report...
I20260709 12:25:31.609823  5647 ts_tablet_manager.cc:1434] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:25:31.610966  5647 tablet_bootstrap.cc:492] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:31.611485  5648 raft_consensus.cc:359] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.611809  5649 raft_consensus.cc:359] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.612331  5648 raft_consensus.cc:385] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.612635  5649 raft_consensus.cc:385] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.612682  5648 raft_consensus.cc:740] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.613063  5649 raft_consensus.cc:740] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.613744  5648 consensus_queue.cc:260] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.614178  5649 consensus_queue.cc:260] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.618857  5647 tablet_bootstrap.cc:654] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.629073  5632 heartbeater.cc:499] Master 127.28.234.126:40709 was elected leader, sending a full tablet report...
I20260709 12:25:31.629599  5648 ts_tablet_manager.cc:1434] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.011s
I20260709 12:25:31.630739  5648 tablet_bootstrap.cc:492] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:31.634574  5653 raft_consensus.cc:493] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.635439  5653 raft_consensus.cc:515] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.637606  5648 tablet_bootstrap.cc:654] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.643601  5653 leader_election.cc:290] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:31.645170  5647 tablet_bootstrap.cc:492] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:31.647326  5647 ts_tablet_manager.cc:1403] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.003s
I20260709 12:25:31.648238  5648 tablet_bootstrap.cc:492] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:31.648907  5648 ts_tablet_manager.cc:1403] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:25:31.651301  5647 raft_consensus.cc:359] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.652431  5647 raft_consensus.cc:385] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.652418  5648 raft_consensus.cc:359] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.653106  5647 raft_consensus.cc:740] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.653402  5648 raft_consensus.cc:385] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.653834  5648 raft_consensus.cc:740] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.654397  5647 consensus_queue.cc:260] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.654852  5648 consensus_queue.cc:260] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.657423  5648 ts_tablet_manager.cc:1434] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:31.657975  5647 ts_tablet_manager.cc:1434] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:25:31.658666  5648 tablet_bootstrap.cc:492] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:31.659385  5647 tablet_bootstrap.cc:492] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:31.663911  5649 ts_tablet_manager.cc:1434] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.055s	user 0.024s	sys 0.014s
I20260709 12:25:31.664894  5483 heartbeater.cc:499] Master 127.28.234.126:40709 was elected leader, sending a full tablet report...
I20260709 12:25:31.666608  5648 tablet_bootstrap.cc:654] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.667542  5647 tablet_bootstrap.cc:654] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.664819  5655 raft_consensus.cc:493] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.667562  5649 tablet_bootstrap.cc:492] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:31.678856  5648 tablet_bootstrap.cc:492] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:31.679507  5648 ts_tablet_manager.cc:1403] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:25:31.682714  5648 raft_consensus.cc:359] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.683531  5648 raft_consensus.cc:385] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.683848  5648 raft_consensus.cc:740] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.684827  5648 consensus_queue.cc:260] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.684159  5655 raft_consensus.cc:515] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.685226  5649 tablet_bootstrap.cc:654] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.695674  5655 leader_election.cc:290] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:31.688031  5648 ts_tablet_manager.cc:1434] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:25:31.698545  5648 tablet_bootstrap.cc:492] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:31.705808  5648 tablet_bootstrap.cc:654] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.733268  5647 tablet_bootstrap.cc:492] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:31.733920  5647 ts_tablet_manager.cc:1403] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.075s	user 0.026s	sys 0.012s
I20260709 12:25:31.737311  5647 raft_consensus.cc:359] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:31.746474  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
W20260709 12:25:31.748958  5498 leader_election.cc:343] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.745638  5647 raft_consensus.cc:385] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.750578  5647 raft_consensus.cc:740] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.751927  5647 consensus_queue.cc:260] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:31.753961  5654 raft_consensus.cc:493] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.755060  5654 raft_consensus.cc:515] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.765098  5654 leader_election.cc:290] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:31.766336  5648 tablet_bootstrap.cc:492] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:31.767093  5648 ts_tablet_manager.cc:1403] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.010s
I20260709 12:25:31.767838  5647 ts_tablet_manager.cc:1434] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:25:31.769330  5647 tablet_bootstrap.cc:492] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:31.777068  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d216217c964b919ef4bd4a0ba34ba9" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:31.777995  5648 raft_consensus.cc:359] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
W20260709 12:25:31.778883  5421 leader_election.cc:343] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.778973  5648 raft_consensus.cc:385] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.782385  5648 raft_consensus.cc:740] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
W20260709 12:25:31.784068  5403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:31.785090  5649 tablet_bootstrap.cc:492] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:31.785782  5649 ts_tablet_manager.cc:1403] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.118s	user 0.028s	sys 0.043s
I20260709 12:25:31.788900  5647 tablet_bootstrap.cc:654] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.788828  5649 raft_consensus.cc:359] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.789629  5649 raft_consensus.cc:385] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.789987  5649 raft_consensus.cc:740] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.790180  5648 consensus_queue.cc:260] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.791170  5649 consensus_queue.cc:260] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.793483  5648 ts_tablet_manager.cc:1434] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
I20260709 12:25:31.795475  5649 ts_tablet_manager.cc:1434] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:31.799252  5649 tablet_bootstrap.cc:492] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:31.799463  5647 tablet_bootstrap.cc:492] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:31.800915  5648 tablet_bootstrap.cc:492] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:31.804245  5647 ts_tablet_manager.cc:1403] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.004s
I20260709 12:25:31.808161  5647 raft_consensus.cc:359] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.808954  5647 raft_consensus.cc:385] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.809298  5647 raft_consensus.cc:740] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.810539  5649 tablet_bootstrap.cc:654] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.810370  5647 consensus_queue.cc:260] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.815044  5647 ts_tablet_manager.cc:1434] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:25:31.816272  5647 tablet_bootstrap.cc:492] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:31.817919  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
W20260709 12:25:31.819543  5498 leader_election.cc:343] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.820159  5498 leader_election.cc:304] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:31.821025  5653 raft_consensus.cc:2749] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.822276  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d216217c964b919ef4bd4a0ba34ba9" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:31.823047  5607 raft_consensus.cc:2468] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:31.823912  5647 tablet_bootstrap.cc:654] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.824368  5422 leader_election.cc:304] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:31.825872  5657 raft_consensus.cc:2804] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.826264  5657 raft_consensus.cc:493] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.826632  5657 raft_consensus.cc:3060] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.828333  5653 raft_consensus.cc:493] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.828891  5653 raft_consensus.cc:515] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.829921  5654 raft_consensus.cc:493] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.830478  5654 raft_consensus.cc:515] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.831267  5653 leader_election.cc:290] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:31.832707  5654 leader_election.cc:290] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:31.839257  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b049956c58af4c579dad64d304c90dd0" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
W20260709 12:25:31.841214  5498 leader_election.cc:343] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.842825  5647 tablet_bootstrap.cc:492] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:31.843468  5647 ts_tablet_manager.cc:1403] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 12:25:31.844673  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:31.846266  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:31.846827  5647 raft_consensus.cc:359] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.847628  5647 raft_consensus.cc:385] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.847950  5647 raft_consensus.cc:740] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
W20260709 12:25:31.848376  5572 leader_election.cc:343] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.849169  5647 consensus_queue.cc:260] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
W20260709 12:25:31.849486  5572 leader_election.cc:343] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.851320  5657 raft_consensus.cc:515] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.852224  5653 raft_consensus.cc:493] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.852754  5653 raft_consensus.cc:515] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.854839  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d216217c964b919ef4bd4a0ba34ba9" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:31.856163  5647 ts_tablet_manager.cc:1434] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
W20260709 12:25:31.857254  5421 leader_election.cc:343] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.857578  5648 tablet_bootstrap.cc:654] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.855052  5653 leader_election.cc:290] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:31.859174  5657 leader_election.cc:290] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:31.859365  5654 raft_consensus.cc:493] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.859431  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877002e003da46fd833919b7b57ba1f4" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:31.859901  5654 raft_consensus.cc:515] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.860783  5456 raft_consensus.cc:2468] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:31.862509  5498 leader_election.cc:304] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:31.862883  5654 leader_election.cc:290] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:31.863914  5653 raft_consensus.cc:2804] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.864454  5653 raft_consensus.cc:493] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.864903  5653 raft_consensus.cc:3060] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.865841  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b049956c58af4c579dad64d304c90dd0" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:31.857373  5647 tablet_bootstrap.cc:492] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:31.864821  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:31.867373  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2d216217c964b919ef4bd4a0ba34ba9" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:31.868067  5605 raft_consensus.cc:3060] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:31.868593  5572 leader_election.cc:343] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.866381  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877002e003da46fd833919b7b57ba1f4" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
W20260709 12:25:31.870621  5498 leader_election.cc:343] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.871116  5498 leader_election.cc:304] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:31.874929  5653 raft_consensus.cc:515] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.876397  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:31.877285  5653 leader_election.cc:290] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:31.877961  5653 raft_consensus.cc:2749] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.878974  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:31.880265  5649 tablet_bootstrap.cc:492] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:31.880851  5649 ts_tablet_manager.cc:1403] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.082s	user 0.024s	sys 0.028s
I20260709 12:25:31.881804  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:31.882786  5533 raft_consensus.cc:2468] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 0.
I20260709 12:25:31.884167  5649 raft_consensus.cc:359] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.884601  5647 tablet_bootstrap.cc:654] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:31.884521  5571 leader_election.cc:343] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.885094  5649 raft_consensus.cc:385] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.885504  5571 leader_election.cc:304] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:31.885494  5649 raft_consensus.cc:740] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.886924  5654 raft_consensus.cc:2749] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.887315  5649 consensus_queue.cc:260] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.887156  5605 raft_consensus.cc:2468] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
W20260709 12:25:31.888548  5571 leader_election.cc:343] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.892367  5571 leader_election.cc:304] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:31.893090  5654 raft_consensus.cc:2749] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:31.893661  5571 leader_election.cc:304] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:31.894547  5654 raft_consensus.cc:2804] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:31.894932  5654 raft_consensus.cc:493] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.895264  5422 leader_election.cc:304] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:31.890837  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877002e003da46fd833919b7b57ba1f4" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:31.897233  5456 raft_consensus.cc:3060] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.897725  5657 raft_consensus.cc:2804] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.899145  5657 raft_consensus.cc:697] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:31.900053  5657 consensus_queue.cc:237] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.891126  5649 ts_tablet_manager.cc:1434] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 12:25:31.895272  5654 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.904873  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877002e003da46fd833919b7b57ba1f4" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
W20260709 12:25:31.891459  5498 leader_election.cc:343] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:31.906625  5498 leader_election.cc:343] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.890070  5648 tablet_bootstrap.cc:492] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:31.907704  5648 ts_tablet_manager.cc:1403] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.107s	user 0.016s	sys 0.002s
I20260709 12:25:31.911152  5649 tablet_bootstrap.cc:492] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:31.911324  5648 raft_consensus.cc:359] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.912309  5648 raft_consensus.cc:385] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.912655  5648 raft_consensus.cc:740] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.913882  5456 raft_consensus.cc:2468] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:31.915284  5498 leader_election.cc:304] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 30d0815aa09840b3a5457d9de2b0e19c
I20260709 12:25:31.916292  5674 raft_consensus.cc:2804] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:31.917227  5647 tablet_bootstrap.cc:492] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:31.917676  5674 raft_consensus.cc:697] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:31.918844  5674 consensus_queue.cc:237] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.917865  5647 ts_tablet_manager.cc:1403] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.022s
I20260709 12:25:31.923449  5649 tablet_bootstrap.cc:654] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.923934  5654 raft_consensus.cc:515] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.924252  5648 consensus_queue.cc:260] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.927268  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
W20260709 12:25:31.928807  5572 leader_election.cc:343] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:31.928555  5647 raft_consensus.cc:359] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.929512  5647 raft_consensus.cc:385] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:31.930003  5647 raft_consensus.cc:740] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:31.930142  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:31.931102  5533 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:31.931425  5647 consensus_queue.cc:260] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:31.936129  5647 ts_tablet_manager.cc:1434] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:25:31.940653  5647 tablet_bootstrap.cc:492] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:31.942319  5654 leader_election.cc:290] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:31.951709  5648 ts_tablet_manager.cc:1434] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.003s
I20260709 12:25:31.952716  5648 tablet_bootstrap.cc:492] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:31.992482  5533 raft_consensus.cc:2468] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 1.
I20260709 12:25:31.997903  5571 leader_election.cc:304] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:31.999487  5647 tablet_bootstrap.cc:654] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:31.989940  5352 catalog_manager.cc:5697] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.009749  5680 raft_consensus.cc:2804] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.010932  5680 raft_consensus.cc:697] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:32.011579  5649 tablet_bootstrap.cc:492] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:32.013021  5649 ts_tablet_manager.cc:1403] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.021s
I20260709 12:25:32.013038  5680 consensus_queue.cc:237] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.022238  5674 raft_consensus.cc:493] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.023687  5674 raft_consensus.cc:515] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.025170  5649 raft_consensus.cc:359] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.026873  5649 raft_consensus.cc:385] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.027385  5649 raft_consensus.cc:740] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.028756  5649 consensus_queue.cc:260] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.031658  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:32.032128  5647 tablet_bootstrap.cc:492] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:32.032795  5456 raft_consensus.cc:2468] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:32.037048  5649 ts_tablet_manager.cc:1434] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 12:25:32.039469  5649 tablet_bootstrap.cc:492] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:32.038530  5355 catalog_manager.cc:5697] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 1 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.040949  5648 tablet_bootstrap.cc:654] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.042032  5647 ts_tablet_manager.cc:1403] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.102s	user 0.022s	sys 0.005s
I20260709 12:25:32.042554  5674 leader_election.cc:290] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.046783  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:32.048493  5605 raft_consensus.cc:2468] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:32.044269  5498 leader_election.cc:304] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:32.049175  5647 raft_consensus.cc:359] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.050854  5647 raft_consensus.cc:385] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.051296  5647 raft_consensus.cc:740] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.051719  5649 tablet_bootstrap.cc:654] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.050212  5674 raft_consensus.cc:2804] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.053383  5674 raft_consensus.cc:493] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.052711  5647 consensus_queue.cc:260] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.053864  5674 raft_consensus.cc:3060] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.057811  5647 ts_tablet_manager.cc:1434] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:25:32.060871  5647 tablet_bootstrap.cc:492] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:32.072814  5647 tablet_bootstrap.cc:654] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.091022  5649 tablet_bootstrap.cc:492] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:32.090715  5674 raft_consensus.cc:515] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.091867  5649 ts_tablet_manager.cc:1403] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.010s
I20260709 12:25:32.093235  5648 tablet_bootstrap.cc:492] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:32.094476  5648 ts_tablet_manager.cc:1403] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.009s
I20260709 12:25:32.094880  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:32.095789  5456 raft_consensus.cc:3060] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.102277  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:32.102725  5647 tablet_bootstrap.cc:492] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:32.102478  5648 raft_consensus.cc:359] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.103266  5605 raft_consensus.cc:3060] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.103538  5647 ts_tablet_manager.cc:1403] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.008s
I20260709 12:25:32.104070  5353 catalog_manager.cc:5697] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 1 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.108570  5647 raft_consensus.cc:359] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.109858  5647 raft_consensus.cc:385] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.110209  5647 raft_consensus.cc:740] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.103591  5648 raft_consensus.cc:385] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.111575  5648 raft_consensus.cc:740] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.114337  5649 raft_consensus.cc:359] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.115357  5649 raft_consensus.cc:385] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.115760  5649 raft_consensus.cc:740] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.117113  5649 consensus_queue.cc:260] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.115561  5648 consensus_queue.cc:260] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.121210  5649 ts_tablet_manager.cc:1434] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:25:32.123253  5649 tablet_bootstrap.cc:492] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:32.124406  5648 ts_tablet_manager.cc:1434] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.001s
I20260709 12:25:32.127890  5648 tablet_bootstrap.cc:492] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:32.131619  5653 raft_consensus.cc:493] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.130812  5647 consensus_queue.cc:260] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.132611  5653 raft_consensus.cc:515] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.134065  5649 tablet_bootstrap.cc:654] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.135842  5653 leader_election.cc:290] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293), 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881)
I20260709 12:25:32.137624  5657 raft_consensus.cc:493] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.139122  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:32.139043  5657 raft_consensus.cc:515] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
W20260709 12:25:32.141793  5498 leader_election.cc:343] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.141899  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:32.142678  5606 raft_consensus.cc:2468] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:32.144264  5498 leader_election.cc:304] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:32.147112  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:32.147927  5657 leader_election.cc:290] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.147980  5533 raft_consensus.cc:2468] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:32.149972  5648 tablet_bootstrap.cc:654] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.150494  5690 raft_consensus.cc:2804] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.151110  5690 raft_consensus.cc:493] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.151049  5421 leader_election.cc:304] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:32.151993  5690 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.153247  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:32.154359  5606 raft_consensus.cc:2468] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:32.156288  5647 ts_tablet_manager.cc:1434] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.052s	user 0.011s	sys 0.005s
I20260709 12:25:32.157406  5657 raft_consensus.cc:2804] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.158010  5657 raft_consensus.cc:493] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.158515  5657 raft_consensus.cc:3060] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.158449  5647 tablet_bootstrap.cc:492] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:32.158689  5674 leader_election.cc:290] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.174177  5456 raft_consensus.cc:2468] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:32.175802  5605 raft_consensus.cc:2468] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:32.177326  5498 leader_election.cc:304] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:32.179159  5674 raft_consensus.cc:2804] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.179735  5674 raft_consensus.cc:697] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:32.181865  5647 tablet_bootstrap.cc:654] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.181370  5674 consensus_queue.cc:237] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.182451  5657 raft_consensus.cc:515] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.184859  5657 leader_election.cc:290] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.186439  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:32.187095  5649 tablet_bootstrap.cc:492] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:32.187222  5533 raft_consensus.cc:3060] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.187789  5649 ts_tablet_manager.cc:1403] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.013s
I20260709 12:25:32.192047  5649 raft_consensus.cc:359] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.196856  5690 raft_consensus.cc:515] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.201619  5649 raft_consensus.cc:385] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.205516  5649 raft_consensus.cc:740] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.206699  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:32.205029  5690 leader_election.cc:290] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293), 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881)
I20260709 12:25:32.207376  5606 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.206614  5649 consensus_queue.cc:260] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.210131  5649 ts_tablet_manager.cc:1434] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 12:25:32.211728  5649 tablet_bootstrap.cc:492] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:32.212081  5657 raft_consensus.cc:493] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.212692  5657 raft_consensus.cc:515] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.215142  5657 leader_election.cc:290] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.217859  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2a0ad0a57d49eda00600a43d2dbfe2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:32.218739  5532 raft_consensus.cc:2468] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:32.219801  5649 tablet_bootstrap.cc:654] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.221539  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2a0ad0a57d49eda00600a43d2dbfe2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:32.223162  5421 leader_election.cc:304] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
W20260709 12:25:32.225459  5422 leader_election.cc:343] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.230057  5657 raft_consensus.cc:2804] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.230732  5657 raft_consensus.cc:493] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.231236  5657 raft_consensus.cc:3060] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.233947  5355 catalog_manager.cc:5697] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 1 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.246387  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
W20260709 12:25:32.248384  5498 leader_election.cc:343] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.250169  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:32.251381  5605 raft_consensus.cc:3060] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.267643  5606 raft_consensus.cc:2468] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:32.274236  5655 raft_consensus.cc:493] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.275107  5655 raft_consensus.cc:515] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.281910  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:32.285714  5532 raft_consensus.cc:2393] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52f6deb1e451449982a9496ac99ddb32 in current term 1: Already voted for candidate 30d0815aa09840b3a5457d9de2b0e19c in this term.
I20260709 12:25:32.290472  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:32.292987  5422 leader_election.cc:304] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52f6deb1e451449982a9496ac99ddb32; no voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:32.294405  5655 leader_election.cc:290] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.295244  5655 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.307772  5533 raft_consensus.cc:2468] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:32.309895  5421 leader_election.cc:304] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
W20260709 12:25:32.316993  5498 consensus_peers.cc:597] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf -> Peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Couldn't send request to peer 30d0815aa09840b3a5457d9de2b0e19c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:32.342067  5697 raft_consensus.cc:2804] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.344646  5648 tablet_bootstrap.cc:492] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:32.345826  5648 ts_tablet_manager.cc:1403] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.220s	user 0.063s	sys 0.097s
I20260709 12:25:32.349035  5498 leader_election.cc:304] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:32.350993  5648 raft_consensus.cc:359] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.351600  5690 raft_consensus.cc:2804] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.352246  5648 raft_consensus.cc:385] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.352595  5690 raft_consensus.cc:697] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:32.352736  5648 raft_consensus.cc:740] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.354303  5648 consensus_queue.cc:260] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.354404  5690 consensus_queue.cc:237] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.358026  5648 ts_tablet_manager.cc:1434] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
W20260709 12:25:32.359548  5422 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.67:45293, user_credentials={real_user=slave}} blocked reactor thread for 66729.4us
I20260709 12:25:32.359922  5648 tablet_bootstrap.cc:492] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:32.362205  5680 raft_consensus.cc:493] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.362870  5680 raft_consensus.cc:515] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.366739  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
W20260709 12:25:32.368712  5572 leader_election.cc:343] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.372231  5648 tablet_bootstrap.cc:654] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.374233  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:32.375283  5533 raft_consensus.cc:2468] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 0.
I20260709 12:25:32.376732  5571 leader_election.cc:304] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:32.377822  5654 raft_consensus.cc:2804] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.378238  5654 raft_consensus.cc:493] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.378579  5654 raft_consensus.cc:3060] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.365507  5680 leader_election.cc:290] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:32.391544  5654 raft_consensus.cc:515] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.397352  5648 tablet_bootstrap.cc:492] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:32.398327  5648 ts_tablet_manager.cc:1403] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.006s
I20260709 12:25:32.400934  5657 raft_consensus.cc:515] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.403280  5648 raft_consensus.cc:359] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.403360  5353 catalog_manager.cc:5697] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 1 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.404660  5648 raft_consensus.cc:385] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.405285  5648 raft_consensus.cc:740] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.406618  5648 consensus_queue.cc:260] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.408605  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2a0ad0a57d49eda00600a43d2dbfe2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:32.409997  5532 raft_consensus.cc:3060] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.410492  5696 consensus_queue.cc:1048] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.417361  5649 tablet_bootstrap.cc:492] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:32.418061  5649 ts_tablet_manager.cc:1403] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.207s	user 0.090s	sys 0.101s
I20260709 12:25:32.409926  5648 ts_tablet_manager.cc:1434] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.002s
I20260709 12:25:32.421867  5680 consensus_queue.cc:1048] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.425011  5697 raft_consensus.cc:697] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:32.426455  5697 consensus_queue.cc:237] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.429804  5648 tablet_bootstrap.cc:492] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:32.430644  5532 raft_consensus.cc:2468] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:32.432312  5421 leader_election.cc:304] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:32.438016  5655 raft_consensus.cc:2749] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.435850  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d2a0ad0a57d49eda00600a43d2dbfe2" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:32.439198  5649 raft_consensus.cc:359] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.440151  5647 tablet_bootstrap.cc:492] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
W20260709 12:25:32.440310  5422 leader_election.cc:343] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:32.441505  5649 raft_consensus.cc:385] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.441941  5649 raft_consensus.cc:740] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.442550  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:32.434826  5605 raft_consensus.cc:2468] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:32.443161  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:32.440871  5654 leader_election.cc:290] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:32.443231  5649 consensus_queue.cc:260] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.443262  5532 raft_consensus.cc:3060] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.447005  5649 ts_tablet_manager.cc:1434] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:25:32.448491  5649 tablet_bootstrap.cc:492] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:32.435822  5698 raft_consensus.cc:2804] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.434418  5657 leader_election.cc:290] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.450330  5698 raft_consensus.cc:697] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:32.444954  5647 ts_tablet_manager.cc:1403] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.287s	user 0.026s	sys 0.129s
I20260709 12:25:32.451601  5456 raft_consensus.cc:3060] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.455081  5648 tablet_bootstrap.cc:654] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.453997  5647 raft_consensus.cc:359] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.456844  5647 raft_consensus.cc:385] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.457142  5647 raft_consensus.cc:740] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.458045  5647 consensus_queue.cc:260] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.460382  5647 ts_tablet_manager.cc:1434] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 12:25:32.462077  5649 tablet_bootstrap.cc:654] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.463299  5674 consensus_queue.cc:1048] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.471141  5654 raft_consensus.cc:493] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.471992  5654 raft_consensus.cc:515] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.475967  5455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877002e003da46fd833919b7b57ba1f4" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:32.476305  5654 leader_election.cc:290] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:32.477128  5455 raft_consensus.cc:2393] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30d0815aa09840b3a5457d9de2b0e19c in current term 1: Already voted for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in this term.
I20260709 12:25:32.480688  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "877002e003da46fd833919b7b57ba1f4" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:32.479351  5698 consensus_queue.cc:237] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.478497  5456 raft_consensus.cc:2468] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 1.
I20260709 12:25:32.491931  5571 leader_election.cc:304] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:32.494506  5532 raft_consensus.cc:2468] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 1.
I20260709 12:25:32.506328  5654 raft_consensus.cc:3060] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.516973  5649 tablet_bootstrap.cc:492] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:32.517680  5649 ts_tablet_manager.cc:1403] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.014s
I20260709 12:25:32.518428  5532 raft_consensus.cc:3060] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.519546  5648 tablet_bootstrap.cc:492] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:32.520170  5648 ts_tablet_manager.cc:1403] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.100s	user 0.021s	sys 0.022s
I20260709 12:25:32.521193  5649 raft_consensus.cc:359] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.522033  5649 raft_consensus.cc:385] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.522367  5649 raft_consensus.cc:740] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.523289  5649 consensus_queue.cc:260] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.531881  5572 leader_election.cc:304] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:32.536295  5648 raft_consensus.cc:359] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.537233  5648 raft_consensus.cc:385] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.537609  5680 raft_consensus.cc:2804] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.537611  5648 raft_consensus.cc:740] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.539042  5648 consensus_queue.cc:260] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.528280  5654 raft_consensus.cc:2749] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.544091  5649 ts_tablet_manager.cc:1434] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:25:32.545889  5649 tablet_bootstrap.cc:492] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:32.550522  5698 consensus_queue.cc:1048] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.558406  5649 tablet_bootstrap.cc:654] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:32.533181  5355 catalog_manager.cc:5697] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.548741  5680 raft_consensus.cc:697] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:32.576045  5654 consensus_queue.cc:1048] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.570559  5680 consensus_queue.cc:237] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.601468  5648 ts_tablet_manager.cc:1434] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.081s	user 0.013s	sys 0.011s
I20260709 12:25:32.620527  5649 tablet_bootstrap.cc:492] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:32.621169  5649 ts_tablet_manager.cc:1403] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.000s
I20260709 12:25:32.624673  5649 raft_consensus.cc:359] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.625440  5649 raft_consensus.cc:385] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:32.625751  5649 raft_consensus.cc:740] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:32.626569  5649 consensus_queue.cc:260] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.626806  5355 catalog_manager.cc:5697] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 1 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.629102  5649 ts_tablet_manager.cc:1434] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:25:32.643080  5353 catalog_manager.cc:5697] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.662192  5680 raft_consensus.cc:493] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.662756  5680 raft_consensus.cc:515] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.665522  5680 leader_election.cc:290] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:32.666316  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b049956c58af4c579dad64d304c90dd0" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:32.666903  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b049956c58af4c579dad64d304c90dd0" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:32.667066  5457 raft_consensus.cc:2468] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 0.
I20260709 12:25:32.667721  5531 raft_consensus.cc:2468] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 0.
I20260709 12:25:32.668390  5572 leader_election.cc:304] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:32.669363  5680 raft_consensus.cc:2804] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:32.669809  5680 raft_consensus.cc:493] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.670164  5680 raft_consensus.cc:3060] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.677299  5680 raft_consensus.cc:515] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.679503  5680 leader_election.cc:290] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:32.680485  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b049956c58af4c579dad64d304c90dd0" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:32.680698  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b049956c58af4c579dad64d304c90dd0" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:32.681216  5457 raft_consensus.cc:3060] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.681358  5531 raft_consensus.cc:3060] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.688912  5531 raft_consensus.cc:2468] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 1.
I20260709 12:25:32.688937  5457 raft_consensus.cc:2468] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 1.
I20260709 12:25:32.690280  5571 leader_election.cc:304] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:32.691097  5680 raft_consensus.cc:2804] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:32.691584  5680 raft_consensus.cc:697] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:32.692426  5680 consensus_queue.cc:237] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:32.700299  5352 catalog_manager.cc:5697] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 1 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.711468  5698 raft_consensus.cc:493] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.712055  5698 raft_consensus.cc:515] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:32.714597  5698 leader_election.cc:290] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:32.715369  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:32.716132  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:32.717078  5606 raft_consensus.cc:2393] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52f6deb1e451449982a9496ac99ddb32 in current term 1: Already voted for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in this term.
I20260709 12:25:32.718194  5422 leader_election.cc:304] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52f6deb1e451449982a9496ac99ddb32; no voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:32.719027  5698 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.726207  5698 raft_consensus.cc:2749] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:32.790644  5690 consensus_queue.cc:1048] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.793840  5690 consensus_queue.cc:1048] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.883375  5532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
mode: GRACEFUL
new_leader_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:38902
I20260709 12:25:32.884104  5532 raft_consensus.cc:606] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Received request to transfer leadership to TS 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:32.884687  5698 consensus_queue.cc:1048] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.893504  5531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
mode: GRACEFUL
new_leader_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:38902
I20260709 12:25:32.894315  5531 raft_consensus.cc:606] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Received request to transfer leadership to TS 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:32.897925  5606 raft_consensus.cc:3060] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:32.908828  5698 consensus_queue.cc:1048] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.909909  5697 consensus_queue.cc:1048] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.917493  5674 consensus_queue.cc:1048] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:32.933416  5698 consensus_queue.cc:1048] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:32.948377  5604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
mode: GRACEFUL
new_leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:46740
I20260709 12:25:32.949497  5604 raft_consensus.cc:606] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Received request to transfer leadership to TS 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:32.961534  5674 consensus_queue.cc:1048] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.001642  5724 raft_consensus.cc:993] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: : Instructing follower 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:33.002241  5653 raft_consensus.cc:1081] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Signalling peer 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:33.005010  5456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:25:33.007865  5456 raft_consensus.cc:493] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:33.008579  5456 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.016036  5457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
mode: GRACEFUL
new_leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:37396
I20260709 12:25:33.016856  5457 raft_consensus.cc:606] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Received request to transfer leadership to TS 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:33.023586  5607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
mode: GRACEFUL
new_leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:46740
I20260709 12:25:33.024132  5607 raft_consensus.cc:606] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Received request to transfer leadership to TS 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:33.026064  5456 raft_consensus.cc:515] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:33.030946  5456 leader_election.cc:290] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:33.031582  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:33.032117  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:33.032521  5531 raft_consensus.cc:3055] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:33.032959  5607 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.033165  5531 raft_consensus.cc:740] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:33.034142  5531 consensus_queue.cc:260] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:33.035297  5531 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.040150  5607 raft_consensus.cc:2468] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:33.041638  5422 leader_election.cc:304] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:33.042062  5531 raft_consensus.cc:2468] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:33.042922  5698 raft_consensus.cc:2804] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:33.043439  5698 raft_consensus.cc:697] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:33.044294  5698 consensus_queue.cc:237] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:33.053215  5352 catalog_manager.cc:5697] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 1 to 2, leader changed from 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66) to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:33.068336  5716 consensus_queue.cc:1048] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.077167  5680 consensus_queue.cc:1048] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:33.083693  5716 consensus_queue.cc:1048] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.094321  5680 consensus_queue.cc:1048] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:33.102504  5716 raft_consensus.cc:993] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c: : Instructing follower 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:33.103142  5716 raft_consensus.cc:1081] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Signalling peer 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:33.105545  5532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:38900
I20260709 12:25:33.106235  5532 raft_consensus.cc:493] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:33.106642  5532 raft_consensus.cc:3060] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.117564  5532 raft_consensus.cc:515] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.120566  5532 leader_election.cc:290] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:33.121032  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:33.121893  5457 raft_consensus.cc:3060] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.121677  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fedaf4fb4f0418ababe85ed2553bf34" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:33.122641  5607 raft_consensus.cc:3055] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:33.123009  5607 raft_consensus.cc:740] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:33.123910  5607 consensus_queue.cc:260] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.125314  5607 raft_consensus.cc:3060] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.130769  5457 raft_consensus.cc:2468] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:33.132397  5498 leader_election.cc:304] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:33.133409  5724 raft_consensus.cc:2804] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:33.133466  5607 raft_consensus.cc:2468] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:33.134167  5724 raft_consensus.cc:697] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:33.135154  5724 consensus_queue.cc:237] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.143471  5354 catalog_manager.cc:5697] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 1 to 2, leader changed from 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67) to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 2 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.322803  5696 raft_consensus.cc:993] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32: : Instructing follower 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:33.323508  5698 raft_consensus.cc:1081] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Signalling peer 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:33.325989  5532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:38896
I20260709 12:25:33.326762  5532 raft_consensus.cc:493] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:33.327183  5532 raft_consensus.cc:3060] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.333361  5532 raft_consensus.cc:515] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.335279  5532 leader_election.cc:290] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:33.336380  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:33.336700  5607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb82a3bf6a540179033575f9887dae2" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:33.337091  5457 raft_consensus.cc:3055] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:33.337355  5607 raft_consensus.cc:3060] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.337488  5457 raft_consensus.cc:740] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:33.338541  5457 consensus_queue.cc:260] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.339659  5457 raft_consensus.cc:3060] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.345504  5607 raft_consensus.cc:2468] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:33.346902  5498 leader_election.cc:304] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:33.347438  5457 raft_consensus.cc:2468] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:33.347694  5724 raft_consensus.cc:2804] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:33.348276  5724 raft_consensus.cc:697] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:33.349218  5724 consensus_queue.cc:237] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.360644  5354 catalog_manager.cc:5697] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 1 to 2, leader changed from 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65) to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 2 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.364635  5741 raft_consensus.cc:993] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf: : Instructing follower 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:33.365484  5690 raft_consensus.cc:1081] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Signalling peer 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:33.367372  5457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:25:33.368125  5457 raft_consensus.cc:493] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:33.368696  5457 raft_consensus.cc:3060] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.375790  5457 raft_consensus.cc:515] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.379230  5457 leader_election.cc:290] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:33.380664  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:33.380872  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7957372b6d5542a68131ad43f61517ed" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:33.381928  5532 raft_consensus.cc:3055] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:33.382028  5606 raft_consensus.cc:3060] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.382257  5532 raft_consensus.cc:740] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:33.384893  5532 consensus_queue.cc:260] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.388423  5532 raft_consensus.cc:3060] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.395058  5606 raft_consensus.cc:2468] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:33.396648  5422 leader_election.cc:304] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:33.397068  5532 raft_consensus.cc:2468] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:33.397977  5698 raft_consensus.cc:2804] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:33.398655  5698 raft_consensus.cc:697] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:33.400231  5698 consensus_queue.cc:237] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.412251  5354 catalog_manager.cc:5697] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 1 to 2, leader changed from 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66) to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.436307  5716 raft_consensus.cc:993] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c: : Instructing follower 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:33.436848  5716 raft_consensus.cc:1081] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Signalling peer 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:33.439822  5532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:38900
I20260709 12:25:33.440455  5532 raft_consensus.cc:493] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:33.440814  5532 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.448365  5532 raft_consensus.cc:515] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.450213  5532 leader_election.cc:290] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:33.451152  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:33.451354  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:33.452028  5457 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.452090  5606 raft_consensus.cc:3055] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:33.452590  5606 raft_consensus.cc:740] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:33.453325  5606 consensus_queue.cc:260] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.455042  5606 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:33.458895  5457 raft_consensus.cc:2468] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:33.460881  5498 leader_election.cc:304] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:33.462011  5690 raft_consensus.cc:2804] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:33.462586  5690 raft_consensus.cc:697] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:33.463150  5606 raft_consensus.cc:2468] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:33.463827  5690 consensus_queue.cc:237] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:33.473657  5354 catalog_manager.cc:5697] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 1 to 2, leader changed from 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67) to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 2 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:33.636365  5607 raft_consensus.cc:1275] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.778389  5696 consensus_queue.cc:1048] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:33.803122  5457 raft_consensus.cc:1275] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.834980  5606 raft_consensus.cc:1275] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.864032  5724 consensus_queue.cc:1048] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:33.865603  5606 raft_consensus.cc:1275] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.865558  5724 consensus_queue.cc:1048] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:33.868136  5724 consensus_queue.cc:1048] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:33.888015  5532 raft_consensus.cc:1275] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.891152  5456 raft_consensus.cc:1275] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.892158  5697 consensus_queue.cc:1048] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:33.893515  5653 consensus_queue.cc:1048] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:33.909185  5531 raft_consensus.cc:1275] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.911229  5605 raft_consensus.cc:1275] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:33.912304  5697 consensus_queue.cc:1048] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:33.916435  5698 consensus_queue.cc:1048] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:34.016276  5457 raft_consensus.cc:1275] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:34.017717  5653 consensus_queue.cc:1048] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:34.030027  5605 raft_consensus.cc:1275] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:34.031731  5653 consensus_queue.cc:1048] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:25:34.796883  5479 debug-util.cc:398] Leaking SignalData structure 0x7b0800292d40 after lost signal to thread 29612
W20260709 12:25:34.798301  5479 debug-util.cc:398] Leaking SignalData structure 0x7b080013b4e0 after lost signal to thread 5389
W20260709 12:25:34.799793  5479 debug-util.cc:398] Leaking SignalData structure 0x7b08000cfe40 after lost signal to thread 5482
W20260709 12:25:34.801061  5479 debug-util.cc:398] Leaking SignalData structure 0x7b08002011c0 after lost signal to thread 5557
W20260709 12:25:34.802335  5479 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8d40 after lost signal to thread 5631
I20260709 12:25:36.172654  5354 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57244:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:36.177145  5354 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:36.251883  5447 tablet_service.cc:1511] Processing CreateTablet for tablet b3b2791e70184f68a5854ad1533c8cdd (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:36.253584  5447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b2791e70184f68a5854ad1533c8cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.253980  5520 tablet_service.cc:1511] Processing CreateTablet for tablet b3b2791e70184f68a5854ad1533c8cdd (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:36.255457  5520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b2791e70184f68a5854ad1533c8cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.260035  5521 tablet_service.cc:1511] Processing CreateTablet for tablet 4e37d9b7d0d64673b48e95a6a78f1a19 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:36.260296  5595 tablet_service.cc:1511] Processing CreateTablet for tablet b3b2791e70184f68a5854ad1533c8cdd (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:36.261737  5521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e37d9b7d0d64673b48e95a6a78f1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.261193  5439 tablet_service.cc:1511] Processing CreateTablet for tablet 4e37d9b7d0d64673b48e95a6a78f1a19 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:36.262898  5439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e37d9b7d0d64673b48e95a6a78f1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.263341  5589 tablet_service.cc:1511] Processing CreateTablet for tablet 4e37d9b7d0d64673b48e95a6a78f1a19 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:36.261961  5595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b2791e70184f68a5854ad1533c8cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.266862  5517 tablet_service.cc:1511] Processing CreateTablet for tablet b6d522795c924db8846dccf157c5f624 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:36.268369  5517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d522795c924db8846dccf157c5f624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.269205  5592 tablet_service.cc:1511] Processing CreateTablet for tablet b6d522795c924db8846dccf157c5f624 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:36.269481  5597 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8d78ba65794b72ac29bc17f6287c8a (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:36.270864  5592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d522795c924db8846dccf157c5f624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.270908  5443 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8d78ba65794b72ac29bc17f6287c8a (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:36.272406  5443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8d78ba65794b72ac29bc17f6287c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.273262  5597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8d78ba65794b72ac29bc17f6287c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.274887  5519 tablet_service.cc:1511] Processing CreateTablet for tablet 99b8faadd63f4ee2b0193205325b0a3c (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:36.275813  5442 tablet_service.cc:1511] Processing CreateTablet for tablet b6d522795c924db8846dccf157c5f624 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:36.276348  5519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b8faadd63f4ee2b0193205325b0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.277351  5442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d522795c924db8846dccf157c5f624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.278137  5589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e37d9b7d0d64673b48e95a6a78f1a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.274894  5522 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8d78ba65794b72ac29bc17f6287c8a (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:36.279335  5522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8d78ba65794b72ac29bc17f6287c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.279944  5518 tablet_service.cc:1511] Processing CreateTablet for tablet 4344ea6eea254938a1a7b05a83785172 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:36.281416  5518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4344ea6eea254938a1a7b05a83785172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.287091  5516 tablet_service.cc:1511] Processing CreateTablet for tablet 46861d48f48c4a3ba3b52e898f95e658 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:36.288600  5516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46861d48f48c4a3ba3b52e898f95e658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.291568  5523 tablet_service.cc:1511] Processing CreateTablet for tablet 5af51674e04b4a1689b427de8e3245eb (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:36.291811  5593 tablet_service.cc:1511] Processing CreateTablet for tablet 99b8faadd63f4ee2b0193205325b0a3c (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:36.293092  5523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af51674e04b4a1689b427de8e3245eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.293668  5593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b8faadd63f4ee2b0193205325b0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.294911  5445 tablet_service.cc:1511] Processing CreateTablet for tablet 4344ea6eea254938a1a7b05a83785172 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:36.296635  5445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4344ea6eea254938a1a7b05a83785172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.301472  5440 tablet_service.cc:1511] Processing CreateTablet for tablet 99b8faadd63f4ee2b0193205325b0a3c (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:36.303411  5440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b8faadd63f4ee2b0193205325b0a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.299594  5446 tablet_service.cc:1511] Processing CreateTablet for tablet 46861d48f48c4a3ba3b52e898f95e658 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:36.307339  5446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46861d48f48c4a3ba3b52e898f95e658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.323534  5591 tablet_service.cc:1511] Processing CreateTablet for tablet 4344ea6eea254938a1a7b05a83785172 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:36.324354  5441 tablet_service.cc:1511] Processing CreateTablet for tablet 5af51674e04b4a1689b427de8e3245eb (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:36.325343  5591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4344ea6eea254938a1a7b05a83785172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.326236  5441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af51674e04b4a1689b427de8e3245eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.331194  5594 tablet_service.cc:1511] Processing CreateTablet for tablet 46861d48f48c4a3ba3b52e898f95e658 (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:36.332947  5594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46861d48f48c4a3ba3b52e898f95e658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.352334  5444 tablet_service.cc:1511] Processing CreateTablet for tablet 7bee45aae7544634add44b7dac5b942e (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:36.354023  5444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bee45aae7544634add44b7dac5b942e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.358075  5515 tablet_service.cc:1511] Processing CreateTablet for tablet 7bee45aae7544634add44b7dac5b942e (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:36.359755  5596 tablet_service.cc:1511] Processing CreateTablet for tablet 5af51674e04b4a1689b427de8e3245eb (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:36.361445  5596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5af51674e04b4a1689b427de8e3245eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.359755  5515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bee45aae7544634add44b7dac5b942e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.376415  5590 tablet_service.cc:1511] Processing CreateTablet for tablet 7bee45aae7544634add44b7dac5b942e (DEFAULT_TABLE table=soft_deleted_table [id=904e437b214f4427bfd998900630a557]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:36.378160  5590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bee45aae7544634add44b7dac5b942e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:36.442545  5761 tablet_bootstrap.cc:492] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:36.462312  5761 tablet_bootstrap.cc:654] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.500540  5762 tablet_bootstrap.cc:492] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:36.516372  5763 tablet_bootstrap.cc:492] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:36.522120  5761 tablet_bootstrap.cc:492] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:36.523001  5761 ts_tablet_manager.cc:1403] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.000s
I20260709 12:25:36.526383  5763 tablet_bootstrap.cc:654] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.526840  5761 raft_consensus.cc:359] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.527786  5761 raft_consensus.cc:385] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.528218  5761 raft_consensus.cc:740] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.529415  5762 tablet_bootstrap.cc:654] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.529129  5761 consensus_queue.cc:260] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.537595  5761 ts_tablet_manager.cc:1434] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:25:36.539323  5761 tablet_bootstrap.cc:492] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:36.552860  5761 tablet_bootstrap.cc:654] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.552945  5762 tablet_bootstrap.cc:492] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:36.555503  5763 tablet_bootstrap.cc:492] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:36.556349  5763 ts_tablet_manager.cc:1403] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.012s
I20260709 12:25:36.556882  5762 ts_tablet_manager.cc:1403] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.011s
I20260709 12:25:36.559134  5761 tablet_bootstrap.cc:492] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:36.559762  5761 ts_tablet_manager.cc:1403] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.009s
I20260709 12:25:36.560963  5762 raft_consensus.cc:359] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.560803  5763 raft_consensus.cc:359] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.561939  5762 raft_consensus.cc:385] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.562179  5763 raft_consensus.cc:385] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.562379  5762 raft_consensus.cc:740] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.562717  5763 raft_consensus.cc:740] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.563244  5761 raft_consensus.cc:359] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.563359  5762 consensus_queue.cc:260] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.564252  5761 raft_consensus.cc:385] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.564699  5761 raft_consensus.cc:740] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.564014  5763 consensus_queue.cc:260] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.565512  5761 consensus_queue.cc:260] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.568142  5761 ts_tablet_manager.cc:1434] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:25:36.569260  5761 tablet_bootstrap.cc:492] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:36.576632  5761 tablet_bootstrap.cc:654] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.586020  5763 ts_tablet_manager.cc:1434] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 12:25:36.597572  5762 ts_tablet_manager.cc:1434] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 12:25:36.602420  5763 tablet_bootstrap.cc:492] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:36.603868  5762 tablet_bootstrap.cc:492] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:36.609426  5763 tablet_bootstrap.cc:654] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.612601  5761 tablet_bootstrap.cc:492] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:36.613243  5761 ts_tablet_manager.cc:1403] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.028s
I20260709 12:25:36.614912  5762 tablet_bootstrap.cc:654] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.616629  5761 raft_consensus.cc:359] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.617554  5761 raft_consensus.cc:385] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.618185  5761 raft_consensus.cc:740] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.619378  5761 consensus_queue.cc:260] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.622792  5761 ts_tablet_manager.cc:1434] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:36.617491  5763 tablet_bootstrap.cc:492] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:36.624064  5761 tablet_bootstrap.cc:492] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:36.624334  5763 ts_tablet_manager.cc:1403] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 12:25:36.628475  5763 raft_consensus.cc:359] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.629514  5763 raft_consensus.cc:385] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.629930  5763 raft_consensus.cc:740] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.631201  5763 consensus_queue.cc:260] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.632071  5761 tablet_bootstrap.cc:654] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.643985  5750 raft_consensus.cc:493] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.644898  5761 tablet_bootstrap.cc:492] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:36.644606  5750 raft_consensus.cc:515] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.645565  5761 ts_tablet_manager.cc:1403] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.013s
I20260709 12:25:36.649343  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:36.649423  5761 raft_consensus.cc:359] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.650756  5761 raft_consensus.cc:385] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.651206  5761 raft_consensus.cc:740] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
W20260709 12:25:36.651396  5572 leader_election.cc:343] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.652284  5761 consensus_queue.cc:260] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.653836  5762 tablet_bootstrap.cc:492] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:36.654220  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:36.654654  5762 ts_tablet_manager.cc:1403] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.009s
W20260709 12:25:36.656107  5571 leader_election.cc:343] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.656625  5571 leader_election.cc:304] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:36.657950  5750 leader_election.cc:290] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:36.659309  5762 raft_consensus.cc:359] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.660473  5762 raft_consensus.cc:385] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.660858  5762 raft_consensus.cc:740] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.662652  5750 raft_consensus.cc:2749] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.644563  5763 ts_tablet_manager.cc:1434] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:25:36.667286  5761 ts_tablet_manager.cc:1434] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.011s
I20260709 12:25:36.668200  5762 consensus_queue.cc:260] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.672792  5762 ts_tablet_manager.cc:1434] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:25:36.669011  5761 tablet_bootstrap.cc:492] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:36.678706  5762 tablet_bootstrap.cc:492] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:36.686000  5763 tablet_bootstrap.cc:492] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:36.687757  5761 tablet_bootstrap.cc:654] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.692574  5773 raft_consensus.cc:493] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.693147  5773 raft_consensus.cc:515] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.693691  5761 tablet_bootstrap.cc:492] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:36.694491  5761 ts_tablet_manager.cc:1403] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.006s
I20260709 12:25:36.698038  5761 raft_consensus.cc:359] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.698547  5763 tablet_bootstrap.cc:654] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.686455  5762 tablet_bootstrap.cc:654] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.699066  5761 raft_consensus.cc:385] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.699585  5761 raft_consensus.cc:740] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.700467  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b8faadd63f4ee2b0193205325b0a3c" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:36.700583  5761 consensus_queue.cc:260] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
W20260709 12:25:36.702083  5572 leader_election.cc:343] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.701392  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b8faadd63f4ee2b0193205325b0a3c" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:36.704183  5772 raft_consensus.cc:493] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:36.704293  5571 leader_election.cc:343] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.705060  5571 leader_election.cc:304] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:36.705029  5772 raft_consensus.cc:515] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.706174  5750 raft_consensus.cc:2749] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.706948  5773 leader_election.cc:290] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:36.708978  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
W20260709 12:25:36.713101  5572 leader_election.cc:343] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.710325  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:36.707785  5772 leader_election.cc:290] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:36.708174  5761 ts_tablet_manager.cc:1434] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:25:36.715618  5761 tablet_bootstrap.cc:492] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
W20260709 12:25:36.715847  5571 leader_election.cc:343] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.716426  5571 leader_election.cc:304] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:36.717283  5772 raft_consensus.cc:2749] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.720149  5762 tablet_bootstrap.cc:492] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:36.720918  5762 ts_tablet_manager.cc:1403] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.001s
I20260709 12:25:36.723793  5761 tablet_bootstrap.cc:654] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.724723  5762 raft_consensus.cc:359] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.725675  5762 raft_consensus.cc:385] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.726059  5762 raft_consensus.cc:740] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.726898  5762 consensus_queue.cc:260] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.731196  5772 raft_consensus.cc:493] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.731827  5772 raft_consensus.cc:515] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.734099  5763 tablet_bootstrap.cc:492] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:36.734732  5763 ts_tablet_manager.cc:1403] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.004s
I20260709 12:25:36.735612  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:36.736984  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
W20260709 12:25:36.737445  5571 leader_election.cc:343] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.737746  5456 raft_consensus.cc:2468] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 0.
I20260709 12:25:36.740545  5772 leader_election.cc:290] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:36.740654  5572 leader_election.cc:304] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:36.741695  5772 raft_consensus.cc:2804] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:36.742142  5772 raft_consensus.cc:493] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.742565  5772 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.743782  5762 ts_tablet_manager.cc:1434] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.010s
I20260709 12:25:36.743535  5763 raft_consensus.cc:359] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.747001  5763 raft_consensus.cc:385] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.747452  5763 raft_consensus.cc:740] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.748392  5763 consensus_queue.cc:260] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.751212  5763 ts_tablet_manager.cc:1434] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:25:36.752488  5763 tablet_bootstrap.cc:492] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:36.752144  5772 raft_consensus.cc:515] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.745749  5762 tablet_bootstrap.cc:492] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:36.757681  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:36.758364  5456 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.754865  5761 tablet_bootstrap.cc:492] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:36.760846  5763 tablet_bootstrap.cc:654] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.761322  5761 ts_tablet_manager.cc:1403] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.008s
I20260709 12:25:36.765162  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
W20260709 12:25:36.766867  5571 leader_election.cc:343] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.767521  5772 leader_election.cc:290] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:36.770385  5762 tablet_bootstrap.cc:654] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.765187  5761 raft_consensus.cc:359] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.777357  5761 raft_consensus.cc:385] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.777944  5761 raft_consensus.cc:740] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.779287  5761 consensus_queue.cc:260] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.776554  5456 raft_consensus.cc:2468] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 1.
I20260709 12:25:36.782398  5572 leader_election.cc:304] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:36.783342  5761 ts_tablet_manager.cc:1434] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 12:25:36.783752  5772 raft_consensus.cc:2804] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:36.784384  5772 raft_consensus.cc:697] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:36.784638  5761 tablet_bootstrap.cc:492] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:36.785343  5772 consensus_queue.cc:237] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.791499  5762 tablet_bootstrap.cc:492] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:36.792368  5762 ts_tablet_manager.cc:1403] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.015s
I20260709 12:25:36.794263  5763 tablet_bootstrap.cc:492] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:36.794894  5763 ts_tablet_manager.cc:1403] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.020s
I20260709 12:25:36.796167  5762 raft_consensus.cc:359] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.797035  5762 raft_consensus.cc:385] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.797430  5761 tablet_bootstrap.cc:654] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.800751  5763 raft_consensus.cc:359] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.797470  5762 raft_consensus.cc:740] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.801616  5763 raft_consensus.cc:385] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.801990  5763 raft_consensus.cc:740] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.802385  5762 consensus_queue.cc:260] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.802781  5763 consensus_queue.cc:260] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.805091  5762 ts_tablet_manager.cc:1434] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:36.806272  5762 tablet_bootstrap.cc:492] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:36.810601  5763 ts_tablet_manager.cc:1434] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:25:36.815399  5763 tablet_bootstrap.cc:492] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:36.825260  5763 tablet_bootstrap.cc:654] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.829088  5762 tablet_bootstrap.cc:654] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.843266  5353 catalog_manager.cc:5697] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 1 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:36.849640  5772 raft_consensus.cc:493] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.850749  5772 raft_consensus.cc:515] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.853775  5772 leader_election.cc:290] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:36.855188  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:36.855335  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:36.856145  5531 raft_consensus.cc:2468] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 0.
W20260709 12:25:36.857643  5572 leader_election.cc:343] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.858779  5571 leader_election.cc:304] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:36.860153  5772 raft_consensus.cc:2804] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:36.860734  5772 raft_consensus.cc:493] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.861207  5772 raft_consensus.cc:3060] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.863371  5761 tablet_bootstrap.cc:492] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:36.864337  5761 ts_tablet_manager.cc:1403] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.013s
I20260709 12:25:36.883673  5772 raft_consensus.cc:515] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.886252  5778 raft_consensus.cc:493] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.886971  5778 raft_consensus.cc:515] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.887413  5762 tablet_bootstrap.cc:492] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:36.887413  5763 tablet_bootstrap.cc:492] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:36.888684  5762 ts_tablet_manager.cc:1403] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.052s
I20260709 12:25:36.888684  5763 ts_tablet_manager.cc:1403] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.034s
I20260709 12:25:36.891300  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af51674e04b4a1689b427de8e3245eb" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:36.892274  5456 raft_consensus.cc:2468] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:36.892669  5762 raft_consensus.cc:359] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.892838  5763 raft_consensus.cc:359] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.893653  5762 raft_consensus.cc:385] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.880470  5761 raft_consensus.cc:359] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.894485  5498 leader_election.cc:304] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:36.895001  5778 leader_election.cc:290] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:36.897140  5761 raft_consensus.cc:385] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.897524  5741 raft_consensus.cc:2804] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:36.895161  5762 raft_consensus.cc:740] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.898222  5741 raft_consensus.cc:493] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.898659  5741 raft_consensus.cc:3060] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.898811  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af51674e04b4a1689b427de8e3245eb" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:36.898931  5762 consensus_queue.cc:260] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.897526  5761 raft_consensus.cc:740] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.901464  5761 consensus_queue.cc:260] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
W20260709 12:25:36.902212  5498 leader_election.cc:343] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.905963  5762 ts_tablet_manager.cc:1434] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 12:25:36.907392  5762 tablet_bootstrap.cc:492] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:36.910522  5761 ts_tablet_manager.cc:1434] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.046s	user 0.012s	sys 0.001s
I20260709 12:25:36.912068  5761 tablet_bootstrap.cc:492] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:36.895292  5763 raft_consensus.cc:385] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.913748  5763 raft_consensus.cc:740] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.914911  5763 consensus_queue.cc:260] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.916865  5763 ts_tablet_manager.cc:1434] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:25:36.918264  5763 tablet_bootstrap.cc:492] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:36.920054  5772 leader_election.cc:290] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:36.921455  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:36.922256  5531 raft_consensus.cc:3060] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.912024  5741 raft_consensus.cc:515] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.925216  5762 tablet_bootstrap.cc:654] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.926725  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af51674e04b4a1689b427de8e3245eb" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:36.927428  5457 raft_consensus.cc:3060] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:36.924968  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
W20260709 12:25:36.931281  5572 leader_election.cc:343] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.932087  5763 tablet_bootstrap.cc:654] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.951352  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af51674e04b4a1689b427de8e3245eb" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
W20260709 12:25:36.953169  5498 leader_election.cc:343] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.953902  5741 leader_election.cc:290] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:36.958810  5457 raft_consensus.cc:2468] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:36.961045  5762 tablet_bootstrap.cc:492] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:36.962131  5762 ts_tablet_manager.cc:1403] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.001s
I20260709 12:25:36.963497  5772 raft_consensus.cc:493] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.964133  5772 raft_consensus.cc:515] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.966324  5761 tablet_bootstrap.cc:654] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:36.965899  5762 raft_consensus.cc:359] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.966770  5762 raft_consensus.cc:385] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.967095  5762 raft_consensus.cc:740] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.968024  5762 consensus_queue.cc:260] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.969991  5762 ts_tablet_manager.cc:1434] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:36.971134  5762 tablet_bootstrap.cc:492] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:36.970137  5498 leader_election.cc:304] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 30d0815aa09840b3a5457d9de2b0e19c
I20260709 12:25:36.971076  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:36.971057  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:36.972882  5778 raft_consensus.cc:2804] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:36.973512  5778 raft_consensus.cc:697] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
W20260709 12:25:36.973987  5571 leader_election.cc:343] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.974474  5778 consensus_queue.cc:237] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.977586  5772 leader_election.cc:290] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
W20260709 12:25:36.978485  5572 leader_election.cc:343] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:36.979079  5572 leader_election.cc:304] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:36.979972  5772 raft_consensus.cc:2749] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:36.980829  5763 tablet_bootstrap.cc:492] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:36.961227  5531 raft_consensus.cc:2468] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 1.
I20260709 12:25:36.981503  5763 ts_tablet_manager.cc:1403] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.010s
I20260709 12:25:36.982550  5571 leader_election.cc:304] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:36.984125  5772 raft_consensus.cc:2804] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:36.984800  5772 raft_consensus.cc:697] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:36.985360  5741 raft_consensus.cc:493] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.985745  5763 raft_consensus.cc:359] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.988855  5763 raft_consensus.cc:385] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:36.989190  5763 raft_consensus.cc:740] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:36.990118  5763 consensus_queue.cc:260] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.978904  5762 tablet_bootstrap.cc:654] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:36.987730  5403 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:36.987052  5741 raft_consensus.cc:515] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:36.996807  5763 ts_tablet_manager.cc:1434] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:25:36.998162  5763 tablet_bootstrap.cc:492] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:36.986649  5772 consensus_queue.cc:237] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.004552  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:37.001515  5741 leader_election.cc:290] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.005391  5457 raft_consensus.cc:2468] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:37.006958  5498 leader_election.cc:304] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.009680  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.011602  5778 raft_consensus.cc:2804] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.012321  5778 raft_consensus.cc:493] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.012843  5778 raft_consensus.cc:3060] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:37.014614  5498 leader_election.cc:343] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.016892  5354 catalog_manager.cc:5697] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 1 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.023797  5762 tablet_bootstrap.cc:492] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:37.024624  5762 ts_tablet_manager.cc:1403] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.000s
I20260709 12:25:37.025897  5761 tablet_bootstrap.cc:492] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:37.028843  5762 raft_consensus.cc:359] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.029475  5761 ts_tablet_manager.cc:1403] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.118s	user 0.017s	sys 0.001s
I20260709 12:25:37.005745  5763 tablet_bootstrap.cc:654] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.033536  5761 raft_consensus.cc:359] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.034292  5761 raft_consensus.cc:385] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.034606  5761 raft_consensus.cc:740] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.034638  5762 raft_consensus.cc:385] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.035063  5762 raft_consensus.cc:740] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.035852  5762 consensus_queue.cc:260] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.037319  5761 consensus_queue.cc:260] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.038089  5778 raft_consensus.cc:515] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.041945  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:37.042608  5457 raft_consensus.cc:3060] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.046237  5762 ts_tablet_manager.cc:1434] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 12:25:37.052290  5457 raft_consensus.cc:2468] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:37.053683  5498 leader_election.cc:304] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.054630  5741 raft_consensus.cc:2804] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.056403  5762 tablet_bootstrap.cc:492] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:37.067111  5761 ts_tablet_manager.cc:1434] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:25:37.067986  5763 tablet_bootstrap.cc:492] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:37.068270  5761 tablet_bootstrap.cc:492] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c: Bootstrap starting.
I20260709 12:25:37.068574  5763 ts_tablet_manager.cc:1403] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.005s
I20260709 12:25:37.071614  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.072182  5763 raft_consensus.cc:359] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.072960  5763 raft_consensus.cc:385] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.073287  5763 raft_consensus.cc:740] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
W20260709 12:25:37.073341  5498 leader_election.cc:343] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:37.077155  5762 tablet_bootstrap.cc:654] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.075177  5778 leader_election.cc:290] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.081874  5353 catalog_manager.cc:5697] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 0 to 1, leader changed from <none> to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 1 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:37.078114  5763 consensus_queue.cc:260] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.085307  5741 raft_consensus.cc:697] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:37.086412  5741 consensus_queue.cc:237] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.087769  5763 ts_tablet_manager.cc:1434] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:25:37.091610  5763 tablet_bootstrap.cc:492] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:37.096709  5783 raft_consensus.cc:493] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.097340  5783 raft_consensus.cc:515] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.101030  5761 tablet_bootstrap.cc:654] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.101831  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:37.102492  5796 raft_consensus.cc:493] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.103044  5796 raft_consensus.cc:515] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.104058  5531 raft_consensus.cc:2468] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:37.106112  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.106837  5606 raft_consensus.cc:2468] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:37.107946  5422 leader_election.cc:304] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.108815  5796 leader_election.cc:290] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.109315  5696 raft_consensus.cc:2804] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.109593  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:37.109990  5696 raft_consensus.cc:493] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.110556  5696 raft_consensus.cc:3060] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.111044  5796 raft_consensus.cc:493] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.111583  5796 raft_consensus.cc:515] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.112355  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.113060  5606 raft_consensus.cc:2468] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:37.113916  5783 leader_election.cc:290] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.114642  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:37.115494  5456 raft_consensus.cc:2393] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in current term 1: Already voted for candidate 30d0815aa09840b3a5457d9de2b0e19c in this term.
I20260709 12:25:37.117583  5498 leader_election.cc:304] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:37.118541  5778 raft_consensus.cc:2804] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.118942  5778 raft_consensus.cc:493] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.119287  5778 raft_consensus.cc:3060] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.119730  5763 tablet_bootstrap.cc:654] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.121469  5696 raft_consensus.cc:515] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.123011  5457 raft_consensus.cc:2393] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in current term 1: Already voted for candidate 52f6deb1e451449982a9496ac99ddb32 in this term.
I20260709 12:25:37.125241  5762 tablet_bootstrap.cc:492] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:37.125802  5762 ts_tablet_manager.cc:1403] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.007s
I20260709 12:25:37.126961  5696 leader_election.cc:290] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.127360  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:37.128691  5762 raft_consensus.cc:359] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.129419  5762 raft_consensus.cc:385] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.129667  5762 raft_consensus.cc:740] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.129808  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.130555  5606 raft_consensus.cc:3060] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.131408  5796 leader_election.cc:290] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.130616  5762 consensus_queue.cc:260] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.133997  5762 ts_tablet_manager.cc:1434] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:37.134925  5762 tablet_bootstrap.cc:492] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Bootstrap starting.
I20260709 12:25:37.137061  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.143290  5353 catalog_manager.cc:5697] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 1 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.146595  5606 raft_consensus.cc:2468] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:37.148610  5422 leader_election.cc:304] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.150081  5498 leader_election.cc:304] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:37.150480  5696 raft_consensus.cc:2804] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.151980  5696 raft_consensus.cc:697] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:37.152184  5797 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.152508  5762 tablet_bootstrap.cc:654] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.153064  5696 consensus_queue.cc:237] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.155232  5783 raft_consensus.cc:493] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.155879  5783 raft_consensus.cc:515] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.157189  5763 tablet_bootstrap.cc:492] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:37.157539  5783 leader_election.cc:290] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.157706  5763 ts_tablet_manager.cc:1403] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.004s
I20260709 12:25:37.158471  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:37.159174  5532 raft_consensus.cc:2468] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:37.162356  5421 leader_election.cc:304] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.164654  5763 raft_consensus.cc:359] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.165463  5763 raft_consensus.cc:385] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.165688  5797 raft_consensus.cc:2749] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:37.165953  5783 raft_consensus.cc:2804] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.165791  5763 raft_consensus.cc:740] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.172416  5783 raft_consensus.cc:493] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.172811  5783 raft_consensus.cc:3060] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.173159  5763 consensus_queue.cc:260] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.168767  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.174696  5606 raft_consensus.cc:2468] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:37.175217  5763 ts_tablet_manager.cc:1434] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:25:37.168743  5762 tablet_bootstrap.cc:492] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf: No bootstrap required, opened a new log
I20260709 12:25:37.176399  5762 ts_tablet_manager.cc:1403] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 12:25:37.176991  5763 tablet_bootstrap.cc:492] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32: Bootstrap starting.
I20260709 12:25:37.170186  5778 raft_consensus.cc:515] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.181635  5531 raft_consensus.cc:2393] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 52f6deb1e451449982a9496ac99ddb32 in current term 1: Already voted for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in this term.
I20260709 12:25:37.181635  5783 raft_consensus.cc:515] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.182789  5778 leader_election.cc:290] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.184116  5783 leader_election.cc:290] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.183830  5762 raft_consensus.cc:359] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.184710  5762 raft_consensus.cc:385] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.185281  5762 raft_consensus.cc:740] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.184679  5353 catalog_manager.cc:5697] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.185920  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.186062  5762 consensus_queue.cc:260] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.186883  5606 raft_consensus.cc:3060] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.187292  5797 raft_consensus.cc:493] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.187741  5797 raft_consensus.cc:515] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.188644  5762 ts_tablet_manager.cc:1434] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:25:37.189930  5797 leader_election.cc:290] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.191320  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:37.192214  5531 raft_consensus.cc:3060] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.198333  5761 tablet_bootstrap.cc:492] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c: No bootstrap required, opened a new log
I20260709 12:25:37.199045  5761 ts_tablet_manager.cc:1403] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.004s
I20260709 12:25:37.199254  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.200202  5605 raft_consensus.cc:2393] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in current term 1: Already voted for candidate 52f6deb1e451449982a9496ac99ddb32 in this term.
I20260709 12:25:37.201715  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d522795c924db8846dccf157c5f624" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:37.202558  5761 raft_consensus.cc:359] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.203405  5761 raft_consensus.cc:385] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.203745  5761 raft_consensus.cc:740] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.204980  5498 leader_election.cc:304] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:37.212430  5761 consensus_queue.cc:260] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.215291  5761 ts_tablet_manager.cc:1434] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:25:37.206759  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.206869  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:37.217104  5457 raft_consensus.cc:2468] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:37.218274  5605 raft_consensus.cc:2468] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:37.219231  5778 raft_consensus.cc:2749] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:37.220314  5498 leader_election.cc:304] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.221112  5778 raft_consensus.cc:2804] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.221544  5778 raft_consensus.cc:493] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.222173  5531 raft_consensus.cc:2468] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:37.223506  5778 raft_consensus.cc:3060] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.224274  5421 leader_election.cc:304] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.225247  5783 raft_consensus.cc:2804] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.225786  5783 raft_consensus.cc:697] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:37.223457  5606 raft_consensus.cc:2468] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:37.226650  5783 consensus_queue.cc:237] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.233307  5778 raft_consensus.cc:515] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.237013  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:37.237746  5457 raft_consensus.cc:3060] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.245009  5763 tablet_bootstrap.cc:654] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.247666  5457 raft_consensus.cc:2468] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:37.250249  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.250856  5778 leader_election.cc:290] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.251682  5606 raft_consensus.cc:3060] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.252663  5498 leader_election.cc:304] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.253829  5778 raft_consensus.cc:2804] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.254482  5778 raft_consensus.cc:697] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:37.254474  5353 catalog_manager.cc:5697] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.255851  5778 consensus_queue.cc:237] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.264020  5606 raft_consensus.cc:2468] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:37.270073  5763 tablet_bootstrap.cc:492] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32: No bootstrap required, opened a new log
I20260709 12:25:37.270524  5763 ts_tablet_manager.cc:1403] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.005s
I20260709 12:25:37.272718  5763 raft_consensus.cc:359] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.273962  5763 raft_consensus.cc:385] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.274252  5763 raft_consensus.cc:740] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.274943  5763 consensus_queue.cc:260] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.277055  5763 ts_tablet_manager.cc:1434] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:25:37.276330  5353 catalog_manager.cc:5697] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 1 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.283581  5772 consensus_queue.cc:1048] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.311163  5778 raft_consensus.cc:493] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.312711  5773 consensus_queue.cc:1048] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.314611  5778 raft_consensus.cc:515] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.317107  5778 leader_election.cc:290] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.319038  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b8faadd63f4ee2b0193205325b0a3c" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.319324  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b8faadd63f4ee2b0193205325b0a3c" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:37.319929  5606 raft_consensus.cc:2468] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:37.320350  5456 raft_consensus.cc:2468] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 0.
I20260709 12:25:37.321570  5498 leader_election.cc:304] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:37.323349  5778 raft_consensus.cc:2804] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.323760  5778 raft_consensus.cc:493] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.324133  5778 raft_consensus.cc:3060] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.332293  5773 raft_consensus.cc:493] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.332875  5773 raft_consensus.cc:515] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.333750  5778 raft_consensus.cc:515] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.334812  5773 leader_election.cc:290] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:37.336664  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af51674e04b4a1689b427de8e3245eb" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:37.336992  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b8faadd63f4ee2b0193205325b0a3c" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:37.337594  5456 raft_consensus.cc:3060] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.338121  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b8faadd63f4ee2b0193205325b0a3c" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.338860  5606 raft_consensus.cc:3060] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.335819  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5af51674e04b4a1689b427de8e3245eb" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:37.347596  5457 raft_consensus.cc:2393] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30d0815aa09840b3a5457d9de2b0e19c in current term 1: Already voted for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in this term.
I20260709 12:25:37.349529  5778 leader_election.cc:290] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.349453  5456 raft_consensus.cc:2468] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:37.348958  5606 raft_consensus.cc:2468] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 1.
I20260709 12:25:37.350839  5572 leader_election.cc:304] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:37.352128  5498 leader_election.cc:304] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:37.352236  5773 raft_consensus.cc:3060] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.353549  5778 raft_consensus.cc:2804] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.354103  5778 raft_consensus.cc:697] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:37.355005  5778 consensus_queue.cc:237] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.361944  5773 raft_consensus.cc:2749] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:37.369302  5353 catalog_manager.cc:5697] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 1 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.392586  5773 raft_consensus.cc:493] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.393391  5773 raft_consensus.cc:515] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.396149  5773 leader_election.cc:290] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:37.396926  5456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52f6deb1e451449982a9496ac99ddb32" is_pre_election: true
I20260709 12:25:37.397377  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:37.398154  5456 raft_consensus.cc:2393] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30d0815aa09840b3a5457d9de2b0e19c in current term 1: Already voted for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in this term.
I20260709 12:25:37.399261  5572 leader_election.cc:304] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c; no voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:37.399464  5696 raft_consensus.cc:493] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.400149  5773 raft_consensus.cc:3060] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.400013  5696 raft_consensus.cc:515] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.402112  5696 leader_election.cc:290] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.403064  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:37.403787  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.403824  5531 raft_consensus.cc:2468] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:37.404618  5606 raft_consensus.cc:2468] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 0.
I20260709 12:25:37.405550  5421 leader_election.cc:304] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.406556  5696 raft_consensus.cc:2804] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:37.407924  5696 raft_consensus.cc:493] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.408385  5696 raft_consensus.cc:3060] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.410996  5773 raft_consensus.cc:2749] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:37.415518  5696 raft_consensus.cc:515] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.418125  5696 leader_election.cc:290] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.418733  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.418924  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:37.419456  5606 raft_consensus.cc:3060] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.419776  5531 raft_consensus.cc:3060] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.427724  5606 raft_consensus.cc:2468] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:37.429008  5422 leader_election.cc:304] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.429910  5696 raft_consensus.cc:2804] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.430586  5696 raft_consensus.cc:697] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:37.430725  5531 raft_consensus.cc:2468] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 1.
I20260709 12:25:37.431516  5696 consensus_queue.cc:237] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.443226  5696 raft_consensus.cc:493] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.442612  5353 catalog_manager.cc:5697] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 1 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.444219  5696 raft_consensus.cc:515] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.447005  5797 consensus_queue.cc:1048] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.448511  5696 leader_election.cc:290] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.449225  5531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" is_pre_election: true
I20260709 12:25:37.450235  5531 raft_consensus.cc:2393] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52f6deb1e451449982a9496ac99ddb32 in current term 1: Already voted for candidate 30d0815aa09840b3a5457d9de2b0e19c in this term.
I20260709 12:25:37.451402  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c" is_pre_election: true
I20260709 12:25:37.454074  5422 leader_election.cc:304] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52f6deb1e451449982a9496ac99ddb32; no voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:37.455507  5696 raft_consensus.cc:3060] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.460810  5778 consensus_queue.cc:1048] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.477957  5778 consensus_queue.cc:1048] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.526774  5773 consensus_queue.cc:1048] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.534415  5605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
mode: GRACEFUL
new_leader_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:46740
I20260709 12:25:37.535259  5605 raft_consensus.cc:606] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Received request to transfer leadership to TS 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:37.536703  5741 consensus_queue.cc:1048] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.546170  5532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
mode: GRACEFUL
new_leader_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:38902
I20260709 12:25:37.546913  5532 raft_consensus.cc:606] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Received request to transfer leadership to TS 52f6deb1e451449982a9496ac99ddb32
I20260709 12:25:37.577898  5696 raft_consensus.cc:2749] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:37.582378  5772 consensus_queue.cc:1048] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.586968  5605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
mode: GRACEFUL
new_leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:46740
I20260709 12:25:37.587690  5605 raft_consensus.cc:606] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Received request to transfer leadership to TS 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:37.596702  5456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
mode: GRACEFUL
new_leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:37396
I20260709 12:25:37.597539  5456 raft_consensus.cc:606] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Received request to transfer leadership to TS 3f0a9bfb3dba47d78d0d0576b4a4aacf
I20260709 12:25:37.606660  5811 raft_consensus.cc:993] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: : Instructing follower 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:37.607179  5772 raft_consensus.cc:1081] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Signalling peer 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:37.608987  5457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:37380
I20260709 12:25:37.609916  5457 raft_consensus.cc:493] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.610311  5457 raft_consensus.cc:3060] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.613221  5696 consensus_queue.cc:1048] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.618151  5457 raft_consensus.cc:515] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.620690  5457 leader_election.cc:290] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.621742  5532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:37.622013  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b2791e70184f68a5854ad1533c8cdd" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.622594  5532 raft_consensus.cc:3060] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.622725  5605 raft_consensus.cc:3055] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.623180  5605 raft_consensus.cc:740] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:37.623945  5605 consensus_queue.cc:260] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.624894  5605 raft_consensus.cc:3060] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.628772  5533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
mode: GRACEFUL
new_leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:38902
I20260709 12:25:37.629678  5533 raft_consensus.cc:606] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Received request to transfer leadership to TS 30d0815aa09840b3a5457d9de2b0e19c
I20260709 12:25:37.632215  5532 raft_consensus.cc:2468] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:37.634032  5421 leader_election.cc:304] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.635077  5696 raft_consensus.cc:2804] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.635703  5696 raft_consensus.cc:697] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:37.636708  5696 consensus_queue.cc:237] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.641419  5605 raft_consensus.cc:2468] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:37.652107  5352 catalog_manager.cc:5697] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 1 to 2, leader changed from 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67) to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.653678  5696 consensus_queue.cc:1048] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.691542  5741 consensus_queue.cc:1048] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.693602  5818 consensus_queue.cc:1048] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.696415  5818 consensus_queue.cc:1048] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.728019  5796 consensus_queue.cc:1048] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.749980  5818 raft_consensus.cc:993] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: : Instructing follower 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:37.750492  5818 raft_consensus.cc:1081] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Signalling peer 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:37.752283  5778 raft_consensus.cc:993] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: : Instructing follower 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:37.752449  5531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:38896
I20260709 12:25:37.752866  5778 raft_consensus.cc:1081] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Signalling peer 52f6deb1e451449982a9496ac99ddb32 to start an election
I20260709 12:25:37.753113  5531 raft_consensus.cc:493] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.753521  5531 raft_consensus.cc:3060] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.760147  5456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
 from {username='slave'} at 127.0.0.1:37364
I20260709 12:25:37.760929  5456 raft_consensus.cc:493] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.761346  5456 raft_consensus.cc:3060] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.769491  5456 raft_consensus.cc:515] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.770340  5531 raft_consensus.cc:515] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.771780  5532 raft_consensus.cc:1240] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Rejecting Update request from peer 52f6deb1e451449982a9496ac99ddb32 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:37.772768  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:37.773468  5533 raft_consensus.cc:3055] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.773854  5533 raft_consensus.cc:740] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:37.774716  5533 consensus_queue.cc:260] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.775892  5533 raft_consensus.cc:3060] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.775746  5531 leader_election.cc:290] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.777626  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.778427  5605 raft_consensus.cc:3060] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.778183  5696 consensus_queue.cc:1059] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.779479  5696 raft_consensus.cc:3055] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.779887  5696 raft_consensus.cc:740] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:37.778759  5456 leader_election.cc:290] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.780823  5696 consensus_queue.cc:260] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.783703  5696 raft_consensus.cc:3060] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.783926  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46861d48f48c4a3ba3b52e898f95e658" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:37.785185  5606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e37d9b7d0d64673b48e95a6a78f1a19" candidate_uuid: "52f6deb1e451449982a9496ac99ddb32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.785840  5606 raft_consensus.cc:3060] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.795790  5533 raft_consensus.cc:2468] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:37.797308  5421 leader_election.cc:304] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.798388  5696 raft_consensus.cc:2804] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.799306  5696 raft_consensus.cc:697] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Becoming Leader. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:37.800249  5696 consensus_queue.cc:237] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.802465  5606 raft_consensus.cc:2468] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52f6deb1e451449982a9496ac99ddb32 in term 2.
I20260709 12:25:37.802498  5457 raft_consensus.cc:2468] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:37.805347  5498 leader_election.cc:304] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0a9bfb3dba47d78d0d0576b4a4aacf, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:37.806512  5796 raft_consensus.cc:2804] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.807142  5796 raft_consensus.cc:697] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:37.808527  5796 consensus_queue.cc:237] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.810973  5605 raft_consensus.cc:2468] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:37.821970  5352 catalog_manager.cc:5697] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 reported cstate change: term changed from 1 to 2, leader changed from 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66) to 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65). New cstate: current_term: 2 leader_uuid: "52f6deb1e451449982a9496ac99ddb32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.824571  5354 catalog_manager.cc:5697] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 1 to 2, leader changed from 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65) to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 2 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.862073  5772 raft_consensus.cc:993] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: : Instructing follower 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:37.862686  5811 raft_consensus.cc:1081] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Signalling peer 3f0a9bfb3dba47d78d0d0576b4a4aacf to start an election
I20260709 12:25:37.864624  5533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
 from {username='slave'} at 127.0.0.1:38900
I20260709 12:25:37.865176  5533 raft_consensus.cc:493] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:37.865505  5533 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.871582  5533 raft_consensus.cc:515] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.873550  5533 leader_election.cc:290] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67:45293)
I20260709 12:25:37.874679  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:37.875013  5605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
I20260709 12:25:37.875470  5457 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.875648  5605 raft_consensus.cc:3055] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:37.876084  5605 raft_consensus.cc:740] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:37.876837  5605 consensus_queue.cc:260] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.877942  5605 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:37.883651  5605 raft_consensus.cc:2468] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:37.883881  5457 raft_consensus.cc:2468] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0a9bfb3dba47d78d0d0576b4a4aacf in term 2.
I20260709 12:25:37.884897  5498 leader_election.cc:304] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:37.885713  5796 raft_consensus.cc:2804] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:37.886247  5796 raft_consensus.cc:697] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Becoming Leader. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:37.887140  5796 consensus_queue.cc:237] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:37.894382  5354 catalog_manager.cc:5697] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf reported cstate change: term changed from 1 to 2, leader changed from 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67) to 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66). New cstate: current_term: 2 leader_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.919862  5696 consensus_queue.cc:1048] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:37.933496  5783 consensus_queue.cc:1048] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.949878  5797 consensus_queue.cc:1048] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:37.955572  5796 consensus_queue.cc:1048] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:38.011251  5741 raft_consensus.cc:993] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: : Instructing follower 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:38.011806  5741 raft_consensus.cc:1081] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Signalling peer 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:38.013639  5605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:46718
I20260709 12:25:38.014315  5605 raft_consensus.cc:493] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:38.014719  5605 raft_consensus.cc:3060] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.023357  5605 raft_consensus.cc:515] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:38.025552  5605 leader_election.cc:290] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 2 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:38.026602  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:38.027303  5457 raft_consensus.cc:3060] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.031484  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bee45aae7544634add44b7dac5b942e" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:38.032198  5533 raft_consensus.cc:3055] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:38.032517  5533 raft_consensus.cc:740] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:38.033422  5533 consensus_queue.cc:260] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:38.035130  5533 raft_consensus.cc:3060] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:38.036242  5457 raft_consensus.cc:2468] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 2.
I20260709 12:25:38.037616  5572 leader_election.cc:304] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:38.038524  5811 raft_consensus.cc:2804] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:38.039130  5811 raft_consensus.cc:697] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:38.040113  5811 consensus_queue.cc:237] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:38.045010  5533 raft_consensus.cc:2468] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 2.
I20260709 12:25:38.049368  5352 catalog_manager.cc:5697] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 1 to 2, leader changed from 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66) to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 2 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.147583  5533 raft_consensus.cc:1275] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.149559  5783 consensus_queue.cc:1048] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.158370  5605 raft_consensus.cc:1275] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.162400  5696 consensus_queue.cc:1048] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.224524  5531 raft_consensus.cc:1275] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.226178  5783 consensus_queue.cc:1048] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.246742  5605 raft_consensus.cc:1275] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 52f6deb1e451449982a9496ac99ddb32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.248476  5783 consensus_queue.cc:1048] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.394174  5457 raft_consensus.cc:1275] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.395555  5741 consensus_queue.cc:1048] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:38.398826  5605 raft_consensus.cc:1275] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.401558  5797 consensus_queue.cc:1048] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.401840  5457 raft_consensus.cc:1275] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.409236  5741 consensus_queue.cc:1048] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.430670  5605 raft_consensus.cc:1275] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Refusing update from remote peer 3f0a9bfb3dba47d78d0d0576b4a4aacf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.438925  5797 consensus_queue.cc:1048] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [LEADER]: Connected to new peer: Peer: permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:38.452009  5531 raft_consensus.cc:1275] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.453749  5811 consensus_queue.cc:1048] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:38.463186  5456 raft_consensus.cc:1275] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:38.465574  5811 consensus_queue.cc:1048] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:40.636745  5354 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57244:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:25:40.659605  5354 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57244:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:25:40.707047 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:25:40.888283  5856 log.cc:927] Time spent T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: Append to log took a long time: real 0.063s	user 0.000s	sys 0.005s
W20260709 12:25:40.922546  5877 log.cc:927] Time spent T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.002s
I20260709 12:25:40.970377  5886 tablet.cc:1724] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:40.975204  5878 log.cc:927] Time spent T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:25:41.046386  5887 tablet.cc:1724] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:40.965319  5893 tablet.cc:1724] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:41.066282  5484 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1a8d78ba65794b72ac29bc17f6287c8a)
W20260709 12:25:41.093014  5484 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:1a8d78ba65794b72ac29bc17f6287c8a)
I20260709 12:25:41.098564  5903 tablet.cc:1724] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:25:41.106438  5484 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:1a8d78ba65794b72ac29bc17f6287c8a)
I20260709 12:25:41.088806  5900 tablet.cc:1724] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.068630  5895 tablet.cc:1724] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.129006  5454 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
mode: GRACEFUL
new_leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:53292
I20260709 12:25:41.130141  5454 raft_consensus.cc:606] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Received request to transfer leadership to TS 30d0815aa09840b3a5457d9de2b0e19c
I20260709 12:25:41.061564  5901 tablet.cc:1724] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.062825  5902 tablet.cc:1724] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.144675  5895 tablet.cc:1724] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.148914  5868 raft_consensus.cc:993] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: : Instructing follower 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.149493  5868 raft_consensus.cc:1081] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Signalling peer 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.062431  5899 tablet.cc:1724] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.165723  5904 tablet.cc:1724] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.223480  5895 tablet.cc:1724] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.225188  5887 tablet.cc:1724] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.231276  5893 tablet.cc:1724] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.232738  5603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:46726
I20260709 12:25:41.233477  5603 raft_consensus.cc:493] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.234532  5603 raft_consensus.cc:3060] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.257041  5900 tablet.cc:1724] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.290180  5911 tablet.cc:1724] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.290817  5904 tablet.cc:1724] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.312201  5887 tablet.cc:1724] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.305116  5886 tablet.cc:1724] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.319496  5893 tablet.cc:1724] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.333907  5899 tablet.cc:1724] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.335811  5902 tablet.cc:1724] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.334450  5900 tablet.cc:1724] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.338541  5603 raft_consensus.cc:515] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.342197  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:41.342922  5457 raft_consensus.cc:3055] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:41.343299  5457 raft_consensus.cc:740] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:41.344955  5457 consensus_queue.cc:260] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.346143  5457 raft_consensus.cc:3060] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.353361  5533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8d78ba65794b72ac29bc17f6287c8a" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:41.354813  5533 raft_consensus.cc:3060] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:41.362931  5603 leader_election.cc:290] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 2 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
W20260709 12:25:41.374547  5420 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.385314  5457 raft_consensus.cc:2468] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 2.
I20260709 12:25:41.391563  5572 leader_election.cc:304] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:41.392720  5891 raft_consensus.cc:2804] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:41.393245  5891 raft_consensus.cc:697] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 2 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:41.394125  5891 consensus_queue.cc:237] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.395097  5533 raft_consensus.cc:2468] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 2.
I20260709 12:25:41.398181  5533 raft_consensus.cc:1240] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Rejecting Update request from peer 52f6deb1e451449982a9496ac99ddb32 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:41.400027  5900 tablet.cc:1724] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.404717  5911 tablet.cc:1724] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.407702  5530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
mode: GRACEFUL
new_leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:50938
I20260709 12:25:41.408818  5530 raft_consensus.cc:606] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Received request to transfer leadership to TS 30d0815aa09840b3a5457d9de2b0e19c
I20260709 12:25:41.411383 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:25:41.412163 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.418442  5900 tablet.cc:1724] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.423610  5353 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7: soft_deleted_table [id=904e437b214f4427bfd998900630a557] alter complete (version 1)
I20260709 12:25:41.443887  5352 catalog_manager.cc:5697] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 1 to 2, leader changed from 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65) to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 2 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.445549  5457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e"
dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
mode: GRACEFUL
new_leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:53292
I20260709 12:25:41.446208  5457 raft_consensus.cc:606] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Received request to transfer leadership to TS 30d0815aa09840b3a5457d9de2b0e19c
I20260709 12:25:41.448889  5533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3"
dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
mode: GRACEFUL
new_leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:50938
I20260709 12:25:41.449498  5533 raft_consensus.cc:606] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Received request to transfer leadership to TS 30d0815aa09840b3a5457d9de2b0e19c
I20260709 12:25:41.451268 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:41.451928 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:41.579583  5869 raft_consensus.cc:993] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: : Instructing follower 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.580343  5908 raft_consensus.cc:1081] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Signalling peer 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.582204  5603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:46718
I20260709 12:25:41.582757  5603 raft_consensus.cc:493] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.583106  5603 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.589512  5603 raft_consensus.cc:515] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.591921  5603 leader_election.cc:290] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 3 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:41.592543  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:41.592967  5530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4344ea6eea254938a1a7b05a83785172" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:41.593261  5457 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.593837  5530 raft_consensus.cc:3055] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:41.594213  5530 raft_consensus.cc:740] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:41.595095  5530 consensus_queue.cc:260] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.596431  5530 raft_consensus.cc:3060] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.601737  5457 raft_consensus.cc:2468] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 3.
I20260709 12:25:41.603101  5572 leader_election.cc:304] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:41.603964  5891 raft_consensus.cc:2804] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:41.604485  5891 raft_consensus.cc:697] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:41.604857  5530 raft_consensus.cc:2468] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 3.
I20260709 12:25:41.605414  5891 consensus_queue.cc:237] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.617192  5352 catalog_manager.cc:5697] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 2 to 3, leader changed from 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66) to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 3 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.663053  5875 raft_consensus.cc:993] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32: : Instructing follower 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.663616  5875 raft_consensus.cc:1081] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Signalling peer 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.665473  5603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:46726
I20260709 12:25:41.666177  5603 raft_consensus.cc:493] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.666554  5603 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.672892  5603 raft_consensus.cc:515] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:41.674924  5603 leader_election.cc:290] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 3 election: Requested vote from peers 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507), 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881)
I20260709 12:25:41.675884  5530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:41.676148  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b9eb9d1e9a4e2ba998cfdcf3ac648e" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:41.676637  5530 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.676789  5457 raft_consensus.cc:3055] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:41.677225  5457 raft_consensus.cc:740] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 52f6deb1e451449982a9496ac99ddb32, State: Running, Role: LEADER
I20260709 12:25:41.678169  5457 consensus_queue.cc:260] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:41.679265  5457 raft_consensus.cc:3060] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.685971  5530 raft_consensus.cc:2468] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 3.
I20260709 12:25:41.686829  5457 raft_consensus.cc:2468] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 3.
I20260709 12:25:41.687505  5571 leader_election.cc:304] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 3f0a9bfb3dba47d78d0d0576b4a4aacf; no voters: 
I20260709 12:25:41.688385  5891 raft_consensus.cc:2804] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:41.688967  5891 raft_consensus.cc:697] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 3 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:41.689870  5891 consensus_queue.cc:237] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } }
I20260709 12:25:41.699483  5352 catalog_manager.cc:5697] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 2 to 3, leader changed from 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65) to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 3 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.863677  5908 raft_consensus.cc:993] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: : Instructing follower 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.864234  5869 raft_consensus.cc:1081] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Signalling peer 30d0815aa09840b3a5457d9de2b0e19c to start an election
I20260709 12:25:41.866124  5603 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3"
dest_uuid: "30d0815aa09840b3a5457d9de2b0e19c"
 from {username='slave'} at 127.0.0.1:46718
I20260709 12:25:41.866685  5603 raft_consensus.cc:493] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:41.867028  5603 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.873986  5457 raft_consensus.cc:1275] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:41.873797  5603 raft_consensus.cc:515] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.875487  5891 consensus_queue.cc:1048] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:41.876323  5603 leader_election.cc:290] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 3 election: Requested vote from peers 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881), 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507)
I20260709 12:25:41.877004  5457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "52f6deb1e451449982a9496ac99ddb32"
I20260709 12:25:41.877717  5457 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.878651  5530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac87e6e2662846f6bf75d974ba3a21b3" candidate_uuid: "30d0815aa09840b3a5457d9de2b0e19c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf"
I20260709 12:25:41.879459  5530 raft_consensus.cc:3055] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:41.879873  5530 raft_consensus.cc:740] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3f0a9bfb3dba47d78d0d0576b4a4aacf, State: Running, Role: LEADER
I20260709 12:25:41.882069  5530 consensus_queue.cc:260] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.883656  5530 raft_consensus.cc:3060] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:41.887436  5457 raft_consensus.cc:2468] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 3.
I20260709 12:25:41.889631  5572 leader_election.cc:304] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30d0815aa09840b3a5457d9de2b0e19c, 52f6deb1e451449982a9496ac99ddb32; no voters: 
I20260709 12:25:41.891882  5891 raft_consensus.cc:2804] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:41.894001  5530 raft_consensus.cc:2468] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30d0815aa09840b3a5457d9de2b0e19c in term 3.
I20260709 12:25:41.900043  5891 raft_consensus.cc:697] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 LEADER]: Becoming Leader. State: Replica: 30d0815aa09840b3a5457d9de2b0e19c, State: Running, Role: LEADER
I20260709 12:25:41.910225  5891 consensus_queue.cc:237] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } }
I20260709 12:25:41.935282  5530 raft_consensus.cc:1275] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:25:41.940691  5924 consensus_queue.cc:1048] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:41.958316  5928 tablet.cc:1724] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:25:41.964076  5352 catalog_manager.cc:5697] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c reported cstate change: term changed from 2 to 3, leader changed from 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66) to 30d0815aa09840b3a5457d9de2b0e19c (127.28.234.67). New cstate: current_term: 3 leader_uuid: "30d0815aa09840b3a5457d9de2b0e19c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30d0815aa09840b3a5457d9de2b0e19c" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 45293 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.033087  5455 raft_consensus.cc:1275] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:42.034988  5924 consensus_queue.cc:1048] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:42.045019  5533 raft_consensus.cc:1275] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:25:42.046581  5922 consensus_queue.cc:1048] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:42.212396  5533 raft_consensus.cc:1275] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.214908  5922 consensus_queue.cc:1048] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:42.232754  5455 raft_consensus.cc:1275] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.236521  5891 consensus_queue.cc:1048] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:42.362778  5533 raft_consensus.cc:1275] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.364141  5922 consensus_queue.cc:1048] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f0a9bfb3dba47d78d0d0576b4a4aacf" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 40507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:42.377954  5455 raft_consensus.cc:1275] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Refusing update from remote peer 30d0815aa09840b3a5457d9de2b0e19c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.381726  5924 consensus_queue.cc:1048] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [LEADER]: Connected to new peer: Peer: permanent_uuid: "52f6deb1e451449982a9496ac99ddb32" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 33881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:42.453457 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:42.460186 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.460633 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.466409 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:42.466969 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:43.468459 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:43.474097 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:43.474620 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.480456 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:43.480885 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.481998 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:44.488371 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:44.488943 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.495076 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:44.495589 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:45.496779 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:45.504580 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.505223 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.511161 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.511747 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.512972 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:46.518922 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:46.519511 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:46.524806 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:46.525328 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:47.526453 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:47.531890 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:47.532405 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:47.537120 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:47.537585 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:48.539093 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:48.545127 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:48.545629 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:48.550735 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:48.551239 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.552352 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:49.560246 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:49.560801 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.566427 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:49.566941 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:50.568032 29609 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:25:50.573304 29609 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:25:50.573853 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.578953 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:50.579432 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:51.649406 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
W20260709 12:25:51.666625  5572 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 12:25:51.672792  5572 consensus_peers.cc:597] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.699105 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:25:51.699251  5572 consensus_peers.cc:597] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.700333 29609 tablet_replica.cc:333] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.701413 29609 raft_consensus.cc:2243] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.702184 29609 raft_consensus.cc:2272] T 99b8faadd63f4ee2b0193205325b0a3c P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.704879 29609 tablet_replica.cc:333] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.705677 29609 raft_consensus.cc:2243] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.706779 29609 raft_consensus.cc:2272] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.709342 29609 tablet_replica.cc:333] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.710122 29609 raft_consensus.cc:2243] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.710747 29609 raft_consensus.cc:2272] T 46861d48f48c4a3ba3b52e898f95e658 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.713584 29609 tablet_replica.cc:333] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.714383 29609 raft_consensus.cc:2243] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.715065 29609 raft_consensus.cc:2272] T 5af51674e04b4a1689b427de8e3245eb P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.718327 29609 tablet_replica.cc:333] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.719223 29609 raft_consensus.cc:2243] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.720199 29609 raft_consensus.cc:2272] T b3b2791e70184f68a5854ad1533c8cdd P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.722719 29609 tablet_replica.cc:333] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.723315 29609 raft_consensus.cc:2243] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.724365 29609 raft_consensus.cc:2272] T b6d522795c924db8846dccf157c5f624 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.727026 29609 tablet_replica.cc:333] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.727670 29609 raft_consensus.cc:2243] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.728637 29609 raft_consensus.cc:2272] T e2d216217c964b919ef4bd4a0ba34ba9 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.731459 29609 tablet_replica.cc:333] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.732100 29609 raft_consensus.cc:2243] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.732556 29609 raft_consensus.cc:2272] T 4344ea6eea254938a1a7b05a83785172 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.735054 29609 tablet_replica.cc:333] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.735615 29609 raft_consensus.cc:2243] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.736090 29609 raft_consensus.cc:2272] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.738739 29609 tablet_replica.cc:333] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.739346 29609 raft_consensus.cc:2243] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.739787 29609 raft_consensus.cc:2272] T b049956c58af4c579dad64d304c90dd0 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.742349 29609 tablet_replica.cc:333] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.742967 29609 raft_consensus.cc:2243] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.743661 29609 raft_consensus.cc:2272] T ac87e6e2662846f6bf75d974ba3a21b3 P 52f6deb1e451449982a9496ac99ddb32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.746838 29609 tablet_replica.cc:333] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.747460 29609 raft_consensus.cc:2243] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.748430 29609 raft_consensus.cc:2272] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.751072 29609 tablet_replica.cc:333] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.751704 29609 raft_consensus.cc:2243] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.752671 29609 raft_consensus.cc:2272] T 7957372b6d5542a68131ad43f61517ed P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.755646 29609 tablet_replica.cc:333] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.756349 29609 raft_consensus.cc:2243] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.756994 29609 raft_consensus.cc:2272] T 1a8d78ba65794b72ac29bc17f6287c8a P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.759596 29609 tablet_replica.cc:333] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.760244 29609 raft_consensus.cc:2243] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.760780 29609 raft_consensus.cc:2272] T bfb82a3bf6a540179033575f9887dae2 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.763569 29609 tablet_replica.cc:333] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.764241 29609 raft_consensus.cc:2243] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.764832 29609 raft_consensus.cc:2272] T 5fedaf4fb4f0418ababe85ed2553bf34 P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.767400 29609 tablet_replica.cc:333] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.767997 29609 raft_consensus.cc:2243] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.768666 29609 raft_consensus.cc:2272] T 877002e003da46fd833919b7b57ba1f4 P 52f6deb1e451449982a9496ac99ddb32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.771317 29609 tablet_replica.cc:333] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32: stopping tablet replica
I20260709 12:25:51.771917 29609 raft_consensus.cc:2243] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.772581 29609 raft_consensus.cc:2272] T 7bee45aae7544634add44b7dac5b942e P 52f6deb1e451449982a9496ac99ddb32 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:51.790289  5572 consensus_peers.cc:597] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:51.827602  5572 consensus_peers.cc:597] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:51.830783  5498 consensus_peers.cc:597] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.853268 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
W20260709 12:25:51.875131  5498 consensus_peers.cc:597] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.900694 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
W20260709 12:25:51.915695  5572 consensus_peers.cc:597] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:51.925064  5498 consensus_peers.cc:597] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:51.928999  5572 consensus_peers.cc:597] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:51.940559  5571 consensus_peers.cc:597] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Couldn't send request to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.951234 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:25:51.952105  5498 consensus_peers.cc:597] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf -> Peer 52f6deb1e451449982a9496ac99ddb32 (127.28.234.65:33881): Couldn't send request to peer 52f6deb1e451449982a9496ac99ddb32. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:33881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.952342 29609 tablet_replica.cc:333] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.953330 29609 raft_consensus.cc:2243] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.954597 29609 raft_consensus.cc:2272] T 46861d48f48c4a3ba3b52e898f95e658 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.957894 29609 tablet_replica.cc:333] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.958623 29609 raft_consensus.cc:2243] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.959540 29609 raft_consensus.cc:2272] T 99b8faadd63f4ee2b0193205325b0a3c P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.962008 29609 tablet_replica.cc:333] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.962714 29609 raft_consensus.cc:2243] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.963315 29609 raft_consensus.cc:2272] T 7bee45aae7544634add44b7dac5b942e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.965749 29609 tablet_replica.cc:333] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.966423 29609 raft_consensus.cc:2243] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.967022 29609 raft_consensus.cc:2272] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.969434 29609 tablet_replica.cc:333] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.970197 29609 raft_consensus.cc:2243] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.970741 29609 raft_consensus.cc:2272] T 4344ea6eea254938a1a7b05a83785172 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.974048 29609 tablet_replica.cc:333] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
W20260709 12:25:51.974814  5571 consensus_peers.cc:597] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Couldn't send request to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.974972 29609 raft_consensus.cc:2243] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.975621 29609 raft_consensus.cc:2272] T e2d216217c964b919ef4bd4a0ba34ba9 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.978065 29609 tablet_replica.cc:333] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.978735 29609 raft_consensus.cc:2243] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.979277 29609 raft_consensus.cc:2272] T b3b2791e70184f68a5854ad1533c8cdd P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.981830 29609 tablet_replica.cc:333] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.982450 29609 raft_consensus.cc:2243] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.983014 29609 raft_consensus.cc:2272] T b6d522795c924db8846dccf157c5f624 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.985603 29609 tablet_replica.cc:333] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.986351 29609 raft_consensus.cc:2243] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.986969 29609 raft_consensus.cc:2272] T 1a8d78ba65794b72ac29bc17f6287c8a P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.989665 29609 tablet_replica.cc:333] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.990355 29609 raft_consensus.cc:2243] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.991376 29609 raft_consensus.cc:2272] T bfb82a3bf6a540179033575f9887dae2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:51.993193  5571 consensus_peers.cc:597] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Couldn't send request to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:51.994100 29609 tablet_replica.cc:333] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.994814 29609 raft_consensus.cc:2243] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:51.995738 29609 raft_consensus.cc:2272] T 5af51674e04b4a1689b427de8e3245eb P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:51.998258 29609 tablet_replica.cc:333] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:51.998811 29609 raft_consensus.cc:2243] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:51.999298 29609 raft_consensus.cc:2272] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.001791 29609 tablet_replica.cc:333] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:52.002419 29609 raft_consensus.cc:2243] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.002929 29609 raft_consensus.cc:2272] T 7957372b6d5542a68131ad43f61517ed P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.005223 29609 tablet_replica.cc:333] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:52.005777 29609 raft_consensus.cc:2243] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.006851 29609 raft_consensus.cc:2272] T 5fedaf4fb4f0418ababe85ed2553bf34 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.009277 29609 tablet_replica.cc:333] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:52.009817 29609 raft_consensus.cc:2243] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.010687 29609 raft_consensus.cc:2272] T 877002e003da46fd833919b7b57ba1f4 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.012849 29609 tablet_replica.cc:333] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:52.013373 29609 raft_consensus.cc:2243] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.013998 29609 raft_consensus.cc:2272] T ac87e6e2662846f6bf75d974ba3a21b3 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.016220 29609 tablet_replica.cc:333] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:52.016788 29609 raft_consensus.cc:2243] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.017323 29609 raft_consensus.cc:2272] T b049956c58af4c579dad64d304c90dd0 P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.019729 29609 tablet_replica.cc:333] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf: stopping tablet replica
I20260709 12:25:52.020251 29609 raft_consensus.cc:2243] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.020727 29609 raft_consensus.cc:2272] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 3f0a9bfb3dba47d78d0d0576b4a4aacf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.066445 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
I20260709 12:25:52.132939 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
I20260709 12:25:52.172890 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:52.174427 29609 tablet_replica.cc:333] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.176622 29609 raft_consensus.cc:2243] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.178963 29609 raft_consensus.cc:2272] T 7bee45aae7544634add44b7dac5b942e P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.183408 29609 tablet_replica.cc:333] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.184700 29609 raft_consensus.cc:2243] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.185582 29609 raft_consensus.cc:2272] T 5af51674e04b4a1689b427de8e3245eb P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.188942 29609 tablet_replica.cc:333] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.189882 29609 raft_consensus.cc:2243] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.190732 29609 raft_consensus.cc:2272] T b6d522795c924db8846dccf157c5f624 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.193732 29609 tablet_replica.cc:333] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.194597 29609 raft_consensus.cc:2243] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.195719 29609 raft_consensus.cc:2272] T b3b2791e70184f68a5854ad1533c8cdd P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.199054 29609 tablet_replica.cc:333] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.199976 29609 raft_consensus.cc:2243] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.200987 29609 raft_consensus.cc:2272] T 99b8faadd63f4ee2b0193205325b0a3c P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.206847 29609 tablet_replica.cc:333] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.208385 29609 raft_consensus.cc:2243] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.209975 29609 raft_consensus.cc:2272] T 46861d48f48c4a3ba3b52e898f95e658 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.214844 29609 tablet_replica.cc:333] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.216370 29609 raft_consensus.cc:2243] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:25:52.216987  5571 consensus_peers.cc:597] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c -> Peer 3f0a9bfb3dba47d78d0d0576b4a4aacf (127.28.234.66:40507): Couldn't send request to peer 3f0a9bfb3dba47d78d0d0576b4a4aacf. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.66:40507: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.217514 29609 raft_consensus.cc:2272] T e2d216217c964b919ef4bd4a0ba34ba9 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.221897 29609 tablet_replica.cc:333] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.223006 29609 raft_consensus.cc:2243] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.224879 29609 raft_consensus.cc:2272] T 4344ea6eea254938a1a7b05a83785172 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.228327 29609 tablet_replica.cc:333] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.229097 29609 raft_consensus.cc:2243] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.231040 29609 raft_consensus.cc:2272] T ac87e6e2662846f6bf75d974ba3a21b3 P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.234660 29609 tablet_replica.cc:333] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.235423 29609 raft_consensus.cc:2243] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.236994 29609 raft_consensus.cc:2272] T b049956c58af4c579dad64d304c90dd0 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.240492 29609 tablet_replica.cc:333] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.241412 29609 raft_consensus.cc:2243] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.243029 29609 raft_consensus.cc:2272] T 17b9eb9d1e9a4e2ba998cfdcf3ac648e P 30d0815aa09840b3a5457d9de2b0e19c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.246210 29609 tablet_replica.cc:333] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.246913 29609 raft_consensus.cc:2243] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.247607 29609 raft_consensus.cc:2272] T 8d2a0ad0a57d49eda00600a43d2dbfe2 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.250697 29609 tablet_replica.cc:333] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.251458 29609 raft_consensus.cc:2243] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.252192 29609 raft_consensus.cc:2272] T 7957372b6d5542a68131ad43f61517ed P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.255293 29609 tablet_replica.cc:333] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.255964 29609 raft_consensus.cc:2243] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.256764 29609 raft_consensus.cc:2272] T 4e37d9b7d0d64673b48e95a6a78f1a19 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.259601 29609 tablet_replica.cc:333] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.260239 29609 raft_consensus.cc:2243] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.260923 29609 raft_consensus.cc:2272] T 877002e003da46fd833919b7b57ba1f4 P 30d0815aa09840b3a5457d9de2b0e19c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.264073 29609 tablet_replica.cc:333] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.264739 29609 raft_consensus.cc:2243] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.265483 29609 raft_consensus.cc:2272] T 5fedaf4fb4f0418ababe85ed2553bf34 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.269909 29609 tablet_replica.cc:333] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.270848 29609 raft_consensus.cc:2243] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.272596 29609 raft_consensus.cc:2272] T 1a8d78ba65794b72ac29bc17f6287c8a P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.275640 29609 tablet_replica.cc:333] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c: stopping tablet replica
I20260709 12:25:52.276186 29609 raft_consensus.cc:2243] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.277145 29609 raft_consensus.cc:2272] T bfb82a3bf6a540179033575f9887dae2 P 30d0815aa09840b3a5457d9de2b0e19c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.323673 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
I20260709 12:25:52.385375 29609 master.cc:562] Master@127.28.234.126:40709 shutting down...
I20260709 12:25:52.415356 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.416091 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.416471 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P 92afaf84023c499a9805d666fba8aac7: stopping tablet replica
I20260709 12:25:52.440809 29609 master.cc:584] Master@127.28.234.126:40709 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21877 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:25:52.511307 29609 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.234.126:42355
I20260709 12:25:52.512571 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:52.518708  5960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.519528  5961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.521204  5963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.522887 29609 server_base.cc:1061] running on GCE node
I20260709 12:25:52.524113 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:52.524318 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:52.524467 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599952524444 us; error 0 us; skew 500 ppm
I20260709 12:25:52.525022 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:52.527837 29609 webserver.cc:533] Webserver started at http://127.28.234.126:37167/ using document root <none> and password file <none>
I20260709 12:25:52.528386 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:52.528566 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:52.528810 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:52.530310 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/master-0-root/instance:
uuid: "21df7d9b29b046728c18ed2332e0b54d"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.535615 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:25:52.539529  5968 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.540501 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:25:52.540855 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/master-0-root
uuid: "21df7d9b29b046728c18ed2332e0b54d"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.541280 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:52.551813 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:52.553272 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:52.599013 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.126:42355
I20260709 12:25:52.599150  6019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.126:42355 every 8 connection(s)
I20260709 12:25:52.603793  6020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.618991  6020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d: Bootstrap starting.
I20260709 12:25:52.624727  6020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.629894  6020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d: No bootstrap required, opened a new log
I20260709 12:25:52.632663  6020 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21df7d9b29b046728c18ed2332e0b54d" member_type: VOTER }
I20260709 12:25:52.633186  6020 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.633500  6020 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21df7d9b29b046728c18ed2332e0b54d, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.634279  6020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21df7d9b29b046728c18ed2332e0b54d" member_type: VOTER }
I20260709 12:25:52.634853  6020 raft_consensus.cc:399] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:52.635103  6020 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:52.635459  6020 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.641374  6020 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21df7d9b29b046728c18ed2332e0b54d" member_type: VOTER }
I20260709 12:25:52.642052  6020 leader_election.cc:304] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21df7d9b29b046728c18ed2332e0b54d; no voters: 
I20260709 12:25:52.643462  6020 leader_election.cc:290] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:52.643888  6023 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.645488  6023 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 1 LEADER]: Becoming Leader. State: Replica: 21df7d9b29b046728c18ed2332e0b54d, State: Running, Role: LEADER
I20260709 12:25:52.646337  6023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21df7d9b29b046728c18ed2332e0b54d" member_type: VOTER }
I20260709 12:25:52.647169  6020 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:52.653189  6024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21df7d9b29b046728c18ed2332e0b54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21df7d9b29b046728c18ed2332e0b54d" member_type: VOTER } }
I20260709 12:25:52.653299  6025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21df7d9b29b046728c18ed2332e0b54d. Latest consensus state: current_term: 1 leader_uuid: "21df7d9b29b046728c18ed2332e0b54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21df7d9b29b046728c18ed2332e0b54d" member_type: VOTER } }
I20260709 12:25:52.654136  6024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:52.654196  6025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:52.660382  6032 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:52.665562  6032 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:52.666971 29609 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:52.675519  6032 catalog_manager.cc:1383] Generated new cluster ID: dfcf32d178ad44448d045c7de161a473
I20260709 12:25:52.675866  6032 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:52.694339  6032 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:52.696133  6032 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:52.719220  6032 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d: Generated new TSK 0
I20260709 12:25:52.719921  6032 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:52.734766 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:52.742053  6041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.743417  6042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.746224 29609 server_base.cc:1061] running on GCE node
W20260709 12:25:52.746224  6044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.747709 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:52.747920 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:52.748121 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599952748105 us; error 0 us; skew 500 ppm
I20260709 12:25:52.748661 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:52.751421 29609 webserver.cc:533] Webserver started at http://127.28.234.65:35935/ using document root <none> and password file <none>
I20260709 12:25:52.752003 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:52.752229 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:52.752548 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:52.753986 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-0-root/instance:
uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.761835 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:52.766059  6049 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.766995 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:25:52.767364 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-0-root
uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.767714 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:52.782299 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:52.783813 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:52.785502 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:52.788234 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:52.788511 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.788802 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:52.789026 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.839466 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.65:43749
I20260709 12:25:52.839632  6112 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.65:43749 every 8 connection(s)
I20260709 12:25:52.845049 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:52.853132  6117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.854099  6118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.859169 29609 server_base.cc:1061] running on GCE node
W20260709 12:25:52.859192  6120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.861253  6113 heartbeater.cc:344] Connected to a master server at 127.28.234.126:42355
I20260709 12:25:52.861366 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:52.862062 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:52.862105  6113 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:52.862406 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599952862381 us; error 0 us; skew 500 ppm
I20260709 12:25:52.863353 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:52.863312  6113 heartbeater.cc:507] Master 127.28.234.126:42355 requested a full tablet report, sending...
I20260709 12:25:52.866456  5985 ts_manager.cc:194] Registered new tserver with Master: 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749)
I20260709 12:25:52.867146 29609 webserver.cc:533] Webserver started at http://127.28.234.66:42555/ using document root <none> and password file <none>
I20260709 12:25:52.867964 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:52.868260 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:52.868623 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:52.869407  5985 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55830
I20260709 12:25:52.870561 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-1-root/instance:
uuid: "42b2e7f4797844a2a6d969b44e7513f4"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.876483 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:52.880383  6125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.881362 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:25:52.881719 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-1-root
uuid: "42b2e7f4797844a2a6d969b44e7513f4"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.882203 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:52.895982 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:52.897610 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:52.899641 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:52.902396 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:52.902659 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.902912 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:52.903095 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.949117 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.66:35993
I20260709 12:25:52.949232  6187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.66:35993 every 8 connection(s)
I20260709 12:25:52.954943 29609 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:52.963025  6191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.963363  6192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.967270 29609 server_base.cc:1061] running on GCE node
W20260709 12:25:52.967604  6194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.968379  6188 heartbeater.cc:344] Connected to a master server at 127.28.234.126:42355
I20260709 12:25:52.968878  6188 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:52.968896 29609 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:52.969336 29609 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:52.969637 29609 hybrid_clock.cc:648] HybridClock initialized: now 1783599952969610 us; error 0 us; skew 500 ppm
I20260709 12:25:52.970083  6188 heartbeater.cc:507] Master 127.28.234.126:42355 requested a full tablet report, sending...
I20260709 12:25:52.970400 29609 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:52.972852  5985 ts_manager.cc:194] Registered new tserver with Master: 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:52.973804 29609 webserver.cc:533] Webserver started at http://127.28.234.67:42363/ using document root <none> and password file <none>
I20260709 12:25:52.974557 29609 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:52.974797 29609 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:52.975132 29609 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:52.975035  5985 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55838
I20260709 12:25:52.977056 29609 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-2-root/instance:
uuid: "fca9d7f013534f2db61763ee726db44f"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.982425 29609 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:25:52.986720  6199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.987639 29609 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:25:52.988094 29609 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-2-root
uuid: "fca9d7f013534f2db61763ee726db44f"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-8c39"
I20260709 12:25:52.988453 29609 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskv9yD4x/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599634586481-29609-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:53.003165 29609 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:53.004536 29609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:53.006192 29609 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:53.008613 29609 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:53.008882 29609 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.009150 29609 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:53.009335 29609 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.056547 29609 rpc_server.cc:307] RPC server started. Bound to: 127.28.234.67:37123
I20260709 12:25:53.056699  6262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.234.67:37123 every 8 connection(s)
I20260709 12:25:53.072757  6263 heartbeater.cc:344] Connected to a master server at 127.28.234.126:42355
I20260709 12:25:53.073308  6263 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:53.074251  6263 heartbeater.cc:507] Master 127.28.234.126:42355 requested a full tablet report, sending...
I20260709 12:25:53.076761  5985 ts_manager.cc:194] Registered new tserver with Master: fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:53.076948 29609 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016844094s
I20260709 12:25:53.078768  5985 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55840
I20260709 12:25:53.105305  5985 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55842:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:53.108258  5985 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:53.189342  6228 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff27e98dae54731b930fd6f1607ef90 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:53.190977  6226 tablet_service.cc:1511] Processing CreateTablet for tablet a5a350ea66eb43d7a0057e1dc92d6a73 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:53.191097  6228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff27e98dae54731b930fd6f1607ef90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.194250  6227 tablet_service.cc:1511] Processing CreateTablet for tablet 3720c332e3894c81aa9ed54af81dfb74 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:53.192503  6225 tablet_service.cc:1511] Processing CreateTablet for tablet c04a8d4a054d4d6a9e1dd4d5570f7158 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:53.195775  6223 tablet_service.cc:1511] Processing CreateTablet for tablet 1911e26a3c7f4f4db6985a3d90de5fc7 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:53.194325  6224 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba407d35514d178c5d3ad4fa4f0554 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:53.195911  6227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3720c332e3894c81aa9ed54af81dfb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.198390  6224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba407d35514d178c5d3ad4fa4f0554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.199122  6223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1911e26a3c7f4f4db6985a3d90de5fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.199848  6226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a350ea66eb43d7a0057e1dc92d6a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.199523  6222 tablet_service.cc:1511] Processing CreateTablet for tablet 2a57f74e26124120a1e043a9fe38df65 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:53.200631  6225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04a8d4a054d4d6a9e1dd4d5570f7158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.201299  6222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a57f74e26124120a1e043a9fe38df65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.204346  6221 tablet_service.cc:1511] Processing CreateTablet for tablet 17d69c11c5bd408e9becdce0b106eeeb (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:53.206593  6221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d69c11c5bd408e9becdce0b106eeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.215530  6220 tablet_service.cc:1511] Processing CreateTablet for tablet 24c965fa00b541deb716a40664f99018 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:53.217259  6220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c965fa00b541deb716a40664f99018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.233661  6278 tablet_bootstrap.cc:492] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.240980  6278 tablet_bootstrap.cc:654] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.264954  6278 tablet_bootstrap.cc:492] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.265748  6278 ts_tablet_manager.cc:1403] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.009s
I20260709 12:25:53.267251  6153 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff27e98dae54731b930fd6f1607ef90 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:53.268801  6153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff27e98dae54731b930fd6f1607ef90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.269119  6278 raft_consensus.cc:359] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.269989  6278 raft_consensus.cc:385] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.270284  6278 raft_consensus.cc:740] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.271260  6278 consensus_queue.cc:260] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.273569  6263 heartbeater.cc:499] Master 127.28.234.126:42355 was elected leader, sending a full tablet report...
I20260709 12:25:53.274220  6278 ts_tablet_manager.cc:1434] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:53.275481  6278 tablet_bootstrap.cc:492] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.282615  6278 tablet_bootstrap.cc:654] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.284173  6152 tablet_service.cc:1511] Processing CreateTablet for tablet 3720c332e3894c81aa9ed54af81dfb74 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:53.285853  6152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3720c332e3894c81aa9ed54af81dfb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.299402  6278 tablet_bootstrap.cc:492] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.300146  6278 ts_tablet_manager.cc:1403] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 12:25:53.301283  6151 tablet_service.cc:1511] Processing CreateTablet for tablet a5a350ea66eb43d7a0057e1dc92d6a73 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:53.302366  6149 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba407d35514d178c5d3ad4fa4f0554 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:53.302958  6151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a350ea66eb43d7a0057e1dc92d6a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.303517  6278 raft_consensus.cc:359] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.304365  6278 raft_consensus.cc:385] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.304702  6278 raft_consensus.cc:740] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.304628  6145 tablet_service.cc:1511] Processing CreateTablet for tablet 24c965fa00b541deb716a40664f99018 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:53.305399  6077 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff27e98dae54731b930fd6f1607ef90 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:53.305995  6076 tablet_service.cc:1511] Processing CreateTablet for tablet 3720c332e3894c81aa9ed54af81dfb74 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:53.305886  6278 consensus_queue.cc:260] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.307061  6077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff27e98dae54731b930fd6f1607ef90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.307835  6076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3720c332e3894c81aa9ed54af81dfb74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.308744  6278 ts_tablet_manager.cc:1434] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:25:53.311013  6146 tablet_service.cc:1511] Processing CreateTablet for tablet 17d69c11c5bd408e9becdce0b106eeeb (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
W20260709 12:25:53.311045  6264 tablet.cc:2406] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:53.316349  6149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba407d35514d178c5d3ad4fa4f0554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.317644  6147 tablet_service.cc:1511] Processing CreateTablet for tablet 2a57f74e26124120a1e043a9fe38df65 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:53.320441  6075 tablet_service.cc:1511] Processing CreateTablet for tablet a5a350ea66eb43d7a0057e1dc92d6a73 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:53.321172  6074 tablet_service.cc:1511] Processing CreateTablet for tablet c04a8d4a054d4d6a9e1dd4d5570f7158 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:53.321836  6147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a57f74e26124120a1e043a9fe38df65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.322481  6075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5a350ea66eb43d7a0057e1dc92d6a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.323194  6074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04a8d4a054d4d6a9e1dd4d5570f7158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.308334  6148 tablet_service.cc:1511] Processing CreateTablet for tablet 1911e26a3c7f4f4db6985a3d90de5fc7 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:53.326871  6148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1911e26a3c7f4f4db6985a3d90de5fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.330334  6145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c965fa00b541deb716a40664f99018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.332099  6073 tablet_service.cc:1511] Processing CreateTablet for tablet 4dba407d35514d178c5d3ad4fa4f0554 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:53.334203  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dba407d35514d178c5d3ad4fa4f0554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.334373  6146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d69c11c5bd408e9becdce0b106eeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.337188  6280 raft_consensus.cc:493] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.337983  6280 raft_consensus.cc:515] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.343917  6072 tablet_service.cc:1511] Processing CreateTablet for tablet 1911e26a3c7f4f4db6985a3d90de5fc7 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:53.345609  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1911e26a3c7f4f4db6985a3d90de5fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.356455  6071 tablet_service.cc:1511] Processing CreateTablet for tablet 2a57f74e26124120a1e043a9fe38df65 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:53.307070  6150 tablet_service.cc:1511] Processing CreateTablet for tablet c04a8d4a054d4d6a9e1dd4d5570f7158 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:53.363081  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a57f74e26124120a1e043a9fe38df65. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:53.363763  6200 leader_election.cc:343] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Not found: Tablet not found: c04a8d4a054d4d6a9e1dd4d5570f7158
I20260709 12:25:53.364193  6150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c04a8d4a054d4d6a9e1dd4d5570f7158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.318507  6278 tablet_bootstrap.cc:492] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.372833  6280 leader_election.cc:290] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.381623  6283 tablet_bootstrap.cc:492] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.388191  6077 tablet_service.cc:1511] Processing CreateTablet for tablet 17d69c11c5bd408e9becdce0b106eeeb (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:53.388782  6070 tablet_service.cc:1511] Processing CreateTablet for tablet 24c965fa00b541deb716a40664f99018 (DEFAULT_TABLE table=test-workload [id=c6c0b599a08140fca0582a88e93021dd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:53.390797  6077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d69c11c5bd408e9becdce0b106eeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.391625  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c965fa00b541deb716a40664f99018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.393375  6283 tablet_bootstrap.cc:654] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.405714  6283 tablet_bootstrap.cc:492] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.406334  6283 ts_tablet_manager.cc:1403] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 12:25:53.409600  6283 raft_consensus.cc:359] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:53.410467  6283 raft_consensus.cc:385] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.410800  6283 raft_consensus.cc:740] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.411980  6283 consensus_queue.cc:260] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
W20260709 12:25:53.414954  6200 leader_election.cc:343] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Not found: Tablet not found: c04a8d4a054d4d6a9e1dd4d5570f7158
I20260709 12:25:53.415623  6200 leader_election.cc:304] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:53.417027  6280 raft_consensus.cc:2749] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.421607  6113 heartbeater.cc:499] Master 127.28.234.126:42355 was elected leader, sending a full tablet report...
I20260709 12:25:53.422052  6283 ts_tablet_manager.cc:1434] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.014s
I20260709 12:25:53.423280  6283 tablet_bootstrap.cc:492] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.430610  6283 tablet_bootstrap.cc:654] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.435585  6282 tablet_bootstrap.cc:492] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:53.443156  6283 tablet_bootstrap.cc:492] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.443878  6283 ts_tablet_manager.cc:1403] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
I20260709 12:25:53.447364  6283 raft_consensus.cc:359] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.448128  6283 raft_consensus.cc:385] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.448524  6283 raft_consensus.cc:740] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.449563  6283 consensus_queue.cc:260] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.454536  6283 ts_tablet_manager.cc:1434] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 12:25:53.458184  6278 tablet_bootstrap.cc:654] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.465219  6283 tablet_bootstrap.cc:492] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.479727  6283 tablet_bootstrap.cc:654] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.481242  6285 raft_consensus.cc:493] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.482631  6285 raft_consensus.cc:515] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:53.481966  6278 tablet_bootstrap.cc:492] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.487766  6282 tablet_bootstrap.cc:654] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.512441  6278 ts_tablet_manager.cc:1403] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.194s	user 0.015s	sys 0.006s
I20260709 12:25:53.487068  6285 leader_election.cc:290] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.518918  6283 tablet_bootstrap.cc:492] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.519552  6283 ts_tablet_manager.cc:1403] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.055s	user 0.027s	sys 0.010s
I20260709 12:25:53.522697  6278 raft_consensus.cc:359] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.524928  6278 raft_consensus.cc:385] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.525291  6278 raft_consensus.cc:740] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.526410  6278 consensus_queue.cc:260] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.528861  6278 ts_tablet_manager.cc:1434] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:25:53.530136  6278 tablet_bootstrap.cc:492] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.532208  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:53.523732  6283 raft_consensus.cc:359] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.534111  6283 raft_consensus.cc:385] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.534530  6283 raft_consensus.cc:740] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
W20260709 12:25:53.535634  6050 leader_election.cc:343] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.535583  6283 consensus_queue.cc:260] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.537881  6278 tablet_bootstrap.cc:654] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.538231  6283 ts_tablet_manager.cc:1434] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260709 12:25:53.539423  6283 tablet_bootstrap.cc:492] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.543483  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
W20260709 12:25:53.545621  6053 leader_election.cc:343] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.546200  6053 leader_election.cc:304] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:53.547588  6285 raft_consensus.cc:2749] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.550359  6283 tablet_bootstrap.cc:654] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.551802  6278 tablet_bootstrap.cc:492] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.552525  6278 ts_tablet_manager.cc:1403] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 12:25:53.556480  6278 raft_consensus.cc:359] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.557564  6278 raft_consensus.cc:385] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.558012  6278 raft_consensus.cc:740] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.559823  6282 tablet_bootstrap.cc:492] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:53.559398  6278 consensus_queue.cc:260] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.560544  6282 ts_tablet_manager.cc:1403] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.014s
I20260709 12:25:53.563695  6278 ts_tablet_manager.cc:1434] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:53.564543  6280 raft_consensus.cc:493] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.564463  6282 raft_consensus.cc:359] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:53.565459  6282 raft_consensus.cc:385] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.565388  6280 raft_consensus.cc:515] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.565994  6282 raft_consensus.cc:740] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.567093  6282 consensus_queue.cc:260] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:53.569278  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:53.570092  6087 raft_consensus.cc:2468] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 0.
I20260709 12:25:53.571650  6188 heartbeater.cc:499] Master 127.28.234.126:42355 was elected leader, sending a full tablet report...
I20260709 12:25:53.572247  6282 ts_tablet_manager.cc:1434] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.002s
I20260709 12:25:53.572093  6200 leader_election.cc:304] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:53.573629  6282 tablet_bootstrap.cc:492] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:53.571722  6283 tablet_bootstrap.cc:492] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.578058  6283 ts_tablet_manager.cc:1403] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.014s
I20260709 12:25:53.581480  6282 tablet_bootstrap.cc:654] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.582168  6280 leader_election.cc:290] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.583032  6280 raft_consensus.cc:493] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.583698  6280 raft_consensus.cc:515] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.582221  6283 raft_consensus.cc:359] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.588174  6283 raft_consensus.cc:385] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.588495  6283 raft_consensus.cc:740] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.591439  6283 consensus_queue.cc:260] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.593254  6278 tablet_bootstrap.cc:492] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.595752  6283 ts_tablet_manager.cc:1434] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:25:53.621658  6283 tablet_bootstrap.cc:492] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.631588  6283 tablet_bootstrap.cc:654] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.635002  6280 leader_election.cc:290] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.636059  6280 raft_consensus.cc:2804] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.636590  6280 raft_consensus.cc:493] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.637130  6280 raft_consensus.cc:3060] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:53.646327  6200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.234.65:43749, user_credentials={real_user=slave}} blocked reactor thread for 74337us
I20260709 12:25:53.648504  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:53.649863  6282 tablet_bootstrap.cc:492] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:53.650527  6282 ts_tablet_manager.cc:1403] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.077s	user 0.024s	sys 0.039s
I20260709 12:25:53.651780  6278 tablet_bootstrap.cc:654] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.654611  6282 raft_consensus.cc:359] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.655591  6282 raft_consensus.cc:385] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.656025  6282 raft_consensus.cc:740] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.656992  6282 consensus_queue.cc:260] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.658002  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
W20260709 12:25:53.658828  6033 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:53.659684  6282 ts_tablet_manager.cc:1434] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:53.661727  6282 tablet_bootstrap.cc:492] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:53.662448  6283 tablet_bootstrap.cc:492] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.663148  6283 ts_tablet_manager.cc:1403] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.002s
I20260709 12:25:53.667548  6283 raft_consensus.cc:359] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.668598  6283 raft_consensus.cc:385] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.669094  6283 raft_consensus.cc:740] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.670991  6282 tablet_bootstrap.cc:654] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.671131  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
W20260709 12:25:53.672106  6200 leader_election.cc:343] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:53.674173  6200 leader_election.cc:343] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:53.675256  6200 leader_election.cc:343] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.675911  6200 leader_election.cc:304] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:53.677457  6296 raft_consensus.cc:2749] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:53.677379  6283 consensus_queue.cc:260] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.678184  6280 raft_consensus.cc:515] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.681471  6283 ts_tablet_manager.cc:1434] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:25:53.682968  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:53.681003  6280 leader_election.cc:290] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.683914  6087 raft_consensus.cc:3060] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.686687  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:53.687860  6278 tablet_bootstrap.cc:492] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.687922  6282 tablet_bootstrap.cc:492] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
W20260709 12:25:53.688431  6200 leader_election.cc:343] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.688637  6278 ts_tablet_manager.cc:1403] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.009s
I20260709 12:25:53.688701  6282 ts_tablet_manager.cc:1403] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260709 12:25:53.692600  6278 raft_consensus.cc:359] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.693310  6278 raft_consensus.cc:385] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.692956  6282 raft_consensus.cc:359] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.693663  6278 raft_consensus.cc:740] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.693889  6282 raft_consensus.cc:385] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.694303  6282 raft_consensus.cc:740] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.694671  6278 consensus_queue.cc:260] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.695371  6282 consensus_queue.cc:260] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.697295  6278 ts_tablet_manager.cc:1434] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:53.698021  6282 ts_tablet_manager.cc:1434] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:25:53.698625  6283 tablet_bootstrap.cc:492] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.698756  6278 tablet_bootstrap.cc:492] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.699172  6282 tablet_bootstrap.cc:492] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:53.697178  6087 raft_consensus.cc:2468] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 1.
I20260709 12:25:53.706423  6283 tablet_bootstrap.cc:654] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.707427  6200 leader_election.cc:304] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:53.708070  6282 tablet_bootstrap.cc:654] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.708371  6280 raft_consensus.cc:2804] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.709017  6280 raft_consensus.cc:697] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:53.710071  6280 consensus_queue.cc:237] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.708117  6278 tablet_bootstrap.cc:654] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.734596  5985 catalog_manager.cc:5697] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 0 to 1, leader changed from <none> to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 1 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.740971  6282 tablet_bootstrap.cc:492] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:53.741698  6282 ts_tablet_manager.cc:1403] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.006s
I20260709 12:25:53.742367  6283 tablet_bootstrap.cc:492] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.742815  6278 tablet_bootstrap.cc:492] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.743202  6283 ts_tablet_manager.cc:1403] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.045s	user 0.034s	sys 0.008s
I20260709 12:25:53.743592  6278 ts_tablet_manager.cc:1403] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.010s
I20260709 12:25:53.745543  6282 raft_consensus.cc:359] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.746505  6282 raft_consensus.cc:385] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.746866  6282 raft_consensus.cc:740] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.747004  6283 raft_consensus.cc:359] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.747934  6283 raft_consensus.cc:385] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.747989  6282 consensus_queue.cc:260] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.748144  6278 raft_consensus.cc:359] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.749454  6278 raft_consensus.cc:385] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.749985  6278 raft_consensus.cc:740] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.750455  6283 raft_consensus.cc:740] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.751276  6278 consensus_queue.cc:260] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.751600  6283 consensus_queue.cc:260] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.754536  6282 ts_tablet_manager.cc:1434] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:25:53.755354  6280 raft_consensus.cc:493] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.754536  6283 ts_tablet_manager.cc:1434] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:25:53.756248  6282 tablet_bootstrap.cc:492] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:53.756027  6280 raft_consensus.cc:515] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.756907  6283 tablet_bootstrap.cc:492] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.758821  6280 leader_election.cc:290] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.759661  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:53.760169  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:53.761484  6163 raft_consensus.cc:2468] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 0.
I20260709 12:25:53.754642  6278 ts_tablet_manager.cc:1434] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:25:53.760658  6296 raft_consensus.cc:493] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:53.762146  6200 leader_election.cc:343] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.763203  6278 tablet_bootstrap.cc:492] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.763126  6296 raft_consensus.cc:515] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.763554  6200 leader_election.cc:304] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:53.765578  6280 raft_consensus.cc:2804] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.765861  6296 leader_election.cc:290] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.766064  6280 raft_consensus.cc:493] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.766498  6280 raft_consensus.cc:3060] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.771304  6283 tablet_bootstrap.cc:654] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.773093  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:53.774070  6294 raft_consensus.cc:493] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.774717  6294 raft_consensus.cc:515] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.775617  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:53.776516  6163 raft_consensus.cc:2468] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 0.
I20260709 12:25:53.779316  6294 leader_election.cc:290] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:53.780857  6282 tablet_bootstrap.cc:654] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.785008  6278 tablet_bootstrap.cc:654] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.787220  6200 leader_election.cc:304] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
W20260709 12:25:53.788548  6200 leader_election.cc:343] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.801090  6296 raft_consensus.cc:2804] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.802114  6296 raft_consensus.cc:493] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.802791  6296 raft_consensus.cc:3060] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.807629  6280 raft_consensus.cc:515] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.811120  6296 raft_consensus.cc:515] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.814229  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
W20260709 12:25:53.815932  6200 leader_election.cc:343] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.823230  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
W20260709 12:25:53.824837  6200 leader_election.cc:343] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.827234  6282 tablet_bootstrap.cc:492] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:53.827982  6282 ts_tablet_manager.cc:1403] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.072s	user 0.013s	sys 0.005s
I20260709 12:25:53.829713  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
W20260709 12:25:53.831552  6129 leader_election.cc:343] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.833977  6280 leader_election.cc:290] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.833864  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:53.835983  6087 raft_consensus.cc:2468] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 0.
I20260709 12:25:53.836298  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:53.836892  6162 raft_consensus.cc:3060] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.836934  6282 raft_consensus.cc:359] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.837854  6282 raft_consensus.cc:385] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.837494  6126 leader_election.cc:304] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: fca9d7f013534f2db61763ee726db44f
I20260709 12:25:53.833830  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:53.838786  6163 raft_consensus.cc:3060] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.839246  6294 raft_consensus.cc:2804] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.839704  6294 raft_consensus.cc:493] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.840065  6294 raft_consensus.cc:3060] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.841450  6283 tablet_bootstrap.cc:492] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.842182  6283 ts_tablet_manager.cc:1403] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.041s
I20260709 12:25:53.832262  6296 leader_election.cc:290] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:53.845502  6283 raft_consensus.cc:359] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.846105  6285 raft_consensus.cc:493] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.846349  6283 raft_consensus.cc:385] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.846565  6162 raft_consensus.cc:2468] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 1.
I20260709 12:25:53.838182  6282 raft_consensus.cc:740] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.846741  6285 raft_consensus.cc:515] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.848093  6200 leader_election.cc:304] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:53.849062  6296 raft_consensus.cc:2804] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.849882  6296 raft_consensus.cc:697] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:53.849438  6285 leader_election.cc:290] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:53.850169  6294 raft_consensus.cc:515] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.851238  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:53.851016  6296 consensus_queue.cc:237] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.851851  6238 raft_consensus.cc:2468] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:53.852353  6294 leader_election.cc:290] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:53.846873  6283 raft_consensus.cc:740] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.853225  6053 leader_election.cc:304] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:53.853703  6283 consensus_queue.cc:260] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.854404  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:53.855100  6087 raft_consensus.cc:3060] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.857138  6278 tablet_bootstrap.cc:492] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.857834  6278 ts_tablet_manager.cc:1403] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.008s
I20260709 12:25:53.858454  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
W20260709 12:25:53.860070  6129 leader_election.cc:343] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.860915  6278 raft_consensus.cc:359] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:53.861641  6278 raft_consensus.cc:385] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.862373  6278 raft_consensus.cc:740] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.863489  6278 consensus_queue.cc:260] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:53.865952  6278 ts_tablet_manager.cc:1434] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:53.865960  6285 raft_consensus.cc:2804] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.867872  6285 raft_consensus.cc:493] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.868249  6285 raft_consensus.cc:3060] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.868783  6278 tablet_bootstrap.cc:492] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.873878  6282 consensus_queue.cc:260] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.866819  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:53.867270  6163 raft_consensus.cc:2468] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 1.
I20260709 12:25:53.876137  6200 leader_election.cc:304] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:53.877409  6280 raft_consensus.cc:2804] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:53.877830  6050 leader_election.cc:343] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.877966  6280 raft_consensus.cc:697] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:53.878692  6087 raft_consensus.cc:2468] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:53.879374  6280 consensus_queue.cc:237] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.880000  6126 leader_election.cc:304] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: fca9d7f013534f2db61763ee726db44f
I20260709 12:25:53.882055  6282 ts_tablet_manager.cc:1434] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.002s
I20260709 12:25:53.882850  6294 raft_consensus.cc:2804] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.883447  6282 tablet_bootstrap.cc:492] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:53.886161  6294 raft_consensus.cc:697] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:53.891396  6294 consensus_queue.cc:237] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.893121  6282 tablet_bootstrap.cc:654] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.889137  6278 tablet_bootstrap.cc:654] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.896862  6283 ts_tablet_manager.cc:1434] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.032s
I20260709 12:25:53.885280  6285 raft_consensus.cc:515] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.898201  6283 tablet_bootstrap.cc:492] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.900013  6285 leader_election.cc:290] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:53.901250  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:53.901244  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:53.902136  6238 raft_consensus.cc:3060] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:53.903901  6050 leader_election.cc:343] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:53.908275  6283 tablet_bootstrap.cc:654] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.911639  6238 raft_consensus.cc:2468] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:53.913226  6053 leader_election.cc:304] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:53.914328  6285 raft_consensus.cc:2804] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:53.915064  6285 raft_consensus.cc:697] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:53.916752  6278 tablet_bootstrap.cc:492] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.916253  6285 consensus_queue.cc:237] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.917403  6278 ts_tablet_manager.cc:1403] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 12:25:53.921200  6278 raft_consensus.cc:359] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.922014  6278 raft_consensus.cc:385] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.922290  6278 raft_consensus.cc:740] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.922547  5982 catalog_manager.cc:5697] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 0 to 1, leader changed from <none> to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 1 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.928320  6282 tablet_bootstrap.cc:492] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:53.928982  6282 ts_tablet_manager.cc:1403] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.005s
I20260709 12:25:53.932417  6282 raft_consensus.cc:359] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.933192  6282 raft_consensus.cc:385] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.933485  6282 raft_consensus.cc:740] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.934279  6282 consensus_queue.cc:260] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.923127  6278 consensus_queue.cc:260] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.936802  6278 ts_tablet_manager.cc:1434] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:25:53.937952  6278 tablet_bootstrap.cc:492] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:53.944433  6278 tablet_bootstrap.cc:654] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.945037  6283 tablet_bootstrap.cc:492] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:53.946699  6283 ts_tablet_manager.cc:1403] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.024s
I20260709 12:25:53.936802  6282 ts_tablet_manager.cc:1434] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:25:53.948755  6282 tablet_bootstrap.cc:492] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:53.949829  6283 raft_consensus.cc:359] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.950709  6283 raft_consensus.cc:385] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.951078  6283 raft_consensus.cc:740] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.952014  6283 consensus_queue.cc:260] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.952302  5985 catalog_manager.cc:5697] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.954454  6283 ts_tablet_manager.cc:1434] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:53.953944  5984 catalog_manager.cc:5697] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 0 to 1, leader changed from <none> to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 1 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.955682  6283 tablet_bootstrap.cc:492] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:53.956267  6282 tablet_bootstrap.cc:654] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.962831  6278 tablet_bootstrap.cc:492] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:53.963364  6278 ts_tablet_manager.cc:1403] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:25:53.964556  6283 tablet_bootstrap.cc:654] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.966355  6278 raft_consensus.cc:359] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.967170  6278 raft_consensus.cc:385] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.967443  6278 raft_consensus.cc:740] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.968210  6278 consensus_queue.cc:260] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.968673  6282 tablet_bootstrap.cc:492] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:53.969322  6285 raft_consensus.cc:493] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.970296  6285 raft_consensus.cc:515] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.971130  6278 ts_tablet_manager.cc:1434] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:53.974822  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c965fa00b541deb716a40664f99018" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:53.975881  6163 raft_consensus.cc:2468] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:53.975420  5983 catalog_manager.cc:5697] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.977511  6050 leader_election.cc:304] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:53.978615  6313 raft_consensus.cc:2804] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:53.979038  6313 raft_consensus.cc:493] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.979378  6313 raft_consensus.cc:3060] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:53.979319  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c965fa00b541deb716a40664f99018" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:53.980527  6238 raft_consensus.cc:2468] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:53.982718  6285 leader_election.cc:290] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:53.969389  6282 ts_tablet_manager.cc:1403] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:25:53.988863  6282 raft_consensus.cc:359] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.990811  6282 raft_consensus.cc:385] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.991321  6282 raft_consensus.cc:740] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.992678  6282 consensus_queue.cc:260] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:53.996981  6282 ts_tablet_manager.cc:1434] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 12:25:53.998730  6282 tablet_bootstrap.cc:492] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:54.003857  6283 tablet_bootstrap.cc:492] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:54.004511  6283 ts_tablet_manager.cc:1403] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.049s	user 0.032s	sys 0.011s
I20260709 12:25:54.006516  6282 tablet_bootstrap.cc:654] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.007684  6283 raft_consensus.cc:359] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.008519  6283 raft_consensus.cc:385] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.008772  6283 raft_consensus.cc:740] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.009883  6313 raft_consensus.cc:515] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.009788  6283 consensus_queue.cc:260] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.013239  6283 ts_tablet_manager.cc:1434] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:54.013631  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c965fa00b541deb716a40664f99018" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:54.014478  6163 raft_consensus.cc:3060] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.017683  6282 tablet_bootstrap.cc:492] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:54.018376  6282 ts_tablet_manager.cc:1403] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 12:25:54.019858  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c965fa00b541deb716a40664f99018" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.020474  6238 raft_consensus.cc:3060] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.024175  6282 raft_consensus.cc:359] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.025091  6282 raft_consensus.cc:385] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.025434  6282 raft_consensus.cc:740] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.026260  6282 consensus_queue.cc:260] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.028391  6282 ts_tablet_manager.cc:1434] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:54.028700  6238 raft_consensus.cc:2468] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:54.029592  6282 tablet_bootstrap.cc:492] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:54.030216  6053 leader_election.cc:304] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.031206  6285 raft_consensus.cc:2804] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.042584  6282 tablet_bootstrap.cc:654] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.043341  6313 leader_election.cc:290] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.044525  6313 raft_consensus.cc:493] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.045063  6313 raft_consensus.cc:515] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.049937  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:54.051206  6162 raft_consensus.cc:2393] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88393fc7d68a4a65bf024ffb5afdf44f in current term 1: Already voted for candidate fca9d7f013534f2db61763ee726db44f in this term.
I20260709 12:25:54.052441  6163 raft_consensus.cc:2468] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:54.054417  6282 tablet_bootstrap.cc:492] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:54.054759  6313 leader_election.cc:290] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.055052  6282 ts_tablet_manager.cc:1403] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.011s
I20260709 12:25:54.055510  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:54.055785  6285 raft_consensus.cc:697] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.057073  6285 consensus_queue.cc:237] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.057137  6053 leader_election.cc:304] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:54.058378  6327 raft_consensus.cc:3060] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.058316  6282 raft_consensus.cc:359] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.059264  6282 raft_consensus.cc:385] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.059630  6282 raft_consensus.cc:740] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.060439  6282 consensus_queue.cc:260] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.062225  6294 raft_consensus.cc:493] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.062731  6294 raft_consensus.cc:515] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:54.063265  6282 ts_tablet_manager.cc:1434] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:54.064706  6294 leader_election.cc:290] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123), 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749)
I20260709 12:25:54.065940  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:54.066661  6238 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 0.
I20260709 12:25:54.065990  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:54.067627  6327 raft_consensus.cc:2749] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.068164  6087 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 0.
I20260709 12:25:54.068058  6129 leader_election.cc:304] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.069535  6315 raft_consensus.cc:2804] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.070004  6315 raft_consensus.cc:493] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.070372  6315 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.074755  5984 catalog_manager.cc:5697] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.079875  6315 raft_consensus.cc:515] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:54.080806  6285 raft_consensus.cc:493] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.081383  6285 raft_consensus.cc:515] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.083165  6315 leader_election.cc:290] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Requested vote from peers fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123), 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749)
I20260709 12:25:54.084403  6285 leader_election.cc:290] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.085210  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:54.085819  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:54.085975  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:54.086002  6163 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:54.086369  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.086562  6087 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.086782  6237 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:54.087036  6238 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.088407  6050 leader_election.cc:304] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:54.090173  6285 raft_consensus.cc:2804] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.090575  6285 raft_consensus.cc:493] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.090929  6285 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.096057  6087 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:54.096310  6238 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:54.097347  6126 leader_election.cc:304] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:54.098320  6315 raft_consensus.cc:2804] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.098910  6315 raft_consensus.cc:697] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:54.099709  6285 raft_consensus.cc:515] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.099735  6315 consensus_queue.cc:237] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:54.102206  6285 leader_election.cc:290] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.102777  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:54.103478  6163 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.103392  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.104264  6238 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.110687  5984 catalog_manager.cc:5697] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.113711  6238 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:54.115274  6053 leader_election.cc:304] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.116320  6285 raft_consensus.cc:2804] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.116401  6163 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:54.116988  6285 raft_consensus.cc:697] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.118019  6285 consensus_queue.cc:237] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.126782  5984 catalog_manager.cc:5697] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.140538  6285 raft_consensus.cc:493] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.141094  6285 raft_consensus.cc:515] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.143028  6285 leader_election.cc:290] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.143864  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:54.144119  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:54.144675  6163 raft_consensus.cc:2393] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88393fc7d68a4a65bf024ffb5afdf44f in current term 1: Already voted for candidate fca9d7f013534f2db61763ee726db44f in this term.
I20260709 12:25:54.145668  6050 leader_election.cc:304] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:54.146675  6285 raft_consensus.cc:3060] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.152729  6285 raft_consensus.cc:2749] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.186333  6315 raft_consensus.cc:493] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.187004  6315 raft_consensus.cc:515] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.188807  6315 leader_election.cc:290] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.189952  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:54.189848  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:54.191191  6087 raft_consensus.cc:2393] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42b2e7f4797844a2a6d969b44e7513f4 in current term 1: Already voted for candidate fca9d7f013534f2db61763ee726db44f in this term.
I20260709 12:25:54.192305  6126 leader_election.cc:304] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4; no voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:54.193133  6315 raft_consensus.cc:3060] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.199368  6315 raft_consensus.cc:2749] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.213019  6285 raft_consensus.cc:493] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.213634  6285 raft_consensus.cc:515] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.215619  6285 leader_election.cc:290] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.216746  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04a8d4a054d4d6a9e1dd4d5570f7158" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:54.216756  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04a8d4a054d4d6a9e1dd4d5570f7158" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:54.217490  6238 raft_consensus.cc:2468] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:54.217726  6163 raft_consensus.cc:2468] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:54.218773  6053 leader_election.cc:304] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.218811  6296 raft_consensus.cc:493] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.219614  6296 raft_consensus.cc:515] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.219806  6285 raft_consensus.cc:2804] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.220414  6285 raft_consensus.cc:493] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.220781  6285 raft_consensus.cc:3060] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.221891  6296 leader_election.cc:290] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:54.222734  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:54.223161  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:54.223661  6087 raft_consensus.cc:2393] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fca9d7f013534f2db61763ee726db44f in current term 1: Already voted for candidate 42b2e7f4797844a2a6d969b44e7513f4 in this term.
I20260709 12:25:54.224975  6200 leader_election.cc:304] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:54.225725  6296 raft_consensus.cc:3060] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.228492  6285 raft_consensus.cc:515] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.230984  6285 leader_election.cc:290] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.232131  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04a8d4a054d4d6a9e1dd4d5570f7158" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.231997  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c04a8d4a054d4d6a9e1dd4d5570f7158" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:54.232769  6238 raft_consensus.cc:3060] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.232810  6163 raft_consensus.cc:3060] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.233454  6296 raft_consensus.cc:2749] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.239755  6296 consensus_queue.cc:1048] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.241374  6163 raft_consensus.cc:2468] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:54.241374  6238 raft_consensus.cc:2468] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:54.242823  6050 leader_election.cc:304] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:54.243702  6285 raft_consensus.cc:2804] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.244196  6285 raft_consensus.cc:697] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.245098  6285 consensus_queue.cc:237] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.248611  6296 consensus_queue.cc:1048] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.257545  5984 catalog_manager.cc:5697] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.265635  6315 raft_consensus.cc:493] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.266462  6315 raft_consensus.cc:515] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.270038  6315 leader_election.cc:290] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.270288  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:54.272275  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:54.273221  6238 raft_consensus.cc:2393] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42b2e7f4797844a2a6d969b44e7513f4 in current term 1: Already voted for candidate 88393fc7d68a4a65bf024ffb5afdf44f in this term.
I20260709 12:25:54.274763  6129 leader_election.cc:304] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4; no voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:54.275748  6315 raft_consensus.cc:3060] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.283951  6315 raft_consensus.cc:2749] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.285364  6315 consensus_queue.cc:1048] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.300084  6315 consensus_queue.cc:1048] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.347851  6285 consensus_queue.cc:1048] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.360771  6328 consensus_queue.cc:1048] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.378509  6296 consensus_queue.cc:1048] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.390507  6162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
mode: GRACEFUL
new_leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:54440
I20260709 12:25:54.391424  6162 raft_consensus.cc:606] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Received request to transfer leadership to TS 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:54.394675  6280 consensus_queue.cc:1048] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.403383  6163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
mode: GRACEFUL
new_leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:54440
I20260709 12:25:54.404088  6163 raft_consensus.cc:606] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Received request to transfer leadership to TS 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:54.406035  6296 consensus_queue.cc:1048] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.412892  6296 consensus_queue.cc:1048] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.447784  6238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
mode: GRACEFUL
new_leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:39308
I20260709 12:25:54.448375  6238 raft_consensus.cc:606] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Received request to transfer leadership to TS 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:54.457939  6238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
mode: GRACEFUL
new_leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:39308
I20260709 12:25:54.458715  6238 raft_consensus.cc:606] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Received request to transfer leadership to TS 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:54.464828  6238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
mode: GRACEFUL
new_leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:39308
I20260709 12:25:54.465591  6238 raft_consensus.cc:606] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Received request to transfer leadership to TS 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:54.481005  6087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
mode: GRACEFUL
new_leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:33578
I20260709 12:25:54.481674  6087 raft_consensus.cc:606] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Received request to transfer leadership to TS 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:54.488059  6087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
mode: GRACEFUL
new_leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:33578
I20260709 12:25:54.488583  6087 raft_consensus.cc:606] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Received request to transfer leadership to TS 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:54.494201  6087 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c965fa00b541deb716a40664f99018"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
mode: GRACEFUL
new_leader_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:33578
I20260709 12:25:54.494710  6087 raft_consensus.cc:606] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Received request to transfer leadership to TS fca9d7f013534f2db61763ee726db44f
I20260709 12:25:54.503968  6285 consensus_queue.cc:1048] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.511515  6328 raft_consensus.cc:993] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f: : Instructing follower 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.512019  6313 raft_consensus.cc:1081] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Signalling peer 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.513800  6163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:54426
I20260709 12:25:54.515306  6163 raft_consensus.cc:493] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.515749  6163 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.518497  6313 consensus_queue.cc:1048] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.524381  6163 raft_consensus.cc:515] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.528652  6315 consensus_queue.cc:1048] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.528996  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:54.529632  6087 raft_consensus.cc:3055] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.529980  6087 raft_consensus.cc:740] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.530907  6087 consensus_queue.cc:260] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.531705  6087 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.536145  6163 leader_election.cc:290] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.538810  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.539656  6238 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.540014  6087 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.541376  6126 leader_election.cc:304] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:54.542304  6315 raft_consensus.cc:2804] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.542826  6315 raft_consensus.cc:697] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:54.543764  6315 consensus_queue.cc:237] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.551204  6340 raft_consensus.cc:993] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4: : Instructing follower 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:54.551795  6340 raft_consensus.cc:1081] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Signalling peer 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:54.550601  6238 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.554497  5985 catalog_manager.cc:5697] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 1 to 2, leader changed from 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65) to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.557232  6315 consensus_queue.cc:1048] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.559254  6087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:33570
I20260709 12:25:54.559921  6087 raft_consensus.cc:493] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.561031  6087 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.570115  6087 raft_consensus.cc:515] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:54.573392  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.573681  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:54.574113  6238 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.574453  6163 raft_consensus.cc:3055] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.574819  6163 raft_consensus.cc:740] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:54.575673  6163 consensus_queue.cc:260] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:54.576721  6163 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.582224  6238 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:54.583568  6053 leader_election.cc:304] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.584188  6163 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:54.584448  6313 raft_consensus.cc:2804] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.584959  6087 leader_election.cc:290] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Requested vote from peers fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:54.585147  6313 raft_consensus.cc:697] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.586320  6313 consensus_queue.cc:237] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:25:54.593588  5984 catalog_manager.cc:5697] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 1 to 2, leader changed from 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66) to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 2 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.633368  6313 consensus_queue.cc:1048] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.645025  6328 consensus_queue.cc:1048] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.653124  6285 raft_consensus.cc:993] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f: : Instructing follower fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:25:54.653687  6328 raft_consensus.cc:1081] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Signalling peer fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:25:54.655305  6238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c965fa00b541deb716a40664f99018"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:39280
I20260709 12:25:54.655917  6238 raft_consensus.cc:493] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.656383  6238 raft_consensus.cc:3060] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.662345  6238 raft_consensus.cc:515] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.664232  6238 leader_election.cc:290] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:54.665436  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c965fa00b541deb716a40664f99018" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:54.665938  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c965fa00b541deb716a40664f99018" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:54.666210  6087 raft_consensus.cc:3055] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.666608  6087 raft_consensus.cc:740] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.666608  6163 raft_consensus.cc:3060] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.667481  6087 consensus_queue.cc:260] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.668936  6087 raft_consensus.cc:3060] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.675205  6087 raft_consensus.cc:2468] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 2.
I20260709 12:25:54.675683  6163 raft_consensus.cc:2468] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 2.
I20260709 12:25:54.676383  6200 leader_election.cc:304] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.677349  6296 raft_consensus.cc:2804] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.677883  6296 raft_consensus.cc:697] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 2 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:54.678961  6296 consensus_queue.cc:237] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.685894  5985 catalog_manager.cc:5697] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 1 to 2, leader changed from 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65) to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 2 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.709399  6295 raft_consensus.cc:993] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: : Instructing follower 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:54.710023  6296 raft_consensus.cc:1081] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Signalling peer 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:54.711645  6087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:25:54.712118  6087 raft_consensus.cc:493] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.712386  6087 raft_consensus.cc:3060] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.717936  6087 raft_consensus.cc:515] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.722139  6340 raft_consensus.cc:993] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4: : Instructing follower 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:54.722776  6315 raft_consensus.cc:1081] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Signalling peer 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:54.723045  6087 leader_election.cc:290] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.724273  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:54.724686  6087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:33570
I20260709 12:25:54.724726  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5a350ea66eb43d7a0057e1dc92d6a73" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.725009  6163 raft_consensus.cc:3060] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.725595  6087 raft_consensus.cc:493] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.725621  6238 raft_consensus.cc:3055] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.726172  6087 raft_consensus.cc:3060] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.726187  6238 raft_consensus.cc:740] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:54.727288  6238 consensus_queue.cc:260] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.728768  6238 raft_consensus.cc:3060] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.731700  6163 raft_consensus.cc:2468] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:54.733016  6050 leader_election.cc:304] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:54.733784  6328 raft_consensus.cc:2804] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.734278  6328 raft_consensus.cc:697] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.734582  6087 raft_consensus.cc:515] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.735149  6328 consensus_queue.cc:237] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.736711  6238 raft_consensus.cc:2468] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:54.737102  6087 leader_election.cc:290] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.738046  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:54.738754  6163 raft_consensus.cc:3055] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.739367  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3720c332e3894c81aa9ed54af81dfb74" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.741205  6163 raft_consensus.cc:740] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:54.741394  6238 raft_consensus.cc:3060] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.742414  6163 consensus_queue.cc:260] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.743800  6163 raft_consensus.cc:3060] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.743563  5985 catalog_manager.cc:5697] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 1 to 2, leader changed from fca9d7f013534f2db61763ee726db44f (127.28.234.67) to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 2 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.749378  6238 raft_consensus.cc:2468] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:54.751170  6053 leader_election.cc:304] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.751725  6163 raft_consensus.cc:2468] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:54.752197  6328 raft_consensus.cc:2804] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.752812  6328 raft_consensus.cc:697] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.753706  6328 consensus_queue.cc:237] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.762257  5985 catalog_manager.cc:5697] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 1 to 2, leader changed from 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66) to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 2 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.772970  6285 consensus_queue.cc:1048] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.778105  6328 consensus_queue.cc:1048] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:54.838187  6295 raft_consensus.cc:993] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f: : Instructing follower 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.838771  6296 raft_consensus.cc:1081] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Signalling peer 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.840358  6163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:54412
I20260709 12:25:54.840833  6163 raft_consensus.cc:493] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.841112  6163 raft_consensus.cc:3060] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.848768  6295 raft_consensus.cc:993] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f: : Instructing follower 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.848881  6163 raft_consensus.cc:515] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.849543  6296 raft_consensus.cc:1081] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Signalling peer 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.851296  6163 leader_election.cc:290] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.851492  6162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:54412
I20260709 12:25:54.852128  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:54.852830  6087 raft_consensus.cc:3060] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.852849  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1911e26a3c7f4f4db6985a3d90de5fc7" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.853596  6238 raft_consensus.cc:3055] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.854004  6238 raft_consensus.cc:740] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:54.854885  6238 consensus_queue.cc:260] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.856297  6238 raft_consensus.cc:3060] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.852140  6162 raft_consensus.cc:493] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.858491  6162 raft_consensus.cc:3060] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.861438  6087 raft_consensus.cc:2468] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.863173  6126 leader_election.cc:304] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:54.864069  6315 raft_consensus.cc:2804] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.864588  6315 raft_consensus.cc:697] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:54.864964  6238 raft_consensus.cc:2468] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.865638  6162 raft_consensus.cc:515] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.865477  6315 consensus_queue.cc:237] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.868250  6162 leader_election.cc:290] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.868798  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.869619  6238 raft_consensus.cc:3055] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.869650  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dba407d35514d178c5d3ad4fa4f0554" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:54.870072  6238 raft_consensus.cc:740] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:54.870429  6087 raft_consensus.cc:3060] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.870995  6238 consensus_queue.cc:260] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.872090  6238 raft_consensus.cc:3060] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.875941  5982 catalog_manager.cc:5697] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 1 to 2, leader changed from fca9d7f013534f2db61763ee726db44f (127.28.234.67) to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.877665  6087 raft_consensus.cc:2468] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.879128  6126 leader_election.cc:304] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:54.879908  6315 raft_consensus.cc:2804] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.880396  6315 raft_consensus.cc:697] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:54.880705  6238 raft_consensus.cc:2468] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.881285  6315 consensus_queue.cc:237] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.892150  5982 catalog_manager.cc:5697] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 1 to 2, leader changed from fca9d7f013534f2db61763ee726db44f (127.28.234.67) to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.932957  6328 raft_consensus.cc:993] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f: : Instructing follower 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.933497  6327 raft_consensus.cc:1081] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Signalling peer 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:54.935189  6162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:54426
I20260709 12:25:54.935714  6162 raft_consensus.cc:493] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:54.936033  6162 raft_consensus.cc:3060] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.941530  6162 raft_consensus.cc:515] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.943943  6162 leader_election.cc:290] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:54.944630  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:54.944648  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d69c11c5bd408e9becdce0b106eeeb" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:54.945680  6087 raft_consensus.cc:3055] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:54.945847  6238 raft_consensus.cc:3060] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.946062  6087 raft_consensus.cc:740] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:54.947099  6087 consensus_queue.cc:260] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.948139  6087 raft_consensus.cc:3060] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:54.952426  6238 raft_consensus.cc:2468] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.953773  6087 raft_consensus.cc:2468] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:54.953832  6129 leader_election.cc:304] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:54.954960  6315 raft_consensus.cc:2804] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:54.955511  6315 raft_consensus.cc:697] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:54.956255  6315 consensus_queue.cc:237] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:54.963130  5982 catalog_manager.cc:5697] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 1 to 2, leader changed from 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65) to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.988263  6238 raft_consensus.cc:1275] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:54.989710  6315 consensus_queue.cc:1048] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:54.998759  6087 raft_consensus.cc:1275] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.000610  6294 consensus_queue.cc:1048] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.014400  6238 raft_consensus.cc:1275] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.015738  6327 consensus_queue.cc:1048] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.024494  6162 raft_consensus.cc:1275] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.026559  6327 consensus_queue.cc:1048] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.116963  6087 raft_consensus.cc:1275] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.118381  6296 consensus_queue.cc:1048] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.127565  6162 raft_consensus.cc:1275] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.129561  6295 consensus_queue.cc:1048] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:55.148461  6162 raft_consensus.cc:1275] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.150013  6327 consensus_queue.cc:1048] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.158617  6238 raft_consensus.cc:1275] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.160352  6328 consensus_queue.cc:1048] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.270097  6238 raft_consensus.cc:1275] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.271600  6328 consensus_queue.cc:1048] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.280515  6162 raft_consensus.cc:1275] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.282653  6328 consensus_queue.cc:1048] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.336869  6238 raft_consensus.cc:1275] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.338637  6294 consensus_queue.cc:1048] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.348628  6087 raft_consensus.cc:1275] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.350529  6362 consensus_queue.cc:1048] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.406469  6087 raft_consensus.cc:1275] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.407744  6362 consensus_queue.cc:1048] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.416404  6238 raft_consensus.cc:1275] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.417732  6340 consensus_queue.cc:1048] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:55.459009  6087 raft_consensus.cc:1275] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.460453  6340 consensus_queue.cc:1048] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:55.471334  6238 raft_consensus.cc:1275] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:55.473500  6340 consensus_queue.cc:1048] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:57.526297  5982 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55844:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:57.528827  5982 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:57.584024  6073 tablet_service.cc:1511] Processing CreateTablet for tablet b90ae35ddf804cfea779d504e259a30b (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:57.585559  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90ae35ddf804cfea779d504e259a30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.585182  6146 tablet_service.cc:1511] Processing CreateTablet for tablet b90ae35ddf804cfea779d504e259a30b (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:57.586792  6146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90ae35ddf804cfea779d504e259a30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.587038  6227 tablet_service.cc:1511] Processing CreateTablet for tablet b90ae35ddf804cfea779d504e259a30b (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:25:57.588493  6227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b90ae35ddf804cfea779d504e259a30b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.588228  6072 tablet_service.cc:1511] Processing CreateTablet for tablet 6783d96deab84d08b11af210aeff203f (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:57.589737  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6783d96deab84d08b11af210aeff203f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.601341  6150 tablet_service.cc:1511] Processing CreateTablet for tablet 6783d96deab84d08b11af210aeff203f (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:57.602870  6150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6783d96deab84d08b11af210aeff203f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.614594  6380 tablet_bootstrap.cc:492] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:57.619091  6381 tablet_bootstrap.cc:492] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:57.623196  6380 tablet_bootstrap.cc:654] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.628787  6381 tablet_bootstrap.cc:654] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.629724  6227 tablet_service.cc:1511] Processing CreateTablet for tablet 6783d96deab84d08b11af210aeff203f (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:25:57.631186  6227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6783d96deab84d08b11af210aeff203f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.631268  6073 tablet_service.cc:1511] Processing CreateTablet for tablet faddcbddd06346abb34a17c26abbf867 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:57.632800  6073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faddcbddd06346abb34a17c26abbf867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.635284  6220 tablet_service.cc:1511] Processing CreateTablet for tablet faddcbddd06346abb34a17c26abbf867 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:57.637404  6220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faddcbddd06346abb34a17c26abbf867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.639590  6147 tablet_service.cc:1511] Processing CreateTablet for tablet faddcbddd06346abb34a17c26abbf867 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:25:57.646368  6072 tablet_service.cc:1511] Processing CreateTablet for tablet f19e0b72cd1344129e7e14a1c969a7aa (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:57.648393  6072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19e0b72cd1344129e7e14a1c969a7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.641728  6147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faddcbddd06346abb34a17c26abbf867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.662050  6151 tablet_service.cc:1511] Processing CreateTablet for tablet f19e0b72cd1344129e7e14a1c969a7aa (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:57.667122  6151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19e0b72cd1344129e7e14a1c969a7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.672024  6228 tablet_service.cc:1511] Processing CreateTablet for tablet f19e0b72cd1344129e7e14a1c969a7aa (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:25:57.673687  6228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19e0b72cd1344129e7e14a1c969a7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.675702  6223 tablet_service.cc:1511] Processing CreateTablet for tablet b1082978956344a98cc1a8932485542c (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:57.677206  6223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1082978956344a98cc1a8932485542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.677008  6146 tablet_service.cc:1511] Processing CreateTablet for tablet b1082978956344a98cc1a8932485542c (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:57.678460  6146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1082978956344a98cc1a8932485542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.679387  6071 tablet_service.cc:1511] Processing CreateTablet for tablet b1082978956344a98cc1a8932485542c (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:25:57.680824  6071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1082978956344a98cc1a8932485542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.685000  6222 tablet_service.cc:1511] Processing CreateTablet for tablet ca8548c521c94866b05f2943785a3ef0 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:57.685359  6145 tablet_service.cc:1511] Processing CreateTablet for tablet ca8548c521c94866b05f2943785a3ef0 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:57.685912  6074 tablet_service.cc:1511] Processing CreateTablet for tablet ca8548c521c94866b05f2943785a3ef0 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:25:57.686445  6222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8548c521c94866b05f2943785a3ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.687381  6074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8548c521c94866b05f2943785a3ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.690325  6382 tablet_bootstrap.cc:492] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:57.691820  6221 tablet_service.cc:1511] Processing CreateTablet for tablet 845e828d6c75461abcbd0ce48595d19e (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:57.693328  6221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845e828d6c75461abcbd0ce48595d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.696180  6077 tablet_service.cc:1511] Processing CreateTablet for tablet 845e828d6c75461abcbd0ce48595d19e (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:25:57.698527  6077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845e828d6c75461abcbd0ce48595d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.700795  6148 tablet_service.cc:1511] Processing CreateTablet for tablet 845e828d6c75461abcbd0ce48595d19e (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
W20260709 12:25:57.705178  6033 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:57.709537  6145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8548c521c94866b05f2943785a3ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.714147  6148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 845e828d6c75461abcbd0ce48595d19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.716197  6070 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3a322d8d08466badc26828b525928c (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:57.717720  6070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3a322d8d08466badc26828b525928c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.723354  6380 tablet_bootstrap.cc:492] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:57.724092  6380 ts_tablet_manager.cc:1403] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.026s
I20260709 12:25:57.730736  6224 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3a322d8d08466badc26828b525928c (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:57.732311  6224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3a322d8d08466badc26828b525928c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.737219  6076 tablet_service.cc:1511] Processing CreateTablet for tablet d945e7c2faba4a98a9c4ed0505b39446 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:57.738700  6076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d945e7c2faba4a98a9c4ed0505b39446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.740604  6382 tablet_bootstrap.cc:654] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.741673  6226 tablet_service.cc:1511] Processing CreateTablet for tablet d945e7c2faba4a98a9c4ed0505b39446 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:57.743085  6226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d945e7c2faba4a98a9c4ed0505b39446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.742774  6150 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3a322d8d08466badc26828b525928c (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:25:57.740629  6152 tablet_service.cc:1511] Processing CreateTablet for tablet d945e7c2faba4a98a9c4ed0505b39446 (DEFAULT_TABLE table=soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:25:57.761081  6152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d945e7c2faba4a98a9c4ed0505b39446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.766268  6150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3a322d8d08466badc26828b525928c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.795462  6380 raft_consensus.cc:359] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.796360  6380 raft_consensus.cc:385] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.796680  6380 raft_consensus.cc:740] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.797500  6380 consensus_queue.cc:260] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.811049  6380 ts_tablet_manager.cc:1434] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:25:57.814278  6381 tablet_bootstrap.cc:492] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:57.815336  6381 ts_tablet_manager.cc:1403] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.197s	user 0.009s	sys 0.008s
I20260709 12:25:57.821414  6381 raft_consensus.cc:359] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.822548  6381 raft_consensus.cc:385] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.822988  6381 raft_consensus.cc:740] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.824973  6380 tablet_bootstrap.cc:492] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:57.824707  6381 consensus_queue.cc:260] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.832693  6380 tablet_bootstrap.cc:654] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.842375  6382 tablet_bootstrap.cc:492] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:57.842952  6382 ts_tablet_manager.cc:1403] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.017s
I20260709 12:25:57.848134  6381 ts_tablet_manager.cc:1434] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:25:57.850597  6382 raft_consensus.cc:359] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.851509  6382 raft_consensus.cc:385] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.851814  6382 raft_consensus.cc:740] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.854420  6369 raft_consensus.cc:493] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.854997  6369 raft_consensus.cc:515] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.857416  6369 leader_election.cc:290] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:57.857491  6382 consensus_queue.cc:260] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.858883  6367 raft_consensus.cc:493] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.859386  6380 tablet_bootstrap.cc:492] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:57.859982  6380 ts_tablet_manager.cc:1403] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.012s
I20260709 12:25:57.859453  6367 raft_consensus.cc:515] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.861500  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:57.862442  6238 raft_consensus.cc:2468] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:57.859148  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:57.863736  6380 raft_consensus.cc:359] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.864148  6367 leader_election.cc:290] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:57.864670  6380 raft_consensus.cc:385] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.864687  6162 raft_consensus.cc:2468] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:57.865126  6380 raft_consensus.cc:740] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.866097  6380 consensus_queue.cc:260] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.866695  6053 leader_election.cc:304] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:57.868021  6285 raft_consensus.cc:2804] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.868451  6285 raft_consensus.cc:493] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.868841  6380 ts_tablet_manager.cc:1434] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:57.868860  6285 raft_consensus.cc:3060] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.874637  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:57.875716  6381 tablet_bootstrap.cc:492] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:57.877185  6382 ts_tablet_manager.cc:1434] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.007s
I20260709 12:25:57.878270  6382 tablet_bootstrap.cc:492] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:57.882524  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:57.883348  6238 raft_consensus.cc:2468] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 0.
I20260709 12:25:57.884089  6381 tablet_bootstrap.cc:654] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.885210  6382 tablet_bootstrap.cc:654] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.884874  6129 leader_election.cc:304] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:57.886124  6387 raft_consensus.cc:2804] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.886366  6380 tablet_bootstrap.cc:492] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:57.886639  6387 raft_consensus.cc:493] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.887061  6387 raft_consensus.cc:3060] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.896220  6380 tablet_bootstrap.cc:654] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.899097  6387 raft_consensus.cc:515] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.903460  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:57.903884  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:57.904831  6238 raft_consensus.cc:3060] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.909927  6387 leader_election.cc:290] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:57.911710  6285 raft_consensus.cc:515] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.915516  6380 tablet_bootstrap.cc:492] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:57.916169  6380 ts_tablet_manager.cc:1403] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.000s
I20260709 12:25:57.916958  6238 raft_consensus.cc:2468] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:57.918242  6087 raft_consensus.cc:2393] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42b2e7f4797844a2a6d969b44e7513f4 in current term 1: Already voted for candidate 88393fc7d68a4a65bf024ffb5afdf44f in this term.
I20260709 12:25:57.918824  6129 leader_election.cc:304] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:57.920646  6387 raft_consensus.cc:2804] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.921718  6381 tablet_bootstrap.cc:492] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:57.922412  6381 ts_tablet_manager.cc:1403] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.006s
I20260709 12:25:57.922307  6387 raft_consensus.cc:697] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:57.923905  6387 consensus_queue.cc:237] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.926390  6381 raft_consensus.cc:359] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.927340  6381 raft_consensus.cc:385] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.927680  6381 raft_consensus.cc:740] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.930469  6380 raft_consensus.cc:359] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.931478  6380 raft_consensus.cc:385] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.931856  6380 raft_consensus.cc:740] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.932785  6380 consensus_queue.cc:260] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.934181  6381 consensus_queue.cc:260] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.934989  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:57.937060  6381 ts_tablet_manager.cc:1434] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:57.939464  6380 ts_tablet_manager.cc:1434] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:25:57.940737  6380 tablet_bootstrap.cc:492] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:57.942893  6285 leader_election.cc:290] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:57.948657  6380 tablet_bootstrap.cc:654] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.941901  5985 catalog_manager.cc:5697] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.950729  6381 tablet_bootstrap.cc:492] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:57.957882  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:57.959196  6238 raft_consensus.cc:2393] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88393fc7d68a4a65bf024ffb5afdf44f in current term 1: Already voted for candidate 42b2e7f4797844a2a6d969b44e7513f4 in this term.
I20260709 12:25:57.959451  6381 tablet_bootstrap.cc:654] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.962265  6053 leader_election.cc:304] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:57.964340  6369 raft_consensus.cc:2749] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.967788  6368 raft_consensus.cc:493] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.968590  6368 raft_consensus.cc:515] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:57.972911  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845e828d6c75461abcbd0ce48595d19e" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
W20260709 12:25:57.975123  6200 leader_election.cc:343] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.976861  6368 leader_election.cc:290] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:57.979173  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845e828d6c75461abcbd0ce48595d19e" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
W20260709 12:25:57.981884  6200 leader_election.cc:343] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.985200  6200 leader_election.cc:304] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:57.987087  6368 raft_consensus.cc:2749] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.010563  6382 tablet_bootstrap.cc:492] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.011374  6382 ts_tablet_manager.cc:1403] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.133s	user 0.044s	sys 0.087s
I20260709 12:25:58.012701  6380 tablet_bootstrap.cc:492] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:58.013355  6380 ts_tablet_manager.cc:1403] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.019s
I20260709 12:25:58.014071  6381 tablet_bootstrap.cc:492] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:58.014575  6381 ts_tablet_manager.cc:1403] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.017s
I20260709 12:25:58.015204  6382 raft_consensus.cc:359] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.016114  6382 raft_consensus.cc:385] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.016464  6382 raft_consensus.cc:740] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.017710  6382 consensus_queue.cc:260] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.018612  6381 raft_consensus.cc:359] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.020928  6381 raft_consensus.cc:385] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.021428  6381 raft_consensus.cc:740] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.022615  6381 consensus_queue.cc:260] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.023396  6382 ts_tablet_manager.cc:1434] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:25:58.024827  6382 tablet_bootstrap.cc:492] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:58.025822  6381 ts_tablet_manager.cc:1434] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:25:58.026899  6381 tablet_bootstrap.cc:492] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:58.031494  6382 tablet_bootstrap.cc:654] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.034264  6381 tablet_bootstrap.cc:654] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.040650  6285 raft_consensus.cc:493] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.041013  6380 raft_consensus.cc:359] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.041510  6285 raft_consensus.cc:515] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.042083  6380 raft_consensus.cc:385] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.043203  6380 raft_consensus.cc:740] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.045091  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e0b72cd1344129e7e14a1c969a7aa" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:58.044505  6380 consensus_queue.cc:260] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.045552  6382 tablet_bootstrap.cc:492] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.046223  6382 ts_tablet_manager.cc:1403] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
W20260709 12:25:58.047761  6050 leader_election.cc:343] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.048530  6381 tablet_bootstrap.cc:492] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:58.049181  6381 ts_tablet_manager.cc:1403] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 12:25:58.049662  6285 leader_election.cc:290] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.050114  6382 raft_consensus.cc:359] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.050516  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e0b72cd1344129e7e14a1c969a7aa" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:58.051024  6382 raft_consensus.cc:385] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.051438  6382 raft_consensus.cc:740] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.052402  6382 consensus_queue.cc:260] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.052939  6381 raft_consensus.cc:359] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.051256  6238 raft_consensus.cc:2468] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.053856  6381 raft_consensus.cc:385] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.055130  6381 raft_consensus.cc:740] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.055612  6382 ts_tablet_manager.cc:1434] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:25:58.056013  6380 ts_tablet_manager.cc:1434] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:25:58.056084  6381 consensus_queue.cc:260] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.056926  6382 tablet_bootstrap.cc:492] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:58.057281  6380 tablet_bootstrap.cc:492] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:58.057184  6053 leader_election.cc:304] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:58.062383  6381 ts_tablet_manager.cc:1434] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:25:58.063647  6381 tablet_bootstrap.cc:492] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:58.059526  6285 raft_consensus.cc:2804] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.067229  6285 raft_consensus.cc:493] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.067641  6285 raft_consensus.cc:3060] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.072979  6381 tablet_bootstrap.cc:654] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.079314  6285 raft_consensus.cc:515] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.082495  6285 leader_election.cc:290] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.083220  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e0b72cd1344129e7e14a1c969a7aa" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:58.065596  6380 tablet_bootstrap.cc:654] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.066161  6382 tablet_bootstrap.cc:654] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.084189  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e0b72cd1344129e7e14a1c969a7aa" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:58.084793  6238 raft_consensus.cc:3060] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:58.085625  6050 leader_election.cc:343] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.087706  6387 raft_consensus.cc:493] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.088313  6387 raft_consensus.cc:515] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.090791  6387 leader_election.cc:290] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.094209  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
W20260709 12:25:58.095999  6129 leader_election.cc:343] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.097388  6394 raft_consensus.cc:493] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.098045  6394 raft_consensus.cc:515] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.100313  6394 leader_election.cc:290] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:58.100849  6382 tablet_bootstrap.cc:492] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.101251  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:58.101522  6382 ts_tablet_manager.cc:1403] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.005s
I20260709 12:25:58.103749  6238 raft_consensus.cc:2468] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.104496  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6783d96deab84d08b11af210aeff203f" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
W20260709 12:25:58.105068  6126 leader_election.cc:343] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.105309  6162 raft_consensus.cc:2468] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 0.
I20260709 12:25:58.106729  6053 leader_election.cc:304] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:58.107360  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6783d96deab84d08b11af210aeff203f" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:58.108337  6087 raft_consensus.cc:2468] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 0.
I20260709 12:25:58.108486  6200 leader_election.cc:304] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:58.109721  6394 raft_consensus.cc:2804] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.109983  6369 raft_consensus.cc:2804] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.110173  6394 raft_consensus.cc:493] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.110603  6394 raft_consensus.cc:3060] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.105578  6126 leader_election.cc:304] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4; no voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:58.111799  6387 raft_consensus.cc:2749] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.112299  6382 raft_consensus.cc:359] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.113619  6382 raft_consensus.cc:385] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.114078  6382 raft_consensus.cc:740] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.115232  6382 consensus_queue.cc:260] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.117175  6369 raft_consensus.cc:697] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:58.118297  6369 consensus_queue.cc:237] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.119673  6382 ts_tablet_manager.cc:1434] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:25:58.120287  6394 raft_consensus.cc:515] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.121304  6382 tablet_bootstrap.cc:492] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:58.125232  6381 tablet_bootstrap.cc:492] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:58.125895  6381 ts_tablet_manager.cc:1403] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.003s
I20260709 12:25:58.127426  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6783d96deab84d08b11af210aeff203f" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:58.128115  6087 raft_consensus.cc:3060] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.130010  5984 catalog_manager.cc:5697] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.125342  6380 tablet_bootstrap.cc:492] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:58.135728  6380 ts_tablet_manager.cc:1403] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.008s
I20260709 12:25:58.137488  6382 tablet_bootstrap.cc:654] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.138216  6087 raft_consensus.cc:2468] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 1.
I20260709 12:25:58.139277  6380 raft_consensus.cc:359] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.140506  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6783d96deab84d08b11af210aeff203f" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:58.141958  6380 raft_consensus.cc:385] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.142141  6162 raft_consensus.cc:3060] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.142330  6380 raft_consensus.cc:740] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.142733  6200 leader_election.cc:304] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:58.143209  6380 consensus_queue.cc:260] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.143772  6368 raft_consensus.cc:2804] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.145359  6381 raft_consensus.cc:359] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.145916  6380 ts_tablet_manager.cc:1434] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:25:58.146199  6381 raft_consensus.cc:385] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.146536  6381 raft_consensus.cc:740] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.147176  6380 tablet_bootstrap.cc:492] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:58.147341  6381 consensus_queue.cc:260] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.150236  6368 raft_consensus.cc:697] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:58.151350  6368 consensus_queue.cc:237] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.151979  6162 raft_consensus.cc:2468] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 1.
I20260709 12:25:58.156340  6394 leader_election.cc:290] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:58.158257  6380 tablet_bootstrap.cc:654] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.167460  6381 ts_tablet_manager.cc:1434] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.004s
I20260709 12:25:58.169001  6381 tablet_bootstrap.cc:492] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:58.169391  5983 catalog_manager.cc:5697] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 0 to 1, leader changed from <none> to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 1 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.172515  6382 tablet_bootstrap.cc:492] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.173271  6382 ts_tablet_manager.cc:1403] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.010s
I20260709 12:25:58.177093  6380 tablet_bootstrap.cc:492] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:58.177029  6382 raft_consensus.cc:359] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.177680  6381 tablet_bootstrap.cc:654] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.177906  6380 ts_tablet_manager.cc:1403] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.001s
I20260709 12:25:58.178038  6382 raft_consensus.cc:385] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.178678  6382 raft_consensus.cc:740] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.179606  6382 consensus_queue.cc:260] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.182149  6382 ts_tablet_manager.cc:1434] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:25:58.182154  6369 raft_consensus.cc:493] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.183257  6382 tablet_bootstrap.cc:492] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:58.182936  6369 raft_consensus.cc:515] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.187835  6380 raft_consensus.cc:359] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.188752  6380 raft_consensus.cc:385] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.189142  6380 raft_consensus.cc:740] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.189992  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:58.190801  6162 raft_consensus.cc:2468] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.190039  6380 consensus_queue.cc:260] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.192624  6050 leader_election.cc:304] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.193492  6382 tablet_bootstrap.cc:654] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.193869  6400 raft_consensus.cc:2804] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.194224  6380 ts_tablet_manager.cc:1434] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:25:58.194458  6400 raft_consensus.cc:493] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.194877  6400 raft_consensus.cc:3060] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.195500  6380 tablet_bootstrap.cc:492] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:58.188169  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
W20260709 12:25:58.198534  6053 leader_election.cc:343] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.199622  6369 leader_election.cc:290] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.203928  6382 tablet_bootstrap.cc:492] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.204725  6382 ts_tablet_manager.cc:1403] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.002s
I20260709 12:25:58.206765  6380 tablet_bootstrap.cc:654] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.218952  6382 raft_consensus.cc:359] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.220103  6382 raft_consensus.cc:385] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.220460  6382 raft_consensus.cc:740] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.221448  6382 consensus_queue.cc:260] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.225101  6382 ts_tablet_manager.cc:1434] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:25:58.227653  6382 tablet_bootstrap.cc:492] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:58.238513  6382 tablet_bootstrap.cc:654] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.240556  6400 raft_consensus.cc:515] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.262135  6381 tablet_bootstrap.cc:492] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:58.262789  6381 ts_tablet_manager.cc:1403] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.094s	user 0.031s	sys 0.043s
I20260709 12:25:58.263092  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:58.264050  6162 raft_consensus.cc:3060] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.264375  6400 leader_election.cc:290] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.266744  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
W20260709 12:25:58.268416  6053 leader_election.cc:343] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.269014  6382 tablet_bootstrap.cc:492] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.266659  6381 raft_consensus.cc:359] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.269667  6382 ts_tablet_manager.cc:1403] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.019s
I20260709 12:25:58.268419  6380 tablet_bootstrap.cc:492] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:58.270471  6380 ts_tablet_manager.cc:1403] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.027s
I20260709 12:25:58.272171  6162 raft_consensus.cc:2468] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.273303  6382 raft_consensus.cc:359] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.273696  6050 leader_election.cc:304] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: fca9d7f013534f2db61763ee726db44f
I20260709 12:25:58.274197  6382 raft_consensus.cc:385] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.273862  6380 raft_consensus.cc:359] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.274531  6382 raft_consensus.cc:740] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.274794  6380 raft_consensus.cc:385] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.269529  6381 raft_consensus.cc:385] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.275367  6381 raft_consensus.cc:740] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.275101  6400 raft_consensus.cc:2804] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.275535  6382 consensus_queue.cc:260] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.277199  6400 raft_consensus.cc:697] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:58.278158  6382 ts_tablet_manager.cc:1434] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:58.278272  6400 consensus_queue.cc:237] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.276780  6381 consensus_queue.cc:260] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.280017  6382 tablet_bootstrap.cc:492] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:58.283447  6381 ts_tablet_manager.cc:1434] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:25:58.275223  6380 raft_consensus.cc:740] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.287308  6381 tablet_bootstrap.cc:492] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:58.285648  6380 consensus_queue.cc:260] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.293859  6382 tablet_bootstrap.cc:654] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.293919  6380 ts_tablet_manager.cc:1434] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.003s
I20260709 12:25:58.296516  6380 tablet_bootstrap.cc:492] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:58.299710  6381 tablet_bootstrap.cc:654] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.300920  5983 catalog_manager.cc:5697] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.302007  6387 raft_consensus.cc:493] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.302793  6387 raft_consensus.cc:515] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.305265  6380 tablet_bootstrap.cc:654] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.307194  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e0b72cd1344129e7e14a1c969a7aa" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:58.307632  6387 leader_election.cc:290] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.310599  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e0b72cd1344129e7e14a1c969a7aa" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:58.311739  6238 raft_consensus.cc:2393] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42b2e7f4797844a2a6d969b44e7513f4 in current term 1: Already voted for candidate 88393fc7d68a4a65bf024ffb5afdf44f in this term.
I20260709 12:25:58.314617  6126 leader_election.cc:304] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4; no voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f
I20260709 12:25:58.316576  6387 raft_consensus.cc:3060] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.348026  6387 raft_consensus.cc:2749] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.354614  6387 consensus_queue.cc:1048] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.355921  6381 tablet_bootstrap.cc:492] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:58.356374  6382 tablet_bootstrap.cc:492] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.356596  6381 ts_tablet_manager.cc:1403] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.070s	user 0.029s	sys 0.033s
I20260709 12:25:58.356876  6382 ts_tablet_manager.cc:1403] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.015s
I20260709 12:25:58.359455  6380 tablet_bootstrap.cc:492] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:58.360098  6380 ts_tablet_manager.cc:1403] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.021s
I20260709 12:25:58.360193  6382 raft_consensus.cc:359] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.361012  6382 raft_consensus.cc:385] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.361506  6382 raft_consensus.cc:740] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.360858  6381 raft_consensus.cc:359] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.362439  6381 raft_consensus.cc:385] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.362418  6382 consensus_queue.cc:260] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.363106  6381 raft_consensus.cc:740] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.363473  6380 raft_consensus.cc:359] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.364200  6380 raft_consensus.cc:385] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.364549  6380 raft_consensus.cc:740] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.364215  6381 consensus_queue.cc:260] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.365142  6382 ts_tablet_manager.cc:1434] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:58.365294  6380 consensus_queue.cc:260] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.366820  6382 tablet_bootstrap.cc:492] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4: Bootstrap starting.
I20260709 12:25:58.367777  6381 ts_tablet_manager.cc:1434] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 12:25:58.369143  6381 tablet_bootstrap.cc:492] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:58.370682  6380 ts_tablet_manager.cc:1434] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:58.371909  6380 tablet_bootstrap.cc:492] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f: Bootstrap starting.
I20260709 12:25:58.373986  6382 tablet_bootstrap.cc:654] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.380378  6381 tablet_bootstrap.cc:654] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.383137  6380 tablet_bootstrap.cc:654] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.386762  6382 tablet_bootstrap.cc:492] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4: No bootstrap required, opened a new log
I20260709 12:25:58.387463  6382 ts_tablet_manager.cc:1403] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:25:58.391230  6381 tablet_bootstrap.cc:492] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:58.391881  6381 ts_tablet_manager.cc:1403] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.012s
I20260709 12:25:58.391512  6382 raft_consensus.cc:359] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.392630  6382 raft_consensus.cc:385] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.392943  6382 raft_consensus.cc:740] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.393798  6382 consensus_queue.cc:260] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.395359  6380 tablet_bootstrap.cc:492] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f: No bootstrap required, opened a new log
I20260709 12:25:58.395256  6381 raft_consensus.cc:359] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.396023  6380 ts_tablet_manager.cc:1403] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:25:58.396159  6382 ts_tablet_manager.cc:1434] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:25:58.396169  6381 raft_consensus.cc:385] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.396706  6381 raft_consensus.cc:740] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.397558  6381 consensus_queue.cc:260] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.398904  6380 raft_consensus.cc:359] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.399499  6381 ts_tablet_manager.cc:1434] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:25:58.399744  6380 raft_consensus.cc:385] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.400100  6380 raft_consensus.cc:740] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.400609  6381 tablet_bootstrap.cc:492] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f: Bootstrap starting.
I20260709 12:25:58.400832  6380 consensus_queue.cc:260] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.404978  6380 ts_tablet_manager.cc:1434] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:25:58.409191  6381 tablet_bootstrap.cc:654] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.410092  6367 raft_consensus.cc:493] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.410630  6367 raft_consensus.cc:515] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.412500  6367 leader_election.cc:290] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.414676  6236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1082978956344a98cc1a8932485542c" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:58.415464  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1082978956344a98cc1a8932485542c" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:58.416152  6087 raft_consensus.cc:2468] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 0.
W20260709 12:25:58.416381  6129 leader_election.cc:343] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.417323  6126 leader_election.cc:304] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: fca9d7f013534f2db61763ee726db44f
I20260709 12:25:58.418650  6367 raft_consensus.cc:2804] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.418676  6381 tablet_bootstrap.cc:492] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f: No bootstrap required, opened a new log
I20260709 12:25:58.419071  6367 raft_consensus.cc:493] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.419322  6381 ts_tablet_manager.cc:1403] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:25:58.419412  6367 raft_consensus.cc:3060] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.422613  6381 raft_consensus.cc:359] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.423334  6381 raft_consensus.cc:385] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.423615  6381 raft_consensus.cc:740] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.424343  6381 consensus_queue.cc:260] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.426829  6381 ts_tablet_manager.cc:1434] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:58.434614  6367 raft_consensus.cc:515] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.435196  6400 raft_consensus.cc:493] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.436223  6400 raft_consensus.cc:515] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.439088  6087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1082978956344a98cc1a8932485542c" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:58.439872  6087 raft_consensus.cc:3060] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.440575  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:58.441515  6400 leader_election.cc:290] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.441532  6162 raft_consensus.cc:2468] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.442896  6236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:58.443683  6236 raft_consensus.cc:2468] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.444938  6050 leader_election.cc:304] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.446589  6400 raft_consensus.cc:2804] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.446982  6400 raft_consensus.cc:493] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.447369  6400 raft_consensus.cc:3060] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.448331  6087 raft_consensus.cc:2468] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:58.450170  6126 leader_election.cc:304] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.451385  6420 raft_consensus.cc:2804] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.451892  6420 raft_consensus.cc:697] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:58.452855  6420 consensus_queue.cc:237] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.454273  6400 raft_consensus.cc:515] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.454836  6387 raft_consensus.cc:493] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.455485  6387 raft_consensus.cc:515] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.457240  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:58.457949  6162 raft_consensus.cc:3060] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.459501  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845e828d6c75461abcbd0ce48595d19e" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:58.460682  6086 raft_consensus.cc:2468] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 0.
I20260709 12:25:58.439968  6367 leader_election.cc:290] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.463510  6126 leader_election.cc:304] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.465458  6162 raft_consensus.cc:2468] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.465320  6236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:58.466245  6367 raft_consensus.cc:2804] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.466531  6236 raft_consensus.cc:3060] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.466718  6367 raft_consensus.cc:493] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.467131  6367 raft_consensus.cc:3060] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.475595  6236 raft_consensus.cc:2468] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.476015  6369 raft_consensus.cc:493] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.478145  6369 raft_consensus.cc:515] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.477006  6050 leader_election.cc:304] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.480355  6400 leader_election.cc:290] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.481071  6400 raft_consensus.cc:2804] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.481773  6400 raft_consensus.cc:697] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
W20260709 12:25:58.483690  6129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:37123, user_credentials={real_user=slave}} blocked reactor thread for 48425.2us
I20260709 12:25:58.480402  6369 leader_election.cc:290] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.485234  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:58.486090  6162 raft_consensus.cc:2468] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.486393  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1082978956344a98cc1a8932485542c" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:58.482796  6400 consensus_queue.cc:237] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.488500  6237 raft_consensus.cc:3060] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.488829  6235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845e828d6c75461abcbd0ce48595d19e" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:58.494043  6235 raft_consensus.cc:2468] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 0.
I20260709 12:25:58.489625  6050 leader_election.cc:304] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.508460  6285 raft_consensus.cc:2804] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.509042  6285 raft_consensus.cc:493] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.509409  6285 raft_consensus.cc:3060] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.490082  6423 consensus_queue.cc:1048] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.511368  5981 catalog_manager.cc:5697] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.475654  6387 leader_election.cc:290] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.493475  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:58.515491  6238 raft_consensus.cc:2468] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.519625  6367 raft_consensus.cc:515] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.513736  6237 raft_consensus.cc:2468] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:58.522249  6285 raft_consensus.cc:515] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.526186  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:58.527699  6162 raft_consensus.cc:3060] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.529311  6426 consensus_queue.cc:1048] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.528668  6285 leader_election.cc:290] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.537061  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845e828d6c75461abcbd0ce48595d19e" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:58.538038  6086 raft_consensus.cc:3060] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.538877  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "845e828d6c75461abcbd0ce48595d19e" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:58.539652  6238 raft_consensus.cc:3060] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.543313  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:58.544984  6237 raft_consensus.cc:3060] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.537355  6367 leader_election.cc:290] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.548288  6285 raft_consensus.cc:493] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.549607  6285 raft_consensus.cc:515] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.556169  6285 leader_election.cc:290] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.552141  6086 raft_consensus.cc:2468] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:58.556259  6403 consensus_queue.cc:1048] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.557499  6234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3a322d8d08466badc26828b525928c" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f" is_pre_election: true
I20260709 12:25:58.558334  6234 raft_consensus.cc:2468] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.559127  6126 leader_election.cc:304] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.560799  6053 leader_election.cc:304] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:58.560963  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3a322d8d08466badc26828b525928c" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:58.562126  6163 raft_consensus.cc:2468] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 0.
I20260709 12:25:58.563021  6285 raft_consensus.cc:2804] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.563349  6423 raft_consensus.cc:2804] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.563566  6285 raft_consensus.cc:493] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.564232  6423 raft_consensus.cc:697] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:58.565582  6423 consensus_queue.cc:237] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.569137  6237 raft_consensus.cc:2468] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.570950  6053 leader_election.cc:304] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:58.571986  6369 raft_consensus.cc:2804] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.572583  6369 raft_consensus.cc:697] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:58.573462  6369 consensus_queue.cc:237] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.564313  6285 raft_consensus.cc:3060] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.574781  5981 catalog_manager.cc:5697] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.603488  6162 raft_consensus.cc:2468] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.606874  6238 raft_consensus.cc:2468] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 1.
I20260709 12:25:58.606928  6403 consensus_queue.cc:1048] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.607234  5984 catalog_manager.cc:5697] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.609843  6285 raft_consensus.cc:515] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.612411  6285 leader_election.cc:290] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.600543  5983 catalog_manager.cc:5697] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 1 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.614277  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3a322d8d08466badc26828b525928c" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:58.614951  6238 raft_consensus.cc:3060] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.616971  6162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3a322d8d08466badc26828b525928c" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:58.617748  6162 raft_consensus.cc:3060] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.617707  6285 consensus_queue.cc:1048] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.631085  6162 raft_consensus.cc:2468] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.632011  6238 raft_consensus.cc:2468] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 1.
I20260709 12:25:58.632501  6050 leader_election.cc:304] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:58.633582  6285 raft_consensus.cc:2804] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.634083  6285 raft_consensus.cc:697] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:58.634857  6285 consensus_queue.cc:237] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.654044  5983 catalog_manager.cc:5697] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 0 to 1, leader changed from <none> to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 1 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.674809  6403 raft_consensus.cc:493] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.675491  6403 raft_consensus.cc:515] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.677703  6403 leader_election.cc:290] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:58.678720  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" is_pre_election: true
I20260709 12:25:58.679121  6161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faddcbddd06346abb34a17c26abbf867" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4" is_pre_election: true
I20260709 12:25:58.680099  6161 raft_consensus.cc:2393] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fca9d7f013534f2db61763ee726db44f in current term 1: Already voted for candidate 88393fc7d68a4a65bf024ffb5afdf44f in this term.
I20260709 12:25:58.681051  6200 leader_election.cc:304] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fca9d7f013534f2db61763ee726db44f; no voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:58.681808  6403 raft_consensus.cc:3060] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.688225  6403 raft_consensus.cc:2749] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.742030  6285 consensus_queue.cc:1048] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.747313  6161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
mode: GRACEFUL
new_leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:54440
I20260709 12:25:58.747996  6161 raft_consensus.cc:606] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Received request to transfer leadership to TS 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:58.754567  6285 consensus_queue.cc:1048] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.767457  6235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6783d96deab84d08b11af210aeff203f"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
mode: GRACEFUL
new_leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:39308
I20260709 12:25:58.768277  6235 raft_consensus.cc:606] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Received request to transfer leadership to TS 88393fc7d68a4a65bf024ffb5afdf44f
I20260709 12:25:58.788437  6086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
mode: GRACEFUL
new_leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:33578
I20260709 12:25:58.789016  6086 raft_consensus.cc:606] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Received request to transfer leadership to TS 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:58.799226  6086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3a322d8d08466badc26828b525928c"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
mode: GRACEFUL
new_leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:33578
I20260709 12:25:58.799845  6086 raft_consensus.cc:606] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Received request to transfer leadership to TS 42b2e7f4797844a2a6d969b44e7513f4
I20260709 12:25:58.805619  6086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
mode: GRACEFUL
new_leader_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:33578
I20260709 12:25:58.806284  6086 raft_consensus.cc:606] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Received request to transfer leadership to TS fca9d7f013534f2db61763ee726db44f
I20260709 12:25:58.851718  6423 consensus_queue.cc:1048] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.863899  6367 consensus_queue.cc:1048] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.966943  6420 raft_consensus.cc:993] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: : Instructing follower 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:58.967658  6420 raft_consensus.cc:1081] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Signalling peer 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:58.969715  6086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:33570
I20260709 12:25:58.970376  6086 raft_consensus.cc:493] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:58.970762  6086 raft_consensus.cc:3060] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.974255  6420 consensus_queue.cc:1048] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.977571  6086 raft_consensus.cc:515] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.980733  6086 leader_election.cc:290] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:58.982583  6161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:58.983228  6161 raft_consensus.cc:3055] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:58.983615  6161 raft_consensus.cc:740] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:58.983319  6235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b90ae35ddf804cfea779d504e259a30b" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:58.984854  6235 raft_consensus.cc:3060] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.984634  6161 consensus_queue.cc:260] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:58.991731  6161 raft_consensus.cc:3060] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:58.993925  6420 consensus_queue.cc:1048] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:58.994971  6235 raft_consensus.cc:2468] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:58.996593  6053 leader_election.cc:304] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:58.997665  6285 raft_consensus.cc:2804] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:58.998138  6285 raft_consensus.cc:697] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:58.998921  6285 consensus_queue.cc:237] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.003683  6161 raft_consensus.cc:2468] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:59.007194  6285 consensus_queue.cc:1048] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.015414  5984 catalog_manager.cc:5697] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 1 to 2, leader changed from 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66) to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 2 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.023239  6400 consensus_queue.cc:1048] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.037379  6400 raft_consensus.cc:993] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: : Instructing follower fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:25:59.037914  6285 raft_consensus.cc:1081] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Signalling peer fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:25:59.039397  6235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:39280
I20260709 12:25:59.039958  6235 raft_consensus.cc:493] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.040269  6235 raft_consensus.cc:3060] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.045739  6235 raft_consensus.cc:515] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.047523  6235 leader_election.cc:290] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:25:59.048516  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:59.048947  6161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d945e7c2faba4a98a9c4ed0505b39446" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:59.049450  6086 raft_consensus.cc:3055] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:59.049561  6161 raft_consensus.cc:3060] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.049858  6086 raft_consensus.cc:740] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:59.050760  6086 consensus_queue.cc:260] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.054181  6086 raft_consensus.cc:3060] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.057847  6161 raft_consensus.cc:2468] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 2.
I20260709 12:25:59.059262  6200 leader_election.cc:304] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:59.060125  6403 raft_consensus.cc:2804] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.060676  6403 raft_consensus.cc:697] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 2 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:59.061550  6403 consensus_queue.cc:237] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.062034  6086 raft_consensus.cc:2468] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 2.
I20260709 12:25:59.068464  5984 catalog_manager.cc:5697] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 1 to 2, leader changed from 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65) to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 2 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.112928  6285 consensus_queue.cc:1048] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.127209  6433 consensus_queue.cc:1048] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.133451  6394 raft_consensus.cc:993] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: : Instructing follower 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:59.134033  6403 raft_consensus.cc:1081] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Signalling peer 88393fc7d68a4a65bf024ffb5afdf44f to start an election
I20260709 12:25:59.136546  6086 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6783d96deab84d08b11af210aeff203f"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
 from {username='slave'} at 127.0.0.1:33554
I20260709 12:25:59.137174  6086 raft_consensus.cc:493] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.137543  6086 raft_consensus.cc:3060] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.146587  6426 consensus_queue.cc:1048] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:59.148123  6285 raft_consensus.cc:993] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: : Instructing follower 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:59.148689  6426 raft_consensus.cc:1081] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Signalling peer 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:59.150583  6086 raft_consensus.cc:515] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.154296  6086 leader_election.cc:290] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Requested vote from peers 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:59.155861  6161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:54426
I20260709 12:25:59.156011  6238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6783d96deab84d08b11af210aeff203f" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:59.156397  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6783d96deab84d08b11af210aeff203f" candidate_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:25:59.156525  6161 raft_consensus.cc:493] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.156945  6238 raft_consensus.cc:3055] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:59.157164  6161 raft_consensus.cc:3060] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.157181  6163 raft_consensus.cc:3060] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.159492  6238 raft_consensus.cc:740] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:25:59.160849  6238 consensus_queue.cc:260] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.162613  6238 raft_consensus.cc:3060] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.165172  6163 raft_consensus.cc:2468] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:59.165256  6161 raft_consensus.cc:515] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.166790  6050 leader_election.cc:304] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:59.167661  6161 leader_election.cc:290] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:59.170029  6237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:59.171030  6237 raft_consensus.cc:3060] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.172333  6400 raft_consensus.cc:2804] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.172904  6400 raft_consensus.cc:697] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Becoming Leader. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:59.173844  6400 consensus_queue.cc:237] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.178079  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8548c521c94866b05f2943785a3ef0" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:59.178735  6086 raft_consensus.cc:3055] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:59.179071  6086 raft_consensus.cc:740] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:59.179905  6086 consensus_queue.cc:260] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.181342  6086 raft_consensus.cc:3060] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.186839  6400 consensus_queue.cc:1048] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:59.190759  5981 catalog_manager.cc:5697] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f reported cstate change: term changed from 1 to 2, leader changed from fca9d7f013534f2db61763ee726db44f (127.28.234.67) to 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65). New cstate: current_term: 2 leader_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.195582  6238 raft_consensus.cc:2468] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88393fc7d68a4a65bf024ffb5afdf44f in term 2.
I20260709 12:25:59.201121  6086 raft_consensus.cc:2468] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:59.204205  6126 leader_election.cc:304] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, 88393fc7d68a4a65bf024ffb5afdf44f; no voters: 
I20260709 12:25:59.205060  6367 raft_consensus.cc:2804] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.205796  6237 raft_consensus.cc:2468] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:59.205619  6367 raft_consensus.cc:697] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:59.207170  6367 consensus_queue.cc:237] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.209969  6285 raft_consensus.cc:993] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: : Instructing follower 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:59.210539  6285 raft_consensus.cc:1081] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Signalling peer 42b2e7f4797844a2a6d969b44e7513f4 to start an election
I20260709 12:25:59.212604  6162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3a322d8d08466badc26828b525928c"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
 from {username='slave'} at 127.0.0.1:54426
I20260709 12:25:59.213312  6162 raft_consensus.cc:493] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:59.213692  6162 raft_consensus.cc:3060] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.223209  5982 catalog_manager.cc:5697] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 1 to 2, leader changed from 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65) to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.227587  6162 raft_consensus.cc:515] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.230041  6162 leader_election.cc:290] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), fca9d7f013534f2db61763ee726db44f (127.28.234.67:37123)
I20260709 12:25:59.231155  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3a322d8d08466badc26828b525928c" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:25:59.231850  6086 raft_consensus.cc:3055] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:59.232236  6086 raft_consensus.cc:740] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:25:59.233950  6234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3a322d8d08466badc26828b525928c" candidate_uuid: "42b2e7f4797844a2a6d969b44e7513f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fca9d7f013534f2db61763ee726db44f"
I20260709 12:25:59.234714  6234 raft_consensus.cc:3060] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.235509  6086 consensus_queue.cc:260] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.236585  6086 raft_consensus.cc:3060] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:59.238040  6161 raft_consensus.cc:1240] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Rejecting Update request from peer 88393fc7d68a4a65bf024ffb5afdf44f for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:59.243374  6234 raft_consensus.cc:2468] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:59.243721  6086 raft_consensus.cc:2468] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42b2e7f4797844a2a6d969b44e7513f4 in term 2.
I20260709 12:25:59.245146  6129 leader_election.cc:304] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:25:59.246325  6367 raft_consensus.cc:2804] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:59.246948  6367 raft_consensus.cc:697] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Becoming Leader. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:25:59.247892  6367 consensus_queue.cc:237] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:25:59.257627  5983 catalog_manager.cc:5697] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 reported cstate change: term changed from 1 to 2, leader changed from 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65) to 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66). New cstate: current_term: 2 leader_uuid: "42b2e7f4797844a2a6d969b44e7513f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.538300  6161 raft_consensus.cc:1275] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.539837  6426 consensus_queue.cc:1048] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:59.542341  6086 raft_consensus.cc:1275] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.544082  6403 consensus_queue.cc:1048] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:59.556102  6234 raft_consensus.cc:1275] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.560850  6161 raft_consensus.cc:1275] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.561481  6426 consensus_queue.cc:1048] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:59.565095  6403 consensus_queue.cc:1048] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:25:59.592334  6087 raft_consensus.cc:1275] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.593855  6423 consensus_queue.cc:1048] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.602325  6234 raft_consensus.cc:1275] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.604403  6367 consensus_queue.cc:1048] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.678915  6161 raft_consensus.cc:1275] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.680480  6426 consensus_queue.cc:1048] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.690279  6234 raft_consensus.cc:1275] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 88393fc7d68a4a65bf024ffb5afdf44f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.692269  6426 consensus_queue.cc:1048] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.790850  6234 raft_consensus.cc:1275] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.792870  6423 consensus_queue.cc:1048] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:59.802070  6087 raft_consensus.cc:1275] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Refusing update from remote peer 42b2e7f4797844a2a6d969b44e7513f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:59.806038  6456 consensus_queue.cc:1048] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:01.809923  5982 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55844:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:26:01.830595  5982 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55844:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20260709 12:26:02.068780  6053 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:37123, user_credentials={real_user=slave}} blocked reactor thread for 44234us
W20260709 12:26:02.138792  6129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.67:37123, user_credentials={real_user=slave}} blocked reactor thread for 111708us
I20260709 12:26:02.165335  6498 tablet.cc:1724] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.180281  6496 tablet.cc:1724] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.183825  6490 tablet.cc:1724] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:02.188587  6050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:35993, user_credentials={real_user=slave}} blocked reactor thread for 44799.7us
I20260709 12:26:02.194793  6495 tablet.cc:1724] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.235292  6502 tablet.cc:1724] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.250113  6505 tablet.cc:1724] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.250675  6506 tablet.cc:1724] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:02.309609  6050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:35993, user_credentials={real_user=slave}} blocked reactor thread for 118644us
I20260709 12:26:02.323992  6508 tablet.cc:1724] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.339959  6496 tablet.cc:1724] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.402134  6505 tablet.cc:1724] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.427271  6511 tablet.cc:1724] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:02.465730  6050 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.66:35993, user_credentials={real_user=slave}} blocked reactor thread for 115186us
I20260709 12:26:02.494855 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:02.462661  6502 tablet.cc:1724] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.510313  6495 tablet.cc:1724] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.681613  6502 tablet.cc:1724] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:02.714444  6126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:43749, user_credentials={real_user=slave}} blocked reactor thread for 254403us
W20260709 12:26:02.725293  6469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.008s	sys 0.000s
W20260709 12:26:02.725847  6469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.009s	sys 0.000s
I20260709 12:26:02.727681  6508 tablet.cc:1724] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.727711  6496 tablet.cc:1724] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.742094  6511 tablet.cc:1724] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.749387  6506 tablet.cc:1724] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.787554  6505 tablet.cc:1724] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.802904  6506 tablet.cc:1724] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:26:02.805676  6200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.234.65:43749, user_credentials={real_user=slave}} blocked reactor thread for 51776.9us
I20260709 12:26:02.816641  6508 tablet.cc:1724] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.818252  6495 tablet.cc:1724] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.821501  6502 tablet.cc:1724] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.849952  6495 tablet.cc:1724] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.872839  6161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65"
dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
mode: GRACEFUL
new_leader_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:51646
I20260709 12:26:02.874334  6161 raft_consensus.cc:606] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Received request to transfer leadership to TS fca9d7f013534f2db61763ee726db44f
I20260709 12:26:02.907922  6531 tablet.cc:1724] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.925624  6495 tablet.cc:1724] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.934470  6531 tablet.cc:1724] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:26:02.957360  6086 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90"
dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
mode: GRACEFUL
new_leader_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:51454
I20260709 12:26:02.958357  6086 raft_consensus.cc:606] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Received request to transfer leadership to TS fca9d7f013534f2db61763ee726db44f
I20260709 12:26:02.960314 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:02.961052 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:02.962779  5984 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d: soft_deleted_table [id=a988c3b5dac34e1e88f396f04d05a10f] alter complete (version 1)
I20260709 12:26:03.024261  6497 raft_consensus.cc:993] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f: : Instructing follower fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:26:03.024883  6450 raft_consensus.cc:1081] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Signalling peer fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:26:03.026950  6238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:39280
I20260709 12:26:03.027611  6238 raft_consensus.cc:493] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.027959  6238 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.035389  6238 raft_consensus.cc:515] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:26:03.037230  6238 leader_election.cc:290] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 3 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:26:03.038568  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:26:03.038987  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff27e98dae54731b930fd6f1607ef90" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:26:03.039578  6086 raft_consensus.cc:3055] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.039794  6163 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.040012  6086 raft_consensus.cc:740] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88393fc7d68a4a65bf024ffb5afdf44f, State: Running, Role: LEADER
I20260709 12:26:03.041338  6086 consensus_queue.cc:260] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:26:03.043249  6086 raft_consensus.cc:3060] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.051784  6163 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 3.
I20260709 12:26:03.053428  6200 leader_election.cc:304] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42b2e7f4797844a2a6d969b44e7513f4, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:26:03.054559  6527 raft_consensus.cc:2804] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:03.055083  6086 raft_consensus.cc:2468] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 3.
I20260709 12:26:03.055171  6527 raft_consensus.cc:697] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 3 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:26:03.057454  6527 consensus_queue.cc:237] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } }
I20260709 12:26:03.068953  5984 catalog_manager.cc:5697] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 2 to 3, leader changed from 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65) to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 3 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.220091  6423 raft_consensus.cc:993] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4: : Instructing follower fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:26:03.220784  6501 raft_consensus.cc:1081] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Signalling peer fca9d7f013534f2db61763ee726db44f to start an election
I20260709 12:26:03.222846  6238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65"
dest_uuid: "fca9d7f013534f2db61763ee726db44f"
 from {username='slave'} at 127.0.0.1:39292
I20260709 12:26:03.223474  6238 raft_consensus.cc:493] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.223852  6238 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.230576  6238 raft_consensus.cc:515] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:26:03.232074  6238 leader_election.cc:290] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 3 election: Requested vote from peers 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749), 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993)
I20260709 12:26:03.233011  6086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "88393fc7d68a4a65bf024ffb5afdf44f"
I20260709 12:26:03.233338  6163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a57f74e26124120a1e043a9fe38df65" candidate_uuid: "fca9d7f013534f2db61763ee726db44f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42b2e7f4797844a2a6d969b44e7513f4"
I20260709 12:26:03.233584  6086 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.234001  6163 raft_consensus.cc:3055] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:03.234314  6163 raft_consensus.cc:740] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42b2e7f4797844a2a6d969b44e7513f4, State: Running, Role: LEADER
I20260709 12:26:03.235107  6163 consensus_queue.cc:260] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:26:03.236317  6163 raft_consensus.cc:3060] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:03.239239  6086 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 3.
I20260709 12:26:03.240931  6200 leader_election.cc:304] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88393fc7d68a4a65bf024ffb5afdf44f, fca9d7f013534f2db61763ee726db44f; no voters: 
I20260709 12:26:03.241834  6527 raft_consensus.cc:2804] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:03.242566  6527 raft_consensus.cc:697] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 3 LEADER]: Becoming Leader. State: Replica: fca9d7f013534f2db61763ee726db44f, State: Running, Role: LEADER
I20260709 12:26:03.243515  6163 raft_consensus.cc:2468] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fca9d7f013534f2db61763ee726db44f in term 3.
I20260709 12:26:03.243507  6527 consensus_queue.cc:237] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } }
I20260709 12:26:03.256402  5984 catalog_manager.cc:5697] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f reported cstate change: term changed from 2 to 3, leader changed from 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66) to fca9d7f013534f2db61763ee726db44f (127.28.234.67). New cstate: current_term: 3 leader_uuid: "fca9d7f013534f2db61763ee726db44f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fca9d7f013534f2db61763ee726db44f" member_type: VOTER last_known_addr { host: "127.28.234.67" port: 37123 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:03.516458  6109 debug-util.cc:398] Leaking SignalData structure 0x7b0800088960 after lost signal to thread 29612
W20260709 12:26:03.517694  6109 debug-util.cc:398] Leaking SignalData structure 0x7b080026dda0 after lost signal to thread 6019
W20260709 12:26:03.520829  6109 debug-util.cc:398] Leaking SignalData structure 0x7b08000d52e0 after lost signal to thread 6262
I20260709 12:26:03.549060  6086 raft_consensus.cc:1275] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.550797  6527 consensus_queue.cc:1048] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.567921  6161 raft_consensus.cc:1275] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.572094  6520 consensus_queue.cc:1048] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.639472  6086 raft_consensus.cc:1275] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.640856  6520 consensus_queue.cc:1048] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88393fc7d68a4a65bf024ffb5afdf44f" member_type: VOTER last_known_addr { host: "127.28.234.65" port: 43749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.649340  6161 raft_consensus.cc:1275] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Refusing update from remote peer fca9d7f013534f2db61763ee726db44f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:03.655393  6520 consensus_queue.cc:1048] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42b2e7f4797844a2a6d969b44e7513f4" member_type: VOTER last_known_addr { host: "127.28.234.66" port: 35993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:03.962230 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:03.970822 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:03.971906 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:04.973223 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.979125 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:04.979636 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:05.980757 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:05.988372 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:05.989043 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.990465 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.999146 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:06.999867 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.001201 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.009950 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:08.010624 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:09.011771 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.017354 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:09.018069 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:10.019295 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.026618 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:10.027208 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.028421 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.035386 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:11.035864 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:12.036988 29609 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.042162 29609 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:12.042672 29609 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:13.114616 29609 tablet_server.cc:179] TabletServer@127.28.234.65:0 shutting down...
W20260709 12:26:13.121158  6126 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
W20260709 12:26:13.127499  6126 consensus_peers.cc:597] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.159248  6200 consensus_peers.cc:597] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.166961 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:13.168166 29609 tablet_replica.cc:333] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.169153 29609 raft_consensus.cc:2243] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.170135 29609 raft_consensus.cc:2272] T d945e7c2faba4a98a9c4ed0505b39446 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.173220 29609 tablet_replica.cc:333] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.174316 29609 raft_consensus.cc:2243] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.175943 29609 raft_consensus.cc:2272] T faddcbddd06346abb34a17c26abbf867 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.180467 29609 tablet_replica.cc:333] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.182039 29609 raft_consensus.cc:2243] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.182991 29609 raft_consensus.cc:2272] T 6a3a322d8d08466badc26828b525928c P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.187227 29609 tablet_replica.cc:333] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.188210 29609 raft_consensus.cc:2243] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.189118 29609 raft_consensus.cc:2272] T ca8548c521c94866b05f2943785a3ef0 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.193397 29609 tablet_replica.cc:333] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.194515 29609 raft_consensus.cc:2243] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.195317 29609 raft_consensus.cc:2272] T 4dba407d35514d178c5d3ad4fa4f0554 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.199717 29609 tablet_replica.cc:333] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.200810 29609 raft_consensus.cc:2243] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.202445 29609 raft_consensus.cc:2272] T b90ae35ddf804cfea779d504e259a30b P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.207456 29609 tablet_replica.cc:333] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.208513 29609 raft_consensus.cc:2243] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.209110 29609 raft_consensus.cc:2272] T 2a57f74e26124120a1e043a9fe38df65 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.211827 29609 tablet_replica.cc:333] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.212529 29609 raft_consensus.cc:2243] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.213234 29609 raft_consensus.cc:2272] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.216614 29609 tablet_replica.cc:333] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.217413 29609 raft_consensus.cc:2243] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.218284 29609 raft_consensus.cc:2272] T 845e828d6c75461abcbd0ce48595d19e P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.222318 29609 tablet_replica.cc:333] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.223141 29609 raft_consensus.cc:2243] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.224225 29609 raft_consensus.cc:2272] T f19e0b72cd1344129e7e14a1c969a7aa P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.226897 29609 tablet_replica.cc:333] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.227578 29609 raft_consensus.cc:2243] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.228142 29609 raft_consensus.cc:2272] T 17d69c11c5bd408e9becdce0b106eeeb P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.230728 29609 tablet_replica.cc:333] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.231379 29609 raft_consensus.cc:2243] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.232435 29609 raft_consensus.cc:2272] T 3720c332e3894c81aa9ed54af81dfb74 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.234959 29609 tablet_replica.cc:333] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.235643 29609 raft_consensus.cc:2243] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.236631 29609 raft_consensus.cc:2272] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.239329 29609 tablet_replica.cc:333] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.239972 29609 raft_consensus.cc:2243] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.240605 29609 raft_consensus.cc:2272] T 24c965fa00b541deb716a40664f99018 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.243198 29609 tablet_replica.cc:333] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.243999 29609 raft_consensus.cc:2243] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.245354 29609 raft_consensus.cc:2272] T 6783d96deab84d08b11af210aeff203f P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.248010  6126 consensus_peers.cc:597] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.249179 29609 tablet_replica.cc:333] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.250032 29609 raft_consensus.cc:2243] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.251405 29609 raft_consensus.cc:2272] T a5a350ea66eb43d7a0057e1dc92d6a73 P 88393fc7d68a4a65bf024ffb5afdf44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.254052 29609 tablet_replica.cc:333] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.254657 29609 raft_consensus.cc:2243] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.255240 29609 raft_consensus.cc:2272] T b1082978956344a98cc1a8932485542c P 88393fc7d68a4a65bf024ffb5afdf44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.258883 29609 tablet_replica.cc:333] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f: stopping tablet replica
I20260709 12:26:13.259636 29609 raft_consensus.cc:2243] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.260318 29609 raft_consensus.cc:2272] T 4ff27e98dae54731b930fd6f1607ef90 P 88393fc7d68a4a65bf024ffb5afdf44f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.273618  6126 consensus_peers.cc:597] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.291496  6126 consensus_peers.cc:597] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.331526  6200 consensus_peers.cc:597] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.350226 29609 tablet_server.cc:196] TabletServer@127.28.234.65:0 shutdown complete.
I20260709 12:26:13.406005 29609 tablet_server.cc:179] TabletServer@127.28.234.66:0 shutting down...
I20260709 12:26:13.439503 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:13.440341 29609 tablet_replica.cc:333] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.441394 29609 raft_consensus.cc:2243] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.442581 29609 raft_consensus.cc:2272] T ca8548c521c94866b05f2943785a3ef0 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.445154 29609 tablet_replica.cc:333] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.446053 29609 raft_consensus.cc:2243] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.447113 29609 raft_consensus.cc:2272] T 6a3a322d8d08466badc26828b525928c P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.449666 29609 tablet_replica.cc:333] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.450388 29609 raft_consensus.cc:2243] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.451006 29609 raft_consensus.cc:2272] T d945e7c2faba4a98a9c4ed0505b39446 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.453428 29609 tablet_replica.cc:333] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.454149 29609 raft_consensus.cc:2243] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.454734 29609 raft_consensus.cc:2272] T faddcbddd06346abb34a17c26abbf867 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.458282 29609 tablet_replica.cc:333] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.459168 29609 raft_consensus.cc:2243] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.460412 29609 raft_consensus.cc:2272] T 4dba407d35514d178c5d3ad4fa4f0554 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.462273  6126 consensus_peers.cc:597] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.463503 29609 tablet_replica.cc:333] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.464324 29609 raft_consensus.cc:2243] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.464965 29609 raft_consensus.cc:2272] T b90ae35ddf804cfea779d504e259a30b P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.467715 29609 tablet_replica.cc:333] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.468436 29609 raft_consensus.cc:2243] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.469018 29609 raft_consensus.cc:2272] T 2a57f74e26124120a1e043a9fe38df65 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.471552 29609 tablet_replica.cc:333] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.472159 29609 raft_consensus.cc:2243] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.472815 29609 raft_consensus.cc:2272] T 6783d96deab84d08b11af210aeff203f P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.475479 29609 tablet_replica.cc:333] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.476141 29609 raft_consensus.cc:2243] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.476711 29609 raft_consensus.cc:2272] T a5a350ea66eb43d7a0057e1dc92d6a73 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.479167 29609 tablet_replica.cc:333] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.479785 29609 raft_consensus.cc:2243] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.480340 29609 raft_consensus.cc:2272] T 24c965fa00b541deb716a40664f99018 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.482765 29609 tablet_replica.cc:333] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.483367 29609 raft_consensus.cc:2243] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.484552 29609 raft_consensus.cc:2272] T 845e828d6c75461abcbd0ce48595d19e P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.487401 29609 tablet_replica.cc:333] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.488458 29609 raft_consensus.cc:2243] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.489312 29609 raft_consensus.cc:2272] T f19e0b72cd1344129e7e14a1c969a7aa P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:13.489528  6126 consensus_peers.cc:597] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.493060 29609 tablet_replica.cc:333] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
W20260709 12:26:13.493494  6200 consensus_peers.cc:597] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f -> Peer 88393fc7d68a4a65bf024ffb5afdf44f (127.28.234.65:43749): Couldn't send request to peer 88393fc7d68a4a65bf024ffb5afdf44f. Status: Network error: Client connection negotiation failed: client connection to 127.28.234.65:43749: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.494211 29609 raft_consensus.cc:2243] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:26:13.495497  6200 consensus_peers.cc:597] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f -> Peer 42b2e7f4797844a2a6d969b44e7513f4 (127.28.234.66:35993): Couldn't send request to peer 42b2e7f4797844a2a6d969b44e7513f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.495651 29609 raft_consensus.cc:2272] T 17d69c11c5bd408e9becdce0b106eeeb P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.498435 29609 tablet_replica.cc:333] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.499015 29609 raft_consensus.cc:2243] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.499981 29609 raft_consensus.cc:2272] T 1911e26a3c7f4f4db6985a3d90de5fc7 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.502739 29609 tablet_replica.cc:333] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.503350 29609 raft_consensus.cc:2243] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.503901 29609 raft_consensus.cc:2272] T c04a8d4a054d4d6a9e1dd4d5570f7158 P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.506500 29609 tablet_replica.cc:333] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.507083 29609 raft_consensus.cc:2243] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.507628 29609 raft_consensus.cc:2272] T 3720c332e3894c81aa9ed54af81dfb74 P 42b2e7f4797844a2a6d969b44e7513f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.510032 29609 tablet_replica.cc:333] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.510607 29609 raft_consensus.cc:2243] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.511618 29609 raft_consensus.cc:2272] T b1082978956344a98cc1a8932485542c P 42b2e7f4797844a2a6d969b44e7513f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.514808 29609 tablet_replica.cc:333] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4: stopping tablet replica
I20260709 12:26:13.515522 29609 raft_consensus.cc:2243] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.516206 29609 raft_consensus.cc:2272] T 4ff27e98dae54731b930fd6f1607ef90 P 42b2e7f4797844a2a6d969b44e7513f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.564640 29609 tablet_server.cc:196] TabletServer@127.28.234.66:0 shutdown complete.
I20260709 12:26:13.610715 29609 tablet_server.cc:179] TabletServer@127.28.234.67:0 shutting down...
I20260709 12:26:13.647815 29609 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:13.648758 29609 tablet_replica.cc:333] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.649688 29609 raft_consensus.cc:2243] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.650382 29609 raft_consensus.cc:2272] T faddcbddd06346abb34a17c26abbf867 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.652949 29609 tablet_replica.cc:333] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.653677 29609 raft_consensus.cc:2243] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.654754 29609 raft_consensus.cc:2272] T d945e7c2faba4a98a9c4ed0505b39446 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.657253 29609 tablet_replica.cc:333] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.658028 29609 raft_consensus.cc:2243] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.658613 29609 raft_consensus.cc:2272] T 6a3a322d8d08466badc26828b525928c P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.661026 29609 tablet_replica.cc:333] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.661666 29609 raft_consensus.cc:2243] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.662266 29609 raft_consensus.cc:2272] T ca8548c521c94866b05f2943785a3ef0 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.664649 29609 tablet_replica.cc:333] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.665278 29609 raft_consensus.cc:2243] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.665906 29609 raft_consensus.cc:2272] T 6783d96deab84d08b11af210aeff203f P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.668319 29609 tablet_replica.cc:333] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.669044 29609 raft_consensus.cc:2243] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.669605 29609 raft_consensus.cc:2272] T f19e0b72cd1344129e7e14a1c969a7aa P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.672037 29609 tablet_replica.cc:333] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.672679 29609 raft_consensus.cc:2243] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.673216 29609 raft_consensus.cc:2272] T 17d69c11c5bd408e9becdce0b106eeeb P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.675592 29609 tablet_replica.cc:333] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.676213 29609 raft_consensus.cc:2243] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.676793 29609 raft_consensus.cc:2272] T 845e828d6c75461abcbd0ce48595d19e P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.679189 29609 tablet_replica.cc:333] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.679822 29609 raft_consensus.cc:2243] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.680820 29609 raft_consensus.cc:2272] T 24c965fa00b541deb716a40664f99018 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.683161 29609 tablet_replica.cc:333] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.683792 29609 raft_consensus.cc:2243] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.684365 29609 raft_consensus.cc:2272] T b1082978956344a98cc1a8932485542c P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.686726 29609 tablet_replica.cc:333] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.687314 29609 raft_consensus.cc:2243] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.688354 29609 raft_consensus.cc:2272] T 4ff27e98dae54731b930fd6f1607ef90 P fca9d7f013534f2db61763ee726db44f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.690846 29609 tablet_replica.cc:333] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.691514 29609 raft_consensus.cc:2243] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.692082 29609 raft_consensus.cc:2272] T 1911e26a3c7f4f4db6985a3d90de5fc7 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.694310 29609 tablet_replica.cc:333] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.694941 29609 raft_consensus.cc:2243] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.695470 29609 raft_consensus.cc:2272] T 4dba407d35514d178c5d3ad4fa4f0554 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.698670 29609 tablet_replica.cc:333] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.699340 29609 raft_consensus.cc:2243] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.699937 29609 raft_consensus.cc:2272] T b90ae35ddf804cfea779d504e259a30b P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.702386 29609 tablet_replica.cc:333] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.702962 29609 raft_consensus.cc:2243] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.703980 29609 raft_consensus.cc:2272] T 2a57f74e26124120a1e043a9fe38df65 P fca9d7f013534f2db61763ee726db44f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.706499 29609 tablet_replica.cc:333] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.707114 29609 raft_consensus.cc:2243] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.707652 29609 raft_consensus.cc:2272] T 3720c332e3894c81aa9ed54af81dfb74 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.710005 29609 tablet_replica.cc:333] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.710593 29609 raft_consensus.cc:2243] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.711124 29609 raft_consensus.cc:2272] T c04a8d4a054d4d6a9e1dd4d5570f7158 P fca9d7f013534f2db61763ee726db44f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.713362 29609 tablet_replica.cc:333] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f: stopping tablet replica
I20260709 12:26:13.713915 29609 raft_consensus.cc:2243] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.714425 29609 raft_consensus.cc:2272] T a5a350ea66eb43d7a0057e1dc92d6a73 P fca9d7f013534f2db61763ee726db44f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.760159 29609 tablet_server.cc:196] TabletServer@127.28.234.67:0 shutdown complete.
I20260709 12:26:13.800900 29609 master.cc:562] Master@127.28.234.126:42355 shutting down...
I20260709 12:26:13.831509 29609 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:13.832319 29609 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.832639 29609 tablet_replica.cc:333] T 00000000000000000000000000000000 P 21df7d9b29b046728c18ed2332e0b54d: stopping tablet replica
I20260709 12:26:13.855788 29609 master.cc:584] Master@127.28.234.126:42355 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21407 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43285 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (339147 ms total)
[  PASSED  ] 8 tests.
I20260709 12:26:13.921372 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2252 messages since previous log ~32 seconds ago
I20260709 12:26:13.921633 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2250 messages since previous log ~32 seconds ago
I20260709 12:26:13.922045 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2245 messages since previous log ~32 seconds ago
I20260709 12:26:13.922243 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:26:13.922417 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:26:13.922595 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~197 seconds ago
I20260709 12:26:13.922823 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 12:26:13.923101 29609 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
